Difference between revisions of "Load RefSeq Into Chado"

From GMOD
Jump to: navigation, search
m (Download the Sequence Files: More genomes are availabe via ftp://ftp.ncbi.nih.gov/genomes/; some files are in GFF3 format (e.g. for bacteria))
(Add an Entry for Your Organism)
Line 18: Line 18:
 
You will need to have an entry for your species in the [[Chado_Tables#Table:_organism|Chado organism table]]. If you are unsure if this entry exists log into your database and execute this [[Glossary#SQL|SQL]] command:
 
You will need to have an entry for your species in the [[Chado_Tables#Table:_organism|Chado organism table]]. If you are unsure if this entry exists log into your database and execute this [[Glossary#SQL|SQL]] command:
 
<sql>
 
<sql>
select common_name from organism;
+
select genus,species,common_name from organism;
 
</sql>
 
</sql>
 
If you do not see your organism listed, execute a command equivalent to this:
 
If you do not see your organism listed, execute a command equivalent to this:
 
<sql>
 
<sql>
   insert into organism (abbreviation, genus, species, common_name, organism_id)
+
   insert into organism (abbreviation, genus, species, common_name)
                 values ('H.sapiens', 'Homo', 'sapiens', 'Human', 9606);
+
                 values ('H.sapiens', 'Homo', 'sapiens', 'Human');
 
</sql>
 
</sql>
 
Substitute in the appropriate values for your own organism.
 
Substitute in the appropriate values for your own organism.

Revision as of 15:43, 20 June 2011

This HOWTO describes a method for loading the sequence data in Genbank RefSeq files into the Chado database.

Download the Sequence Files

These steps have been used to load data from genomic RefSeq files. You can recognize these files by their NC_ and NT_ prefixes. First download the Genbank genome files of interest. A good source for RefSeq files is NCBI's FTP site. This website provides some files in GFF3 format (suffix .gff). Files in the Genbank format have the suffix .gbk.

Convert RefSeq to GFF3

Use the BioPerl script genbank2gff3.pl, found in scripts/Bio-DB-GFF/ within the BioPerl distribution. If you've actually installed BioPerl then the installed script will have been renamed bp_genbank2gff3.pl. Note that there's also an older genbank2gff.pl script, don't use it.

 >bp_genbank2gff3.pl <filename>

This will create a GFF3 file. It may give several warnings about unrecognized feature types. If the feature types are not part of SOFA, you will have to hand edit the resulting GFF3 file to change the feature type. Any skipped features will be printed at the end. If you want those to be part of the GFF3 file, you will have to add those manually as well, fixing any non-SOFA feature types.

Add an Entry for Your Organism

You will need to have an entry for your species in the Chado organism table. If you are unsure if this entry exists log into your database and execute this SQL command: <sql> select genus,species,common_name from organism; </sql> If you do not see your organism listed, execute a command equivalent to this: <sql>

 insert into organism (abbreviation, genus, species, common_name)
               values ('H.sapiens', 'Homo', 'sapiens', 'Human');

</sql> Substitute in the appropriate values for your own organism.

Load the GFF3

Run the load/bin/gmod_load_gff3.pl script from the GMOD distribution:

  >gmod_load_gff3.pl --organism <your org common name>  --srcdb DB:genbank --gfffile <your gfffile>

This will load your data into the Chado database. Note that if there are non-SOFA feature types remaining in the GFF3 file the load will fail when they are encountered. If that happens, edit the file to fix the incorrect term and load again. Only the previously unloaded data will load (i.e. you won't have duplicate rows).

More Information

Please send questions to the GMOD developers list:

gmod-devel@lists.sourceforge.net


Authors