Consistent annotation of gene expression arrays
© Ballester et al; licensee BioMed Central Ltd. 2010
Received: 20 July 2009
Accepted: 11 May 2010
Published: 11 May 2010
Gene expression arrays are valuable and widely used tools for biomedical research. Today's commercial arrays attempt to measure the expression level of all of the genes in the genome. Effectively translating the results from the microarray into a biological interpretation requires an accurate mapping between the probesets on the array and the genes that they are targeting. Although major array manufacturers provide annotations of their gene expression arrays, the methods used by various manufacturers are different and the annotations are difficult to keep up to date in the rapidly changing world of biological sequence databases.
We have created a consistent microarray annotation protocol applicable to all of the major array manufacturers. We constantly keep our annotations updated with the latest Ensembl Gene predictions, and thus cross-referenced with a large number of external biomedical sequence database identifiers. We show that these annotations are accurate and address in detail reasons for the minority of probesets that cannot be annotated. Annotations are publicly accessible through the Ensembl Genome Browser and programmatically through the Ensembl Application Programming Interface. They are also seamlessly integrated into the BioMart data-mining tool and the biomaRt package of BioConductor.
Consistent, accurate and updated gene expression array annotations remain critical for biological research. Our annotations facilitate accurate biological interpretation of gene expression profiles.
Since their introduction, microarrays have become an essential technology to measure the expression of thousands of genes in a single experiment. The widespread use of microarray technology required solutions to a number of challenges related to the analysis, storage and organisation of the data. Previous reports have detailed considerable progress in genomic scale analysis of complex gene expression data  the federation and warehousing of large amounts of data , the reproducibility of experiments across platform and laboratory  and the definition of standards for presenting and exchanging such data .
Recently, attention has been focused on improving the annotation of probes and probesets [5–7]. This has been driven by the combination of improved genome assemblies , more accurate genome annotations , new results describing the extent of transcription in the genome  and the recent availability of the actual DNA sequences on standard microarrays. Indeed since the time of initial probe design on most microarrays, updated genome assemblies and refined transcript structures based on data sources such as full length cDNAs, CAGE (short cap analysis of gene expression sequences) and diTags  have made updated probeset annotation critically important. As an example, between Ensembl release 25 http://oct2004.archive.ensembl.org and Ensembl release 51 http://nov2008.archive.ensembl.org the human genome assembly was updated twice and the number of evidence-based protein-coding transcripts identified by the Ensembl Genebuild increased by approximately 27% (from 34,111 to 46,752). This increase is especially significant considering that the number of annotated protein coding genes in Ensembl actually decreased during this same time frame (from 22,291 to 21,714). Accurate knowledge of what expression products the probes and probesets are measuring is fundamental for all downstream analysis in order to ensure accurate biological interpretation of the results.
Affymetrix GeneChips use a variable number of pairs of 25 mer oligonucleotide probes to form a probeset representing a target transcript or gene. These pairs consist of a perfect match (PM) probe identical to target transcript sequence and a mismatch (MM) probe where the 13th (i.e. middle) nucleotide differs. For a given target transcript or gene, the number of PM-MM pairs varies from 11 to 20 depending on the GeneChip. Several attempts have been made to either reannotate the existing probesets or redefine probesets from the full set of probes. In both cases, these results are presented in various databases [5–7, 11, 12]. These previous studies are based on the same fundamental assumption that we make, namely that accurate genome annotation leads to better interpretation of gene expression data, and focus on the use of various mapping strategies to investigate ways of accurately matching probesets to the latest genomic knowledge. For example Gautier et al have reannotated the Affymetrix HG-U133A probesets by mapping the probes against Human Refseq mRNA using the BioConductor package matchprobes [5, 13]. Most reannotation efforts addressing GeneChip microarrays have remapped probes, or target sequences to external public databases of expressed sequence. One exception to this approach is Dai et al who aligned probes to the genome of the corresponding species as well as to external references for their updated probesets definitions .
In this paper, we present and assess our method to map and annotate gene expression arrays, using the Affymetrix GeneChip arrays as an example. In contrast to other methods, we employ direct mappings to both the reference genome and the Ensembl gene sets as the basis for the probeset annotation. This feature makes our annotations easily accessible for use with expression of protein coding genes and also with the more complex expression patterns such as antisense or pervasive transcription that have been observed in other studies [14–16]. Moreover, the Ensembl annotations are conducted in a consistent way across all supported species, and thus do not rely on the completeness of external data resources which are necessarily less complete for some species. Ensembl is updated approximately five times each year assuring that probeset annotations incorporate the most recently released datasets.
In the following sections we (i) describe exactly how probes are mapped and assigned to transcripts, (ii) demonstrate the quality of these annotations and (iii) present the bioinformatics resources to publicly access this information.
The mapping pipeline
It is important to note that this first step in the Ensembl probeset mapping pipeline is independent of the completeness or quality of the genome annotation, but dependent on the quality of the genome assembly. For example, Ensembl release 47 http://oct2007.archive.ensembl.org contained both an updated build of the finished Mus musculus assembly (NCBIm37)  and a combined Ensembl-Havana genebuild compared to Ensembl release 46. The new assembly alone results in some noticeable differences in the probe mapping as the number of probes mapped to the new assemblies tend to decrease, for example for the Mouse430A_2 array the number of probes mapped decreased by 8.4% (from 387341 to 354982) between the NCBIm36 and NCBIm37 assemblies. In general, for genomes with multiple assembly updates, such as human and mouse, we observe fewer probes mapping to improved assemblies, which may indicate that correcting assembly errors enhances probe mapping by removing probes designed against lower quality regions of the assembly.
The annotation pipeline
In the second step, we associate probes and probesets from commercial arrays with Ensembl transcripts. This step uses the mapping of the individual probes by associating those probes that are part of a defined probeset to a specific transcript. For successful transcript annotation, we require that at least half of the probes of a probeset match the underlying transcript sequence and 3' untranslated regions (3' UTRs) if available. The probeset sizes are calculated dynamically using the data available from the array design as for a given array the number of probes for a distinct probeset can vary. In cases where a transcript has a 3' UTR predicted based on experimental evidence we use the transcript and we double the length of the 3' UTR sequence for the probeset annotation. If a transcript has no 3' UTR annotated we extend the 3' most exon. The lengths of the extensions are computed as the greater of either the mean or median of all 3' UTRs in the given species. In future Ensembl releases, the extension will also be limited to avoid probesets being annotated to genes in close proximity unless there is independent evidence that the UTRs overlap. These extensions of transcript sequences are used to compensate for the absence of UTRs in some of the Ensembl transcript predictions. These occur because each Ensembl transcript UTR is based on experimental evidence from cDNAs, which in some cases can be incomplete leading to shorter or missing UTRs. Affymetrix probes and microarray probes in general tend to be designed against 3' ends of transcripts , mostly on the basis of EST evidence from NCBI's UniGene. Since for most species in Ensembl full length cDNA sequences are limited, extending the transcript length using a species-specific UTR size is a consistent means to successfully map probe sets to Ensembl transcripts.
Mapping probes to the Transcript set - Effects on the probeset annotation
In addition to mapping the probes to the genome, we investigated the effect of mapping the probes directly to the set of Ensembl transcripts represented as cDNAs. Mapping probes this way allowed us to assess the extent to which the probes are mapped across exon boundaries. The mapping of probes to cDNAs defined by Ensembl transcripts adds ~79,000 new alignments which corresponds to a ~2.2% increase, representing ~59,700 distinct probes (Ensembl release 51). Indeed some probes map at multiple locations on different genes, such as the probe 39540_at:245:7 from the HG_U95Av2 chip which maps to the Ensembl transcript ENST00000322357 on 19:3999238:4004988 (chromosome:start:end) as well as ENST00000332053 on 18:43810276:43820288. On the other hand some probes map to multiple transcripts of the same gene across different exon junctions, for instance the probe 61492_at:216:201 on the array HG_U95C maps to two different transcripts ENST00000366534 and ENST00000366533 from the same gene ENSG00000179397 but in slightly different locations. For the transcript ENST00000366534 the probe maps to the boundaries of exons 20 and 21 (ENSE00001441952 and ENSE00001441951) at the location of 1:242847609:242865435 and for ENST00000366533 maps to the boundaries of exons 19 and 20 (ENSE00001296059 and ENSE00001330630) at the location of 1:242840250:242865435. Other rare examples are probes mapping across three exons where the central exon is generally a short exon, for instance the probe 207136_at:1089:1005 from the array HG_U133_Plus_2 maps to the transcript ENST00000307959 on three exons, 7 bp on ENSE00001275564, 10 bp on ENSE00001425447, and 8 bp on ENSE00001275540. This 10 bp exon has strong supporting evidence from external protein identifiers P36575, NM_004312 and P36575-2 (Additional file 2, Figure S2).
Effect of updated array designs on probe annotation
Effect of new assemblies and genebuilds
The improved human genebuild focused on accurate transcript placement and UTR extensions, using both new methods and new data such as diTag information. For mouse, the new genebuild was created on the updated NCBI m37 mouse assembly. Somewhat unexpectedly our results indicate that increasing the accuracy of the transcript placement in human without a new assembly does remove some probeset annotations as some genes have had their structures improved. Between Ensembl release 46 and Ensembl release 51 the number of protein coding transcripts in human increased by about 4.8% (from 44340 to 46470), while the number of protein-coding genes decreased (from 22680 to 21714). As Dai et al described, at the time of the HG-U133 design, UniGene contained 2.8 million cDNA/ESTs but now contains 6.9 million sequences . Our results show that improved assemblies have a less striking impact on the annotation than do updated gene sets as the new mouse assembly had an average 1.2% decrease in coverage across microarrays. However, this is potentially modulated by the addition for the first time in the Ensembl mouse genebuild (Ensembl release 47) of a combined gene set featuring both the Ensembl automatic gene predictions and the Havana manual annotations . These manual annotations include more than 15,000 full-length protein-coding transcripts for the mouse annotated by the Havana team in addition to the Ensembl automatic genebuild. The new NCBI m37 mouse assembly is the first update of the finished mouse assembly, and has been a focus of annotation for the Consensus Coding Sequence (CCDS) project, a collaborative effort to produce a common set of CDS annotations of transcripts .
Comparing Ensembl annotation with Affymetrix annotation
Since the Affymetrix annotation is the most widely used probeset definition in numerous gene expression analysis packages including BioConductor, we compared our probesets annotation with the latest Affymetrix GeneChip annotations. The Affymetrix annotation includes information from a number of sources depending on the array including sequence information collected at the time of array design, information updated from public databases such as UniGene and protein matches from public and Affymetrix-created sources .
Additional file 4, Table S1 presents how Ensembl and Affymetrix compare using external accession identifiers common between these two annotations. When using the EntrezGene identifiers, the Human, Mouse and Rat chips have between 65% and 95% of EntrezGene IDs in common between Ensembl and Affymetrix annotations. These differences could be explained by the specificity of our rigorous external identifier reference mapping procedure that assigns Ensembl genes to external references. Given that ESTs from distinct genes could be falsely clustered together, some probesets could target genes with few or non-consistent external experimental references leading to separate annotations between Ensembl and Affymetrix. However comparing probeset annotation using external identifiers may not be the best approach to assess the performance of different reannotation methods when procedures for mapping external identifiers from public databases to probesets or genes are not common between Affymetrix and Ensembl. For example Affymetrix explains that UniGene identifiers are determined using the probeset's representative sequence . In the case that the sequence is not found in the current UniGene database the most common UniGene identifier of the sub-cluster sequences is used. Therefore, the UniGene identifier detected using such procedure may not be what Ensembl uses in the external reference mapping procedure.
Probesets annotated to multiple genes
Probeset annotation is complicated especially when a probeset may intentionally or unintentionally target multiple genes or transcripts. This multiple gene targeting may be the result of probesets designed against erroneous cDNA sequence or chimeric EST clusters containing ESTs from closely related genes or overlapping genes. These probesets may be more likely to exhibit cross-hybridization from splice variants or closely related genes (i.e. paralogues).
Allele-specific probes and mismatches
Updated array annotations are provided as necessary with each Ensembl release . Whenever a new assembly becomes available or a new gene set is produced, the probeset mapping and annotation is recomputed to present the most up-to-date and consistent probeset annotations. All gene expression array probes and probeset annotations are publicly accessible through a range of tools described below.
Data mining: Ensembl BioMart, Biomart.org and biomaRt
BioMart  is a data-mining tool to efficiently extract information from structured databases. Ensembl's BioMart includes the probeset annotations and is updated along with each Ensembl release. This can be used to access Ensembl genes and associated probeset annotations according to the user's specifications without any programming knowledge . An example BioMart query to fetch Affymetrix GeneChip HG_U133A_2 probesets annotation is as follows:
(i) Start: Select the Ensembl Gene database then the species of interest, for instance Homo sapiens. (ii) Filter: Apply the filter "with affy hg u133a 2 ID(s): Only" in the ID LIST LIMIT panel. (iii) Attribute: Select the output needed, for example Ensembl Gene ID, Ensembl Transcript ID, and the name of the microarray of interest AFFY HG U133A 2. (iv) Results: Hit the button "Results" to overview of the output before final export. Not using the ID LIST LIMIT filter will output genes linked to probesets and also genes without probesets annotation.
For R/BioConductor users, the package biomaRt  connects to the BioMart databases to fetch the latest Ensembl annotation directly into the R console. An example of a biomaRt query to fetch Affymetrix GeneChip HG_U133A annotation would be:
>human_mart <- useMart("ensembl", "hsapiens_gene_ensembl")
> affy_hg_u133a_ensembl_annotation = getBM(attributes = c("affy_hg_u133a", "hgnc_symbol", "ensembl_transcript_id"), filters = "with_affy_hg_u133a", values = c("1"), mart = human_mart)
> affy_hg_u133a_ensembl_annotation [350:355,]
affy_hg_u133a hgnc_symbol ensembl_transcript_id
350 205486_at TESK2 ENST00000372084
351 215662_at MMACHC ENST00000401061
352 211774_s_at MMACHC ENST00000401060
353 211774_s_at MMACHC ENST00000372082
354 219843_at ENST00000401059
355 215903_s_at MAST2 ENST00000372009
The Ensembl Perl API
Ensembl maintains a comprehensive set of Perl APIs, which permit the programmatic retrieval of data from the databases. Using the API, there are different routes to access our probe mapping and probeset annotations. One is to retrieve genomic mappings using the ProbeFeatureAdaptor which will fetch all the probes aligned to a given region (slice). An Ensembl Perl API example script is available as an additional file (Additional file 5) where other methods are described. Also we store in the database the reasons why a particular probe was not considered for a transcript annotation (e.g. intronic, anti-sense, insufficient hits).
Recent studies have shown the need to regularly and automatically re-annotate gene expression probes and probesets [7, 31, 35]. We show that aligning probe sequences to reference genome assemblies followed by association of mapped probes to the latest Ensembl genebuild leads to precise and consistent microarray annotation across species, with differences largely due to the quality of the underlying genome sequence assembly. The strength of the Ensembl probeset annotation pipeline lies in its simple genomic mapping rule rather than mapping consensus sequences to external databases (such as RefSeq, etc.) or relating probe identifiers to public database identifiers. With our non-restrictive probe alignment procedure, we keep and show probes located in non-coding regions, but also probes and probesets mapping to multiple locations. This is done to illustrate the potentially complex nature of annotating or designing a probeset. We believe researchers should be able to access the most comprehensive set of gene expression array annotation in additional to information suggesting a probe or probeset incorrectly targets a region or another gene.
In most of the published studies, probes or reference sequences were mapped against external databases or transcripts using strict alignment rules [5, 7, 36]. For example, to generate reorganized probesets based on UniGene, Dai et al applied a list of seven mapping steps, including steps for removing probes mapping to multiple cDNA/EST sequences, probes mapping to more than one location on the genome, and probes mapping in non-coding regions . In order to understand the problems encountered for some probesets, researchers should be able to access the quality of probe mappings for their downstream analysis.
While a majority of probesets are perfectly mapped to the genome and annotated to one gene and a few transcripts (Figure 6), a substantial number of probes and probesets present some difficulties in the mapping and annotation to transcript. In their studies Dai et al described in detail numerous problems confronted in the GeneChip probeset annotation; probeset redundancy, non-specificity of probes, genomic location issues and unreliable consensus sequences. A potential cause of these problems could be erroneous UniGene clusters used in the probeset design, for example old merged UniGene clusters. Our mapping pipeline retains genomic mappings with one mismatch regardless of the location on the genome, or multiple mappings (threshold of 100 locations). In spite of our fairly non-restrictive mapping procedure, our results reveal that not all probes of a microarray align to the genome (Figure 1) as some are non-specific with mismatches greater than one base pair whilst others have significant mapping to multiple locations (Figure S3).
While some probesets potentially target multiple genes (Figure 6), some probesets have been designed to specifically target a single gene. Sometimes these target a neighbouring gene as well and lead to ambiguous annotations. Stalteri et al examined in detail the problem of multiple probesets mapping to the same gene . They specifically studied a single case, the Affymetrix MOE430 chip and the genes Surf4/Surf2, which are located in a tail-to-tail conformation on mouse chromosome 2 (Figure 9). For this microarray, Affymetrix identified eight probesets targeting the Surf4 gene. However, after careful alignments Stalteri et al found that five probesets actually target the Surf4 gene, two probesets target the gene Surf2 on the opposite strand, and one probeset maps to a different chromosome. For these eight probesets, Ensembl essentially replicates the manual annotation of Stalteri et al. We correctly annotate the five probesets to Surf4 and the probeset found to be targeting chromosome 19. The remaining two probesets, which Stalteri et al annotate to Surf2 are mapped in the same genomic location by our procedure, but we annotate only one of the two probesets to Surf2. This difference is due to Stalteri et al's reliance of an alternative splice acceptor site on exon 6, where one of the probeset mapped. This alternative splice site is not included in the current Ensembl gene set because is not supported by the protein evidence we used.
Some studies [6, 36] have brought probeset mapping into another level in redefining complete probesets based on where probes aligned on transcripts. New probeset definitions regroup probes that consistently map to a set of transcripts or a single transcript variant. In their example with the probeset "33631_at" from HG_U95Av2, Lu, et al demonstrates how a set of 16 probes could be redefined in two distinct probesets, a probeset of 9 probes and another of 7 . Their probeset redefinition is then be used to measure specific transcript differential expression. The Ensembl probeset annotation pipeline does not produce probeset redefinitions, but use the manufacturer's original design. However, using the Ensembl API, researchers could use the genomic probe mapping information and the Ensembl transcript predictions to redefine probes into new custom probesets.
While this paper focused on the Affymetrix GeneChip probesets to describe our procedure to map and annotate gene expression arrays, our pipeline is also implemented to annotate arrays made by other manufacturers, including both Illumina and CodeLink expression arrays.
Our method to map microarray probes and annotate probesets to the latest Ensembl gene sets provides a consistent annotation of gene expression arrays available to researchers. For some arrays a substantial number of probesets cause problems but these issues have been identified and are taken into account by our annotation methods. However, with the recent advances in functional elements identification and the massive parallel sequencing technologies our understanding of the genome and transcriptome is evolving. Consequently, regularly updating our probe set annotation based on the latest genome assembly and gene predictions will continue to improve the analysis and understanding of gene expression arrays.
Probe mapping procedures
The Affymetrix GeneChip probe sequences are freely available on the Affymetrix website, and were downloaded for all the species included in Ensembl. Probes, targets, annotation, technical documentation files and others documents are available from the Affymetrix microarray product webpage http://www.affymetrix.com. For each species the probes supplied by Affymetrix are "collapsed" into a non-redundant set of probes because a single probe sequence can be a part of several array designs. The input to this step is the complete set of PM probes for all arrays of a given species. The output is a set of probes written into the oligo_array and oligo_probe tables in the appropriate Ensembl databases and a FASTA file of non-redundant probe sequences. In the alignment step the FASTA file of non-redundant PM probes generated in the last step is aligned against the corresponding genomic sequence files in softmasked-dusted fasta format. We use Exonerate  to align the probes against the genome, alignment must be exact or contain 1 mismatch at most, and probes should not align to the genome more than 100 times. Exonerate 1.4 is the current version used in our pipeline with the following options: --bestn 100 --dnahspthreshold 116 --fsmmemory 256 --dnawordlen 14 --dnawordlimit 11, and is available at http://www.ebi.ac.uk/~guy/exonerate/.
Annotation to transcript
The annotation method associates microarray probesets with Ensembl transcripts. At least 50% of the PM probes in a probeset need to match the underlying transcript cDNA sequence for successful transcript annotation. In cases where a transcript has a 3' UTR predicted based on experimental evidence we use the transcript and twice the length of the 3' UTR sequence for the probeset annotation, otherwise we extend the 3' most exon. The length of the extension is precomputed as the longer of the median or the mean of all 3'UTR of the corresponding species. In the future, this extension will be adjusted to avoid any overlap with a gene in the proximity of the extended transcript.
Mapping probes to cDNA
GeneChips probe sequences were aligned against cDNA sequences with Exonerate and using the same parameters as our current pipeline. For each transcript cDNA, sequences were downloaded from the corresponding Ensembl databases (Ensembl release 51) using the Perl API. For each alignment, coordinates were projected to genomic coordinates and probes mapping to exon-exon boundaries where kept for the analysis.
Unannotated probesets genomic locations
For each unannotated probeset the genomic location of probes were obtained using the Ensembl API. The probe locations are computed at the transcript level, so for example a single probe hit could map to an exon on one transcript, and an intron on another transcript. For each unannotated probeset, the number of probes assigned to a category (exon, intron, 5'UTR, 3'UTR, and borders) is divided by the number of associated transcripts the given probeset. Finally, for each category, each ratio is centred by the sum of all ratios. For the ternary diagrams, locations were classified into three groups, the "non coding" group including intergenic region and intron categories, the "coding" group including the exon and 5'/3' UTR categories and finally the "border" group which includes probes located on border of one of these regions. Border locations are associated with the most 5' region, for example a probe spanning an exon-intron boundaries will be defined as being in the exon border, while a probe spanning an intron-exon will be defined as intron border.
Comparison with Affymetrix annotation
All Affymetrix annotation files corresponding to the GeneChips included in our pipeline are publicly available and were downloaded from the Affymetrix website. All Human, Mouse, Rat but also C. elegans, Drosophila, Zebrafish, Rhesus, Chicken, Canine, Cow, Yeast and Anopheles Plasmodium GeneChips were annotated on 08/07/2008, except for MG_U74A/B/C annotated on 31/05/2007. The Affymetrix annotations for the RGD database are missing from the 19/03/2008 and 08/07/2008 annotation files, thus Affymetrix RGD annotation for the rat GeneChip have been replaced by the previous annotations files (06/11/2007). External accession numbers given by the Affymetrix annotations files were used to compare with our annotations. For each GeneChip, external identifiers associated with transcript-level annotated probesets were extracted using the Ensembl Perl API and compared with Affymetrix external annotations. When Affymetrix or Ensembl provided more than one external identifier for the same probeset and the same database, one accession identifier in common was enough to connect the two annotations.
Probesets annotated to multiple genes
Genes linked to same probeset where extracted and analysed for homologous or overlapping evidence. The "within_species_paralogues" inferred from gene trees were extracted from the Ensembl Compara 51 database using the Ensembl Compara API . A within-species paralog corresponds to a relation between two genes of the same species where the ancestor node has been labelled as a duplication node. The duplication event could have occurred in this species only, or at a different duplication time depending on the ancestor node taxonomy level. Overlapping genes are defined as two tandem genes having their start/end overlapping after UTR extension.
Allele-specific probes and mismatches
For each probe mapping we looked for the presence of one or more SNPs within that region regardless of the presence of a mismatch in the alignment. Species-specific Ensembl Variation release 51 databases and the variation Perl API were used to obtain the SNPs available for each probe location. Probes with SNPs found in their genomic location where categorized in four groups: the mismatch with or without SNPs groups, and the perfect match with or without SNPs groups. The mismatch groups correspond to probes mapping the genome with one mismatch as defined in the mapping procedures.
The Ensembl API allows programmatic access to all of the arrays reannotated by our pipeline. The probe mapping and probeset annotation data can be directly accessed using our public MySQL servers (host: ensembldb.ensembl.org, user: anonymous, port: 5306 for Ensembl releases above 48). We also provide a Perl API to programmatically access the mapping and annotation in our database as well as all other data available in Ensembl. Documentation schema descriptions, tutorials and also instructions on how to download and install the Ensembl APIs (Core, Compara, Variation, Functional Genomics) can found at http://www.ensembl.org/info/data/api.html. An example script to extract probes mapping and probesets annotation is available as an additional file (Additional file 5). BioMart can be accessed directly from the BioMart central server http://www.biomart.org or from http://www.ensembl.org/biomart/martview/ for the Ensembl databases. Biomart provides an intuitive web interface to access our data. Finally, the R package biomaRt is available through BioConductor, some external packages (XML, RCurl) are required for installation.
The authors thank Vivek Iyer and the entire Ensembl team. The Ensembl project receives primary funding from the Wellcome Trust. Additional support for this work was provided by EMBL and the European Union through the EURATools project, European Commission contract number LSHG-CT-2005-019015 (BB) and the HEROIC (High-throughput Epigenetic Regulatory Organisation In Chromatin) Project, European Commission contract number LSHG-CT-2005-018883 (NJ). Open access changes were paid by the Wellcome Trust.
- Gentleman RC, Carey VJ, Bates DM, Bolstad B, Dettling M, Dudoit S, Ellis B, Gautier L, Ge Y, Gentry J, Hornik K, Hothorn T, Huber W, Iacus S, Irizarry R, Leisch F, Li C, Maechler M, Rossini AJ, Sawitzki G, Smith C, Smyth G, Tierney L, Yang JY, Zhang J: Bioconductor: open software development for computational biology and bioinformatics. Genome Biol. 2004, 5: R80-10.1186/gb-2004-5-10-r80.PubMed CentralPubMedView Article
- Parkinson H, Kapushesky M, Shojatalab M, Abeygunawardena N, Coulson R, Farne A, Holloway E, Kolesnykov N, Lilja P, Lukk M, Mani R, Rayner T, Sharma A, William E, Sarkans U, Brazma A: ArrayExpress--a public database of microarray experiments and gene expression profiles. Nucleic Acids Res. 2007, 35: D747-D750. 10.1093/nar/gkl995.PubMed CentralPubMedView Article
- MAQC Consortium, Shi L, Reid LH, Jones WD, Shippy R, Warrington JA, Baker SC, Collins PJ, de Longueville F, Kawasaki ES, Lee KY, Luo Y, Sun YA, Willey JC, Setterquist RA, Fischer GM, Tong W, Dragan YP, Dix DJ, Frueh FW, Goodsaid FM, Herman D, Jensen RV, Johnson CD, Lobenhofer EK, Puri RK, Schrf U, Thierry-Mieg J, Wang C, Wilson M, Wolber PK, Zhang L, Amur S, Bao W, Barbacioru CC, Lucas AB, Bertholet V, Boysen C, Bromley B, Brown D, Brunner A, Canales R, Cao XM, Cebula TA, Chen JJ, Cheng J, Chu TM, Chudin E, Corson J, Corton JC, Croner LJ, Davies C, Davison TS, Delenstarr G, Deng X, Dorris D, Eklund AC, Fan XH, Fang H, Fulmer-Smentek S, Fuscoe JC, Gallagher K, Ge W, Guo L, Guo X, Hager J, Haje PK, Han J, Han T, Harbottle HC, Harris SC, Hatchwell E, Hauser CA, Hester S, Hong H, Hurban P, Jackson SA, Ji H, Knight CR, Kuo WP, LeClerc JE, Levy S, Li QZ, Liu C, Liu Y, Lombardi MJ, Ma Y, Magnuson SR, Maqsodi B, McDaniel T, Mei N, Myklebost O, Ning B, Novoradovskaya N, Orr MS, Osborn TW, Papallo A, Patterson TA, Perkins RG, Peters EH, Peterson R, Philips KL, Pine PS, Pusztai L, Qian F, Ren H, Rosen M, Rosenzweig BA, Samaha RR, Schena M, Schroth GP, Shchegrova S, Smith DD, Staedtler F, Su Z, Sun H, Szallasi Z, Tezak Z, Thierry-Mieg D, Thompson KL, Tikhonova I, Turpaz Y, Vallanat B, Van C, Walker SJ, Wang SJ, Wang Y, Wolfinger R, Wong A, Wu J, Xiao C, Xie Q, Xu J, Yang W, Zhang L, Zhong S, Zong Y, Slikker W: The MicroArray Quality Control (MAQC) project shows inter- and intraplatform reproducibility of gene expression measurements. Nat Biotechnol. 2006, 24: 1151-1161. 10.1038/nbt1239.View Article
- Brazma A, Hingamp P, Quackenbush J, Sherlock G, Spellman P, Stoeckert C, Aach J, Ansorge W, Ball CA, Causton HC, Gaasterland T, Glenisson P, Holstege FC, Kim IF, Markowitz V, Matese JC, Parkinson H, Robinson A, Sarkans U, Schulze-Kremer S, Stewart J, Taylor R, Vilo J, Vingron M: Minimum information about a microarray experiment (MIAME)-toward standards for microarray data. Nat Genet. 2001, 29: 365-371. 10.1038/ng1201-365.PubMedView Article
- Gautier L, Møller M, Friis-Hansen L, Knudsen S: Alternative mapping of probes to genes for Affymetrix chips. BMC Bioinformatics. 2004, 5: 111-10.1186/1471-2105-5-111.PubMed CentralPubMedView Article
- Carter SL, Eklund AC, Mecham BH, Kohane IS, Szallasi Z: Redefinition of Affymetrix probe sets by sequence overlap with cDNA microarray probes reduces cross-platform inconsistencies in cancer-associated gene expression measurements. BMC Bioinformatics. 2005, 6: 107-10.1186/1471-2105-6-107.PubMed CentralPubMedView Article
- Dai M, Wang P, Boyd AD, Kostov G, Athey B, Jones EG, Bunney WE, Myers RM, Speed TP, Akil H, Watson SJ, Meng F: Evolving gene/transcript definitions significantly alter the interpretation of GeneChip data. Nucleic Acids Res. 2005, 33: e175-10.1093/nar/gni179.PubMed CentralPubMedView Article
- International Human Genome Sequencing Consortium: Finishing the euchromatic sequence of the human genome. Nature. 2004, 431: 931-945. 10.1038/nature03001.View Article
- Flicek P, Aken BL, Beal K, Ballester B, Caccamo M, Chen Y, Clarke L, Coates G, Cunningham F, Cutts T, Down T, Dyer SC, Eyre T, Fitzgerald S, Fernandez-Banet J, Gräf S, Haider S, Hammond M, Holland R, Howe KL, Howe K, Johnson N, Jenkinson A, Kähäri A, Keefe D, Kokocinski F, Kulesha E, Lawson D, Longden I, Megy K, Meidl P, Overduin B, Parker A, Pritchard B, Prlic A, Rice S, Rios D, Schuster M, Sealy I, Slater G, Smedley D, Spudich G, Trevanion S, Vilella AJ, Vogel J, White S, Wood M, Birney E, Cox T, Curwen V, Durbin R, Fernandez-Suarez XM, Herrero J, Hubbard TJ, Kasprzyk A, Proctor G, Smith J, Ureta-Vidal A, Searle S: Ensembl 2008. Nucleic Acids Res. 2008, 36: D707-D714. 10.1093/nar/gkm988.PubMed CentralPubMedView Article
- ENCODE Project Consortium, Birney E, Stamatoyannopoulos JA, Dutta A, Guigó R, Gingeras TR, Margulies EH, Weng Z, Snyder M, Dermitzakis ET, Thurman RE, Kuehn MS, Taylor CM, Neph S, Koch CM, Asthana S, Malhotra A, Adzhubei I, Greenbaum JA, Andrews RM, Flicek P, Boyle PJ, Cao H, Carter NP, Clelland GK, Davis S, Day N, Dhami P, Dillon SC, Dorschner MO, Fiegler H, Giresi PG, Goldy J, Hawrylycz M, Haydock A, Humbert R, James KD, Johnson BE, Johnson EM, Frum TT, Rosenzweig ER, Karnani N, Lee K, Lefebvre GC, Navas PA, Neri F, Parker SC, Sabo PJ, Sandstrom R, Shafer A, Vetrie D, Weaver M, Wilcox S, Yu M, Collins FS, Dekker J, Lieb JD, Tullius TD, Crawford GE, Sunyaev S, Noble WS, Dunham I, Denoeud F, Reymond A, Kapranov P, Rozowsky J, Zheng D, Castelo R, Frankish A, Harrow J, Ghosh S, Sandelin A, Hofacker IL, Baertsch R, Keefe D, Dike S, Cheng J, Hirsch HA, Sekinger EA, Lagarde J, Abril JF, Shahab A, Flamm C, Fried C, Hackermüller J, Hertel J, Lindemeyer M, Missal K, Tanzer A, Washietl S, Korbel J, Emanuelsson O, Pedersen JS, Holroyd N, Taylor R, Swarbreck D, Matthews N, Dickson MC, Thomas DJ, Weirauch MT, Gilbert J, Drenkow J, Bell I, Zhao X, Srinivasan KG, Sung WK, Ooi HS, Chiu KP, Foissac S, Alioto T, Brent M, Pachter L, Tress ML, Valencia A, Choo SW, Choo CY, Ucla C, Manzano C, Wyss C, Cheung E, Clark TG, Brown JB, Ganesh M, Patel S, Tammana H, Chrast J, Henrichsen CN, Kai C, Kawai J, Nagalakshmi U, Wu J, Lian Z, Lian J, Newburger P, Zhang X, Bickel P, Mattick JS, Carninci P, Hayashizaki Y, Weissman S, Hubbard T, Myers RM, Rogers J, Stadler PF, Lowe TM, Wei CL, Ruan Y, Struhl K, Gerstein M, Antonarakis SE, Fu Y, Green ED, Karaöz U, Siepel A, Taylor J, Liefer LA, Wetterstrand KA, Good PJ, Feingold EA, Guyer MS, Cooper GM, Asimenos G, Dewey CN, Hou M, Nikolaev S, Montoya-Burgos JI, Löytynoja A, Whelan S, Pardi F, Massingham T, Huang H, Zhang NR, Holmes I, Mullikin JC, Ureta-Vidal A, Paten B, Seringhaus M, Church D, Rosenbloom K, Kent WJ, Stone EA, NISC Comparative Sequencing Program, Baylor College of Medicine Human Genome Sequencing Center, Washington University Genome Sequencing Center, Broad Institute, Children's Hospital Oakland Research Institute, Batzoglou S, Goldman N, Hardison RC, Haussler D, Miller W, Sidow A, Trinklein ND, Zhang ZD, Barrera L, Stuart R, King DC, Ameur A, Enroth S, Bieda MC, Kim J, Bhinge AA, Jiang N, Liu J, Yao F, Vega VB, Lee CW, Ng P, Yang A, Moqtaderi Z, Zhu Z, Xu X, Squazzo S, Oberley MJ, Inman D, Singer MA, Richmond TA, Munn KJ, Rada-Iglesias A, Wallerman O, Komorowski J, Fowler JC, Couttet P, Bruce AW, Dovey OM, Ellis PD, Langford CF, Nix DA, Euskirchen G, Hartman S, Urban AE, Kraus P, Van Calcar S, Heintzman N, Kim TH, Wang K, Qu C, Hon G, Luna R, Glass CK, Rosenfeld MG, Aldred SF, Cooper SJ, Halees A, Lin JM, Shulha HP, Zhang X, Xu M, Haidar JN, Yu Y, Iyer VR, Green RD, Wadelius C, Farnham PJ, Ren B, Harte RA, Hinrichs AS, Trumbower H, Clawson H, Hillman-Jackson J, Zweig AS, Smith K, Thakkapallayil A, Barber G, Kuhn RM, Karolchik D, Armengol L, Bird CP, de Bakker PI, Kern AD, Lopez-Bigas N, Martin JD, Stranger BE, Woodroffe A, Davydov E, Dimas A, Eyras E, Hallgrímsdóttir IB, Huppert J, Zody MC, Abecasis GR, Estivill X, Bouffard GG, Guan X, Hansen NF, Idol JR, Maduro VV, Maskeri B, McDowell JC, Park M, Thomas PJ, Young AC, Blakesley RW, Muzny DM, Sodergren E, Wheeler DA, Worley KC, Jiang H, Weinstock GM, Gibbs RA, Graves T, Fulton R, Mardis ER, Wilson RK, Clamp M, Cuff J, Gnerre S, Jaffe DB, Chang JL, Lindblad-Toh K, Lander ES, Koriabine M, Nefedov M, Osoegawa K, Yoshinaga Y, Zhu B, de Jong PJ: Identification and analysis of functional elements in 1% of the human genome by the ENCODE pilot project. Nature. 2007, 447: 799-816. 10.1038/nature05874.View Article
- Liu H, Zeeberg BR, Qu G, Koru AG, Ferrucci A, Kahn A, Ryan MC, Nuhanovic A, Munson PJ, Reinhold WC, Kane DW, Weinstein JN: AffyProbeMiner: a web resource for computing or retrieving accurately redefined Affymetrix probe sets. Bioinformatics. 2007, 23: 2385-2390. 10.1093/bioinformatics/btm360.PubMedView Article
- Yu H, Wang F, Tu K, Xie L, Li YY, Li YX: Transcript-level annotation of Affymetrix probesets improves the interpretation of gene expression data. BMC Bioinformatics. 2007, 8: 194-10.1186/1471-2105-8-194.PubMed CentralPubMedView Article
- Huber W, Gentleman R: matchprobes: a Bioconductor package for the sequence-matching of microarray probe elements. Bioinformatics. 2004, 20: 1651-1652. 10.1093/bioinformatics/bth133.PubMedView Article
- Oeder S, Mages J, Flicek P, Lang R: Uncovering information on expression of natural antisense transcripts in Affymetrix MOE430 datasets. BMC Genomics. 2007, 8: 200-10.1186/1471-2164-8-200.PubMed CentralPubMedView Article
- Kapranov P, Cheng J, Dike S, Nix DA, Duttagupta R, Willingham AT, Stadler PF, Hertel J, Hackermüller J, Hofacker IL, Bell I, Cheung E, Drenkow J, Dumais E, Patel S, Helt G, Ganesh M, Ghosh S, Piccolboni A, Sementchenko V, Tammana H, Gingeras TR: RNA maps reveal new RNA classes and a possible function for pervasive transcription. Science. 2007, 316: 1484-1488. 10.1126/science.1138341.PubMedView Article
- Carlile M, Swan D, Jackson K, Preston-Fayers K, Ballester B, Flicek P, Werner A: Strand selective generation of endo-siRNAs from the Na/phosphate transporter gene Slc34a1 in murine tissues. Nucleic Acids Res. 2009, 37: 2274-2282. 10.1093/nar/gkp088.PubMed CentralPubMedView Article
- Slater GS, Birney E: Automated generation of heuristics for biological sequence comparison. BMC Bioinformatics. 2005, 6: 31-10.1186/1471-2105-6-31.PubMed CentralPubMedView Article
- Bolstad BM, Irizarry RA, Astrand M, Speed TP: A comparison of normalization methods for high density oligonucleotide array data based on variance and bias. Bioinformatics. 2003, 19: 185-193. 10.1093/bioinformatics/19.2.185.PubMedView Article
- Irizarry RA, Hobbs B, Collin F, Beazer-Barclay YD, Antonellis KJ, Scherf U, Speed TP: Exploration, normalization, and summaries of high density oligonucleotide array probe level data. Biostatistics. 2003, 4: 249-264. 10.1093/biostatistics/4.2.249.PubMedView Article
- Schuster EF, Blanc E, Partridge L, Thornton JM: Estimation and correction of non-specific binding in a large-scale spike-in experiment. Genome Biol. 2007, 8: R126-10.1186/gb-2007-8-6-r126.PubMed CentralPubMedView Article
- Chalifa-Caspi V, Shmueli O, Benjamin-Rodrig H, Rosen N, Shmoish M, Yanai I, Ophir R, Kats P, Safran M, Lancet D: GeneAnnot: interfacing GeneCards with high-throughput gene expression compendia. Brief Bioinform. 2003, 4: 349-360. 10.1093/bib/4.4.349.PubMedView Article
- Wang JP, Lindsay BG, Leebens-Mack J, Cui L, Wall K, Miller WC, dePamphilis CW: EST clustering error evaluation and correction. Bioinformatics. 2004, 20: 2973-2984. 10.1093/bioinformatics/bth342.PubMedView Article
- Church DM, Goodstadt L, Hillier LW, Zody MC, Goldstein S, She X, Bult CJ, Agarwala R, Cherry JL, DiCuccio M, Hlavina W, Kapustin Y, Meric P, Maglott D, Birtle Z, Marques AC, Graves T, Zhou S, Teague B, Potamousis K, Churas C, Place M, Herschleb J, Runnheim R, Forrest D, Amos-Landgraf J, Schwartz DC, Cheng Z, Lindblad-Toh K, Eichler EE, Ponting CP, Mouse Genome Sequencing Consortium: Lineage-specific biology revealed by a finished genome assembly of the mouse. PLoS Biol. 2009, 7: e1000112-10.1371/journal.pbio.1000112.PubMed CentralPubMedView Article
- Design and Performance of the GeneChip® Human Genome U133 Plus 2.0 and Human Genome U133A 2.0 Array. [http://www.affymetrix.com/support/technical/technotes/hgu133_p2_technote.pdf]
- Wilming LG, Gilbert JG, Howe K, Trevanion S, Hubbard T, Harrow JL: The vertebrate genome annotation (Vega) database. Nucleic Acids Res. 2008, 36: D753-D760. 10.1093/nar/gkm987.PubMed CentralPubMedView Article
- Pruitt KD, Harrow J, Harte RA, Wallin C, Diekhans M, Maglott DR, Searle S, Farrell CM, Loveland JE, Ruef BJ, Hart E, Suner MM, Landrum MJ, Aken B, Ayling S, Baertsch R, Fernandez-Banet J, Cherry JL, Curwen V, Dicuccio M, Kellis M, Lee J, Lin MF, Schuster M, Shkeda A, Amid C, Brown G, Dukhanina O, Frankish A, Hart J, Maidak BL, Mudge J, Murphy MR, Murphy T, Rajan J, Rajput B, Riddick LD, Snow C, Steward C, Webb D, Weber JA, Wilming L, Wu W, Birney E, Haussler D, Hubbard T, Ostell J, Durbin R, Lipman D: The consensus coding sequence (CCDS) project: Identifying a common protein-coding gene set for the human and mouse genomes. Genome Res. 2009, 19: 1316-1323. 10.1101/gr.080531.108.PubMed CentralPubMedView Article
- Eyras E, Caccamo M, Curwen V, Clamp M: ESTGenes: alternative splicing from ESTs in Ensembl. Genome Res. 2004, 14: 976-987. 10.1101/gr.1862204.PubMed CentralPubMedView Article
- Affymetrix - Technical Note, Annotation Methodology. [http://www.affymetrix.com/support/technical/technotes/annot_method_technote.affx]
- Chen Y, Cunningham F, Rios D, McLaren WM, Smith J, Pritchard B, Spudich GM, Brent S, Kulesha E, Marin-Garcia P, Smedley D, Birney E, Flicek P: Ensembl Variation Resources. BMC Genomics. 2010, 11: 293-10.1186/1471-2164-11-293.PubMed CentralPubMedView Article
- Bentley DR: Whole-genome re-sequencing. Curr Opin Genet Dev. 2006, 16: 545-552. 10.1016/j.gde.2006.10.009.PubMedView Article
- Harbig J, Sprinkle R, Enkemann SA: A sequence-based identification of the genes detected by probesets on the Affymetrix U133 plus 2.0 array. Nucleic Acids Res. 2005, 33: e31-10.1093/nar/gni027.PubMed CentralPubMedView Article
- Kasprzyk A, Keefe D, Smedley D, London D, Spooner W, Melsopp C, Hammond M, Rocca-Serra P, Cox T, Birney E: EnsMart: a generic system for fast and flexible access to biological data. Genome Res. 2004, 14: 160-169. 10.1101/gr.1645104.PubMed CentralPubMedView Article
- Spudich G, Fernández-Suárez XM, Birney E: Genome browsing with Ensembl: a practical overview. Brief Funct Genomic Proteomic. 2007, 6: 202-219. 10.1093/bfgp/elm025.PubMedView Article
- Durinck S, Moreau Y, Kasprzyk A, Davis S, De Moor B, Brazma A, Huber W: BioMart and Bioconductor: a powerful link between biological databases and microarray data analysis. Bioinformatics. 2005, 21: 3439-3440. 10.1093/bioinformatics/bti525.PubMedView Article
- Chen R, Li L, Butte AJ: AILUN: reannotating gene expression data automatically. Nat Methods. 2007, 4: 879-10.1038/nmeth1107-879.PubMed CentralPubMedView Article
- Lu J, Lee JC, Salit ML, Cam MC: Transcript-based redefinition of grouped oligonucleotide probe sets using AceView: high-resolution annotation for microarrays. BMC Bioinformatics. 2007, 8: 108-10.1186/1471-2105-8-108.PubMed CentralPubMedView Article
- Stalteri MA, Harrison AP: Interpretation of multiple probe sets mapping to the same gene in Affymetrix GeneChips. BMC Bioinformatics. 2007, 8: 13-10.1186/1471-2105-8-13.PubMed CentralPubMedView Article
- Vilella AJ, Severin J, Ureta-Vidal A, Heng L, Durbin R, Birney E: EnsemblCompara GeneTrees: Complete, duplication-aware phylogenetic trees in vertebrates. Genome Res. 2009, 19: 327-335. 10.1101/gr.073585.107.PubMed CentralPubMedView Article
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.