A detailed transcript-level probe annotation reveals alternative splicing based microarray platform differences
BMC Genomics volume 8, Article number: 284 (2007)
Microarrays are a popular tool used in experiments to measure gene expression levels. Improving the reproducibility of microarray results produced by different chips from various manufacturers is important to create comparable and combinable experimental results. Alternative splicing has been cited as a possible cause of differences in expression measurements across platforms, though no study to this point has been conducted to show its influence in cross-platform differences.
Using probe sequence data, a new microarray probe/transcript annotation was created based on the AceView Aug05 release that allowed for the categorization of genes based on their expression measurements' susceptibility to alternative splicing differences across microarray platforms. Examining gene expression data from multiple platforms in light of the new categorization, genes unsusceptible to alternative splicing differences showed higher signal agreement than those genes most susceptible to alternative splicing differences. The analysis gave rise to a different probe-level visualization method that can highlight probe differences according to transcript specificity.
The results highlight the need for detailed probe annotation at the transcriptome level. The presence of alternative splicing within a given sample can affect gene expression measurements and is a contributing factor to overall technical differences across platforms.
Microarrays have become a widely used tool to measure gene expression levels on a genome-wide basis and are available from a number of manufacturers. Each platform incorporates proprietary technology, with differences in probe design, probe bioinformatics, probe creation and deposition, reagents and protocols across platforms introducing variability into expression analysis. A large body of work has studied the reproducibility of microarray data and therefore the interchangeability of commercial platforms. A dialogue over data sets, analysis methods, and concordance measures has evolved, but no clear consensus on the level of agreement or disagreement in expression results has been reached.
It is generally understood that differences between platforms exist. The source of contention is the interpretation of the magnitude of these differences. Some conclude from the data that microarray results are sufficiently comparable across platforms [1, 2]. Others caution that the technological differences have not yet been sufficiently resolved to combine experimental results from different platforms [3, 4]. Regardless of the overall interpretation, both sides hypothesize that some of the differences may be attributable to the presence of splice variants [5–9].
Although alternative splicing is a logical source of cross-platform differences, there has been no direct evidence to show that this is the case. Studies have indicated 40% or more of all human genes are alternatively spliced [10, 11] and expression measurement differences may arise when probes on different platforms target differentially expressed splice variants of the same gene. It has been previously demonstrated that a sequence matching method between probes increases cross-platform consistency and reproducibility . Others have matched probes to genes and shown that annotation discrepancies affect analysis . Here, we combine the two ideas to provide evidence for alternative splicing based cross-platform disagreement.
We created an in-depth probe/genome/transcript annotation using the AceView transcript database. AceView is a comprehensive annotation of transcripts and genes that incorporates data from GenBank, dbEST and RefSeq . It has been shown to offer a richer view of the transcriptome, with 3 to 5 times more high-quality transcript forms than UCSC known genes, RefSeq or Ensemble . Capturing transcript diversity is important because probes may be derived from the same loci, but match different transcript sequences due to alternative splicing.
Using this new annotation, we categorized genes on each platform according to their susceptibility to splice variant differences and measured their cross-platform agreement in a biological data set using a traditional correlation measure and a Euclidean distance measure. The novel usage of the distance measure lends itself to a visualization that can show alternative splicing differences or other poorly performing probes.
Matching platform-specific probes to AceView and RefSeq Transcripts
We created a transcript-level annotation of microarray probes to study the effects of alternative splicing on cross-platform microarray discordance. Microarray probe sequences from Affymetrix (U95Av.2 GeneChip, 25 mer oligonucleotide probes), Agilent (Human 1, cDNA probes) and Codelink (Uniset Human I Bioarrays, 30 mer oligonucleotide probes) were aligned to the genome and annotated as matching transcripts through shared genomic coordinates from the AceView and RefSeq  transcript databases (see Methods). Table 1 shows the results of both the genome and transcript mappings.
Greater than 95% of all probes on the three platforms had genome alignments. Overall, 73%, 94% and 90% of Agilent, Codelink and Affymetrix probes, respectively, had AceView transcript alignments. The comparatively fewer alignments for Agilent stem from the strict coordinate restrictions we placed on the multiple-exon cDNA genome alignments. A detailed account of probe alignment conditions is available [see Additional file 1].
As anticipated, more probes were found to match to AceView transcripts than RefSeq transcripts, with 21%, 11% and 13% more total probes for Agilent, Codelink and Affymetrix, respectively. The rest of our analysis was therefore conducted using AceView data. Agilent and Codelink utilize single probes to target a gene and generate expression measurements. The Affymetrix U95Av2 chip is different. It targets a gene with a probe set consisting of up to 16 probes and summarizes the probe set to generate expression measurements. To create a transcript-level annotation of probe sets, a probe set was said to target a transcript if 5 or more probes matched it. An internal study showed five probes are necessary for reliable summarization measurements [see Additional file 2]. Of the 12453 Affymetrix probe sets, 11564 matched at least one transcript with 5 or more probes.
Genes categorized by susceptibility to alternative splicing based differences
To detect the effects of splice variation on gene expression measurements, we categorized each gene by probe specificity against known splice variants as annotated in AceView. Genes most susceptible to expression measurement differences from splice variants are those in which the probes from each of two different platforms interrogate mutually exclusive, or disjoint, sets of transcripts. Genes that are not susceptible to these measurement differences are those in which probes on both platforms target the same, or equal, sets of transcripts. In between the two extremes are genes that are susceptible to splice variants, but the effect of which cannot be measured because the platforms target common transcripts as well as transcripts specific to each platform. Using our transcript annotation results, we categorized genes commonly targeted by each pairwise platform combination based on their susceptibility to alternative splicing. To match the Affymetrix gene expression data used below, the Affymetrix probe set annotation was used, as described above. The number of genes in each category for Affymetrix/Agilent, Affymetrix/Codelink and Agilent/Codelink is shown in Table 2.
Correlation measure of alternative splicing discordance
We looked for overall splice variant differences utilizing gene expression data from a previous biological experiment. RNA was obtained from PANC-1 cells of a pancreatic ductile cell phenotype and an early stage of their differentiation to a pancreatic islet phenotype (see Methods). Five technical and biological replicate microarray experiments were run on each platform and their results were averaged to produce a single fold change value for each gene. We analyzed the expression data by creating scatter plots of the log2 fold changes for genes in the equal and disjoint transcript sets for each pairwise platform combination, shown in Figure 1. Only genes that were statistically significant at p-value < 0.05 on at least one platform were included in our analysis. Table 3 shows the computed Pearson and Spearman correlation coefficients for each of the disjoint and equal gene groups.
There is a drastic drop in the correlation coefficients from the equal to the disjoint transcript sets for all three platform pairs; the difference being 0.263, 0.484 and 0.38 for Pearson and 0.253, 0.465, and 0.41 for Spearman from the Affymetrix/Agilent, Affymetrix/Codelink and Agilent/Codelink comparisons, respectively. As genes with disjoint transcript sets are most susceptible to alternative splicing based differences and genes with equal transcript sets are unsusceptible to alternative splicing based differences, the drop in the correlation coefficients between these two groups suggests alternative splicing is a contributing factor to platform discordance.
Distance measure of alternative splicing discordance
A distance measure provides an alternative view of the data to confirm the correlation coefficient results. We calculated the log2 fold change of experimental versus control groups for each of the five replicates individually, creating a vector of the five fold change values for each gene on each platform. Using log2 fold change places each platform into a common measurement space. We then calculated the Euclidean distance between expression vectors from different platforms for the genes in the equal and disjoint transcript sets. Unlike the previous scatterplots, no restriction was made on statistical significance of the gene. Next, we plotted a cumulative distribution function (CDF) of all calculated distances for each grouping to highlight the differences attributable to alternative splicing, shown in Figure 2(a,c,e).
A curve that rises steeply and is shifted to the left represents a distance distribution that includes smaller distances than a curve shifted farther to the right. Smaller distances between expression vectors across platforms indicates higher agreement. The CDF curve for probes with equal transcript sets (impervious to alternative splicing based differences) is shifted to the left and rises faster than the CDF curve for disjoint transcripts sets (most susceptible to alternative splicing based differences) for all pairwise platform combinations. Thus, equal transcript sets tend to have smaller distances and higher agreement than disjoint transcript sets, indicating a distinct alternative splicing effect in platform discordance.
To establish a baseline for comparison, we randomly paired expression vectors from genes on different platforms and calculated the distances. A CDF of distances from unrelated expression vectors provides an unbiased worst-case distribution and the baseline CDF is plotted in Figure 2. By comparison, if two platforms agreed completely, the CDF would be a unit step function. Platform distance distributions based on equal and disjoint gene sets fall in between the two extremes, as the baseline CDF is shifted to the right, establishing the distance for unrelated measurements.
Probe-level distance measure
Agilent and Codelink both use single probes to target a gene, but the Affymetrix U95Av2 genechip utilizes probe sets consisting of 16 probes to target a gene. Probe set gene expression measurements are statistical summarizations of member probes, which can be influenced by dead probes, cross-hybridization and other effects [16, 17]. In order to generate a clearer view of expression measurements and agreement levels, we thought to analyze probe-level expression vectors instead of probe set summarizations for Affymetrix platform combinations.
We conducted a similar analysis as before, creating a vector of fold change values from the five replicates for each individual probe. To better isolate the effects of alternative splicing, we reduced the effect of cross-hybridization by removing from the analysis the 6.5%, 3.1% and 3.5% of individual Affymetrix, Agilent and Codelink probes, respectively, that matched multiple AceView gene symbols. Probe cross-hybridization results, as implied by sequence, are shown in Table 4.
For all genes shared between platforms, individual probe-probe comparisons using the probe annotations were made for equal or disjoint transcript set targeting. By examining all possible combinations of individual probes, it was hoped that details masked by the probe set annotation would become apparent. We created CDFs of all of the probe distances in each category and established a baseline by randomly pairing probe expression vectors, shown in Figure 2(b,d). The alternative splicing effect is again apparent, with a left shift of probe distance CDFs for the equal transcript set versus disjoint transcript set.
The Kolmogorov-Smirnov test is used to determine if two samples are drawn from the same underlying distribution. We used it to test whether the Equal-Disjoint, Equal-Random and Disjoint-Random CDF combinations for each of the platform pairs differ from each other. Table 5 illustrates the test results, laid out to match the ordering of the platform pairings in Figure 2. At p < 0.05, we reject the null hypothesis of drawing from the same distribution for all CDF combinations except for Disjoint-Random on Affymetrix probeset/Codelink (c). We accept that the Equal, Disjoint and Random distance distributions are different from each other, except in the case of Disjoint-Random for Affymetrix/Codelink (c), where we cannot reject the null hypothesis that they are the same.
The distance distributions are different, indicating the shifts towards smaller distances and better agreement are meaningful in Figure 2. However, the disjoint transcript set in any pairwise combination involving Affymetrix probes (b, d) is not appreciably better than random, unlike the probe set-level CDFs, indicating Affymetrix's reliance on probe sets and robust algorithms for accurate expression measurements.
Individual gene expression visualization
We generated a distance matrix containing all pairwise probe distances for each gene. By turning the matrix into a heatmap colored by distance, with probes ordered by their position along the transcript, clusters of probes with signals showing high agreement and similar patterns show up as darker blocks along the main diagonal. Figures 3 and 4 are examples of the visualization for the genes thioredoxin-like 2 (TXNL2) and flap structure-specific endonuclease 1 (FEN1), respectively. TXNL2, otherwise known as PICOT (protein kinase C interacting cousin of thioredoxin) is a hypertrophy-inducible, PKC-inhibiting negative regulator of hypertrophy. No biological function has as yet been ascribed to be splice-variant specific. FEN1 removes 5' overhanging flaps in DNA repair and processes the 5' ends of Okazaki fragments in lagging strand DNA synthesis. The top part of each figure shows the AceView transcript forms and where the probes align.
TXNL2 is a case of disjoint transcript sets being targeted by Affymetrix and Agilent. The Affymetrix probe set targets TXNL2.cAug05 (outlined in blue). Two Agilent probes target TXNL2.bAug05 (outlined in green). In the heatmap, the Agilent probes clearly form a dark cluster distinct and distant from the Affymetrix probes. Examining the log2 signal intensities, Agilent shows a clear separation between the control and experimental groups while Affymetrix shows no pattern at all. Agilent microarray results indicate that TXNL2 is downregulated, with fold changes of -1.78 (p = 0.003) and -1.67 (p = 0.007). Affymetrix microarray results indicate no change, with a fold change of -1.04 (p = 0.632).
These results were validated by PCR experiments. Real-time PCR showed a fold change of -1.70 (p = 0.014) for the transcripts targeted by Agilent. The transcript targeted by Affymetrix failed to amplify after 40 cycles. The lack of amplification corroborates the low signal intensity and lack of signal pattern in the microarray data, meaning the Affymetrix transcript is likely not present in the sample. Therefore TXNL2 represents a gene whose discordant expression measurements are attributable to alternative splicing, because each platform targets mutually exclusive transcripts with different, validated results. There were three additional transcripts for which we could adequately design a real-time PCR assay and for which probe alignments are shown [see Additional file 3]. In the first case, CDC42 was significantly downregulated when assayed by Codelink (-1.65, p = 0.00298; variants e, f) but unchanged by Affymetrix (1.10, p = 0.04; variant d). Surprisingly, we were not able to validate either result by real-time PCR (variants e, f: 1.82, p = 0.07; variant d: 2.97, p = 0.02), suggesting a false positive result for Codelink and a false negative one for Affymetrix. In two other cases where increased transcript expression was detected by Affymetrix (CALM1 (variant b), 1.94, p < 0.003) and by Codelink (FMO5 (variants a, d), (2.23 p < 0.001), both were validated by real-time PCR (2.73, p = 0.003; 3.01, p < 0.001). Correspondingly, results from the Agilent platform showed no change for different variants of both genes, (1.11, p = 0.45; -1.26, p = 0.59 for CALM1 (variant a) and FMO5 (variant c), respectively). Nevertheless, we further determined by real-time PCR that these specific variants were also upregulated (8.06, p < 0.001; 2.69, p < 0.001). These results demonstrate that additional factors clearly contribute to the dissociation of results across platforms, and that splice variants may only play a partial role in explaining these differences.
One of these factors might be the existence of poorly performing probes possibly resulting from failure to hybridize, or susceptibility to cross-hybridization. FEN1 is an example of a visualization revealing poorly performing probes. A group of four Affymetrix probes, outlined in green, are distant from all of the other probes for the gene, including the Agilent and Codelink probes (probes 17 and 18 respectively). Due to an existing non-disclosure agreement with GE Healthcare, we are unable to show the position of the Codelink probe on the genome, but it is in the vicinity of Affymetrix probe 41583_at-4021. The group of four probes shows poor or no separation in the log2 signal intensity between the control and experimental groups, unlike the other probes that show clear downregulation. This difference is not due to transcript specificity and highlights the fact that individual probes can misbehave for other reasons.
Mapping probes to transcripts via the genome yields more information and is more complex than a direct probe/transcript mapping. Genome coordinates show the cause of alignment failures, such as probes aligning to an intron. In addition, genome builds are more stable than transcript databases and allow for enhanced future study. For instance, a probe may have been designed using proprietary transcript sequences or map to an unexplored area where tiling arrays indicate transcriptional activity [18, 19]. While we may miss some alignments involving rare non-standard introns or some Agilent cDNA clones due to our algorithm, we maintain a high stringency of matches between genome coordinates, probes, and transcripts.
The algorithms that generate genomic alignments and transcript annotations differ for the three platforms. They serve as an abstraction layer to transform the different probe designs from each platform into commonly comparable annotation data. Annotation quality is the key factor when investigating alternative splicing disagreement. Although we maintain a high stringency in the alignments, the Agilent cDNA probes have lower transcript hybridization specificity than Affymetrix or Codelink due to their length. Therefore, under actual hybridization conditions, Agilent may target more transcripts than our purely sequence-based annotation indicates. While this may slightly impact the Agilent results, our annotation provides a good starting point for alternative splicing analysis. For instance in TXNL2, Agilent and Affymetrix target disjoint transcripts based on sequence alone. It is possible that Agilent could bind to the Affymetrix transcript, TXNL2.cAug05, though we do not know for sure. Even so, we were able to assay the terminal exon exclusive to Affymetrix to show splicing-based disagreement. Screening for such candidate genes most susceptible to alternative splicing requires at least a detailed sequence-based annotation.
The drop in correlation coefficients of expression measurements across platforms from genes impervious to alternative splicing based differences to those genes most susceptible to alternative splicing based differences seems to indicate alternative splicing plays a role in platform discordance. Although correlation coefficients are widely used measures of platform concordance, the large drop was not necessarily supported by a corresponding visual change in the distribution of data points underlying the coefficient calculations.
We verified the correlation coefficients by using a distance measure derived from gene and probe-level log2 fold change data from replicate samples. Instead of using other fuzzy measures such as percent gene list overlap to measure improvement, our distance measure provides a clearer measure that cuts to the signal differences attributable to alternative splicing. The CDF shows that probes that target equal transcripts have fold changes that on average are closer and more agreeable between the two platforms than probes with disjoint transcripts. A key point is that the CDFs were generated without any arbitrary p-value or fold change filtering of the probes. Since we are not concerned with methods to improve concordance, we did not utilize any filtering method or thresholding that could change the interpretation of microarray results. The CDF differences show that alternative splicing is a layer on top of the basic platform technology differences that contributes to platform discordance, independent of any post-processing method.
While alternative splicing clearly affects platform discordance, making a broad-based quantification of its effects is difficult. First, alternative splicing is tissue dependent ; not only do the variants need to be differentially expressed, but the genes affected will change in each experiment. While we categorized genes based on their susceptibility to alternative splicing differences, the majority of genes have both common and specific transcript targets on each platform, making it difficult to isolate the effect of alternative splicing from the underlying technological discordance represented in the common transcripts. Though it is not possible to establish a universal boundary on alternative splicing's contribution to discordance in this study, we have provided evidence for its existence.
Basic platform technology differences are revealed in the CDFs for genes with equal transcript sets on any two platforms compared. These genes are unsusceptible to alternative splicing differences, yet the CDF does not approximate a stair-step function that would indicate complete agreement. Other platform differences may include high probe/mRNA secondary structure, difficulties in labelling and other design and protocol considerations. Therefore underlying platform-based differences exist and are unexplainable by alternative splicing alone. In this respect, our inability to validate some of our discordant microarray results demonstrates that clearly other factors exist. To aid in understanding this phenomenon, our distance measure also offers a way to visually examine similarly performing probes. In a heatmap of pairwise probe distances for a gene, clusters of probes became visually apparent based on shared signal intensity patterns according to positional ordering. The presence of clusters of "close" probes provides both insights into probe performance behaviour and a sanity check on the distance measure itself. However a more in-depth study using other clustering techniques on different factors could show probes grouped together on the basis of GC content or hybridization conditions, revealing the causes of differing probe behaviour for the same transcripts.
In addition to probe design-dependent differences in sensitivity and specificity, systematic and random sources of variability unrelated to probe sequence can contribute to an "intrinsic" level of discordance across expression arrays. For instance, context-dependent differences in expression data have been reported across generations of Affymetrix arrays with identical probe sequences . Moreover, a study by the MAQC consortium showed that cross-site concordance rates for a single array platform was ~50–65% for the most highly ranked differentially expressed genes when two related samples were compared [, Fig. S2]. This within-platform agreement rate is noteworthy compared to the ~40% cross-platform agreement rate previously reported [6, 9, 23]. In our current analysis, more detailed ANOVA models were used to describe and subsequently remove non-biological sources of variability specific to each platform, such as batch effects due to RNA extraction and array- and dye-specific bias. Assuming that systematic errors typical of a microarray experiment can be accounted for in this manner, the remaining discordance is still only partly explained by the presence of splice variants. In this regard, a similar re-analysis of other multi-platform datasets would be highly interesting and our code is made available for this purpose [see Additional file 4].
As known transcript diversity increases, we expect the number of genes with equal transcripts on both platforms to decrease, raising the confidence of the annotation of the remaining genes, producing lower distances and a sharper CDF. Despite the certain existence of technical variables affecting cross-platform concordance, we believe inter-platform agreement rates can be further improved as use of the transcriptome for probe annotation increases. To further advance this goal, we have recently provided custom chip-description-files and annotation files for a transcript-based probe set redefinition of the human Affymetrix arrays .
Using an in-depth transcript annotation, we categorized genes as being either impervious or susceptible to alternative splicing cross-platform differences. Examining gene expression data for these genes in two manners, we provided evidence that alternative splicing cross-platform discordance exists. Utilizing a distance measure, we were able to create a gene visualization that can highlight probe differences. Alternative splicing's contribution depends heavily on the prevalence of alternative splicing in the experimental data set and it is a factor adding to omnipresent and underlying technical differences.
Generating probe genome coordinates
All alignment code was run on the NIH Biowulf supercomputing cluster. Probes were aligned to Human Genome Build (hg17, May 2004). Although a new genome build was released in March 2006, the AceView transcript genome coordinates have not yet been updated to reflect the new build.
Agilent probe sequences were generously contributed by Open Biosystems (Incyte clone database). Of the 13323 unique Agilent cloneIDs, sequences were available for 12955 clones. Of the 12955 clones, 10016 were annotated as being a confirmed full length cDNA clone sequence; the other 2939 were potential full length clones with a 5' read. Of the 2939 potential full length probes, 12 had additional 3' read sequences. Potential full length probes may have gaps that are not sequenced.
The Agilent probes were aligned to the genome using the default parameters of the BLAT algorithm. Alignment results were filtered using the following steps:
1. For each probe, the ratio between the number of matching base pairs in the alignment and the number of base pairs in the probe sequence had to be greater than 0.75 for the highest scoring alignment. This requirement forces the best alignment to match a majority of the probe sequence, since BLAT produces many spurious short alignments with 100% percent identity.
2. For each probe, accept any alignment whose score is within 5% of the best alignment's score. This requirement eliminates low quality alignments, while allowing for finding coordinates of gene repeats.
Affymetrix and Codelink
Affymetrix probe sequences for the U95A.v2 chip were downloaded from the Affymetrix website , yielding sequences for 199015 unique probes after removing 69 probes associated with ALU repeats. Codelink probe sequences for 9969 unique probes were obtained from GE Healthcare.
Traditional sequence alignment algorithms, such as BLAST are unsuited for aligning short probe sequences to the genome because they work best with sequences greater than 50 bp and require parameter tuning and post-processing quality control for optimal results. Other programs that allow for fuzzy alignments to mimic hybridization conditions, such as GCG's findpatterns or EMBOSS's fuzznuc do not scale well with 200000 probes at the genome level. We therefore created a custom alignment procedure, written in perl. It is a cascade architecture that progressively uses more computationally intensive alignment algorithms on the reduced subset of probes unaligned in the previous step, making efficient use of computational resources. The algorithm consists of four steps:
1. Exact alignments of probe sequences to the genome are found using a hash table. A sliding window is passed over the genome, querying the "dictionary" hash table for a probe match using the window sequence as the key.
2. Probes without exact matches are then tested for alignment with single base pair mismatches, again using a hash table approach with an expanded dictionary to include all possible mismatch sequences. When windowing the genome, a "don't care" term corresponding to an N nucleotide are substituted at each position in the window when querying the hash table, effectively scanning the genome n times, where n is the probe length.
3. Probes not aligned in either step above are subjected to regular expression genome searches to determine whether a probe spans an intron. To aid in intron search specificity, intron feet are added to each regular expression because 99% of all introns begin and end with the sequence GT-AG or GC-AG. Only those probes found with intron gaps of less than 60 kbp are accepted to eliminate spurious alignments. Regular expressions are slow compared to hash-based approaches.
4. Any remaining probes are run through BLAT as a catch all. A previous study (GE, personal communiqué) shows that probes can tolerate up to 3 mismatches with the target sequence before there is significant signal degradation due to failed hybridization. A conservative BLAT score cutoff is used, equating to accepting either two mismatches or a gapped intron alignment and one mismatch. BLAT is only guaranteed to find perfect matches down to 33 bases and therefore may miss some probes of interest due to short probe length.
Matching probes to transcripts
Two transcript databases, AceView and Reference Sequence (RefSeq) were used. AceView human Aug05 transcripts and genome coordinates were obtained from the AceView website . Genome coordinates of RefSeq transcripts as determined by BLAT alignment were obtained from UCSC on 12/29/05. Individual probes were then matched to transcripts by comparing common genome coordinates in an Oracle database query.
Expression data for all three platforms were obtained as described in . PANC-1 cells were grown in serum-rich medium, trypsinized and collected immediately and at 24 h following transfer of these cells to serum-free medium. Each one of the microarray platforms utilized a common sample pool of RNA from control PANC-1 cells which have a pancreatic ductal cell phenotype or from an early stage of their differentiation to a pancreatic islet phenotype. RNA was labeled and hybridized to microarrays from Affymetrix (U95Av.2 GeneChips, multiple 25 mer oligonucleotide probe sets), Agilent (Human 1, cDNA probes) and Amersham (Codelink UniSet Human I Bioarrays, 30 mer oligonucleotide probes) according to manufacturers' guidelines. For each time point, three arrays were hybridized with RNA derived from one of the PANC-1 cell cultures (technical replicates); the remaining two microarrays were hybridized with RNA from two independent cell cultures (biological replicates), thus generating five data points for each probe at each time point.
Raw data from Codelink was median-normalized as recommended by the manufacturer. Raw data from the Agilent platform underwent lowess normalization via the Feature Extraction Software. Affymetrix gene expression measurements underwent quantile normalization and summarization using RMA . Experiment-wide systematic technical or "batch" effects such as that caused by RNA extraction on different sample batches were removed using Partek Genomics Suite .
For Codelink and Affymetrix GeneChip data, the following ANOVA model was used: let Ygij be the base-2 logarithm of the background-corrected measurement from gene g (g = 1...n), treatment i (i = 1,..2), and RNA extraction batch j (j = 1,..2):
Ygij = μ + Ti + Rj + (TR)ij + ε
where T is the main effect for treatments, R is the main effect for RNA extraction, and TR is the interaction effect of RNA extraction and treatment, and ε is stochastic error. Using this model, we were able to subtract the effect of RNA extraction from the gene expression signal.
For the Agilent 2-channel array, the following ANOVA model was used: let Ygij be the base-2 logarithm of the background-corrected measurement from gene g (g = 1,...n), treatment i (i = 1,2), RNA extraction batch j (j = 1,2), configuration on slide k (k = 1,2), dye l (l = 1,2) and array m (m = 1,...5).
Ygij = μ + Ti + Rj + (TR)ij + (C)k + (D)l + (AR)jm + ε
where T is the main effect for treatments, R is the main effect for RNA extraction, and TR is the interaction effect of RNA extraction and treatment, C and D are the effects for configuration and dye respectively, and AR is the interaction effect of RNA extraction and array and ε is stochastic error. Effects of RNA extraction, slide configuration (left vs. right), dye, and array were removed. Cy5 and Cy3 channel signals were then averaged for each sample. All raw and processed data are available in GEO (GSE7785).
Real-time PCR Expression Analysis
An inventoried assay for the gene TXNL2 was obtained from Applied Biosystems (Hs01582641_g1) and was used to test for the TXNL2.aAug05 and TXNL2.bAug05 transcripts targeted by the Agilent probes. The assay's context sequence is TGGATATTGTGAAGGAACTGAAAGA.
Custom designed PCR primers were synthesized by MWG-BIOTECH Inc. (High Point, NC, USA). The forward (CCCAAAGTGCTGGAATTTACAGGAGTGT) and reverse (TGGTGAATGAGGCATCAGGAAGCTA) primers were designed to target the same exon as the Affymetrix probe set and align to TXNL2.cAug05. Melting point Tm temperatures (65.9°C and 64.8°C respectively) and %GC content (46.4% and 48.0% respectively) was checked using Primer Express™ software package from Applied Biosystems (Foster City, CA, USA).
Equal and disjoint transcript sets for probes and genes were determined using Access database queries examining the transcript annotation data. The correlation, distance measure and CDF analysis was conducted using built-in Matlab functions, custom Matlab scripts, custom Perl scripts and Microsoft Access databases to tie the data together. Code and data are available as supplementary files.
Petersen D, Chandramouli GV, Geoghegan J, Hilburn J, Paarlberg J, Kim CH, Munroe D, Gangi L, Han J, Puri R, Staudt L, Weinstein J, Barrett JC, Green J, Kawasaki ES: Three microarray platforms: an analysis of their concordance in profiling gene expression. BMC Genomics. 2005, 6: 63-10.1186/1471-2164-6-63.
Quackenbush J: Weighing our measures of gene expression. Mol Syst Biol. 2006, 2: 63-
Zhu B, Ping G, Shinohara Y, Zhang Y, Baba Y: Comparison of gene expression measurements from cDNA and 60-mer oligonucleotide microarrays. Genomics. 2005, 85: 657-665. 10.1016/j.ygeno.2005.02.012.
Ioannidis JP: Microarrays and molecular research: noise discovery?. Lancet. 2005, 365: 454-455.
Draghici S, Khatri P, Eklund AC, Szallasi Z: Reliability and reproducibility issues in DNA microarray measurements. Trends Genet. 2006, 22: 101-109. 10.1016/j.tig.2005.12.005.
Larkin JE, Frank BC, Gavras H, Sultana R, Quackenbush J: Independence and reproducibility across microarray platforms. Nat Methods. 2005, 2: 337-344. 10.1038/nmeth757.
Mecham BH, Klus GT, Strovel J, Augustus M, Byrne D, Bozso P, Wetmore DZ, Mariani TJ, Kohane IS, Szallasi Z: Sequence-matched probes produce increased cross-platform consistency and more reproducible biological results in microarray-based gene expression measurements. Nucleic Acids Res. 2004, 32: e74-10.1093/nar/gnh071.
Shippy R, Sendera TJ, Lockner R, Palaniappan C, Kaysser-Kranich T, Watts G, Alsobrook J: Performance evaluation of commercial short-oligonucleotide microarrays and the impact of noise in making cross-platform correlations. BMC Genomics. 2004, 5: 61-10.1186/1471-2164-5-61.
Tan PK, Downey TJ, Spitznagel EL, Xu P, Fu D, Dimitrov DS, Lempicki RA, Raaka BM, Cam MC: Evaluation of gene expression measurements from commercial microarray platforms. Nucleic Acids Res. 2003, 31: 5676-5684. 10.1093/nar/gkg763.
Mironov AA, Fickett JW, Gelfand MS: Frequent alternative splicing of human genes. Genome Res. 1999, 9: 1288-1293. 10.1101/gr.9.12.1288.
Modrek B, Resch A, Grasso C, Lee C: Genome-wide detection of alternative splicing in expressed sequences of human genes. Nucleic Acids Res. 2001, 29: 2850-2859. 10.1093/nar/29.13.2850.
Carter SL, Eklund AC, Mecham BH, Kohane IS, Szallasi Z: Redefinition of Affymetrix probe sets by sequence overlap with cDNA microarray probes reduces cross-platform inconsistencies in cancer-associated gene expression measurements. BMC Bioinformatics. 2005, 6: 107-10.1186/1471-2105-6-107.
Gautier L, Moller M, Friis-Hansen L, Knudsen S: Alternative mapping of probes to genes for Affymetrix chips. BMC Bioinformatics. 2004, 5: 111-10.1186/1471-2105-5-111.
Thierry-Mieg D, Thierry-Mieg J: AceView: a comprehensive cDNA-supported gene and transcripts annotation. Genome Biol. 2006, 7 Suppl 1: S12-S14. 10.1186/gb-2006-7-s1-s12.
Pruitt KD, Tatusova T, Maglott DR: NCBI Reference Sequence (RefSeq): a curated non-redundant sequence database of genomes, transcripts and proteins. Nucleic Acids Res. 2005, 33: D501-D504. 10.1093/nar/gki025.
Jones W: Microarray Probes That Mask Differential Expression. Pharmaceutical Discovery. 2005, [http://www.pharmadd.com/archives/Jun%201%202005/Microarray%20Probes.asp]
Smith K, Hallett M: Towards quality control for DNA microarrays. J Comput Biol. 2004, 11: 945-970. 10.1089/cmb.2004.11.945.
Kapranov P, Cawley SE, Drenkow J, Bekiranov S, Strausberg RL, Fodor SP, Gingeras TR: Large-scale transcriptional activity in chromosomes 21 and 22. Science. 2002, 296: 916-919. 10.1126/science.1068597.
Schadt EE, Edwards SW, GuhaThakurta D, Holder D, Ying L, Svetnik V, Leonardson A, Hart KW, Russell A, Li G, Cavet G, Castle J, McDonagh P, Kan Z, Chen R, Kasarskis A, Margarint M, Caceres RM, Johnson JM, Armour CD, Garrett-Engele PW, Tsinoremas NF, Shoemaker DD: A comprehensive transcript index of the human genome generated using microarrays and computational approaches. Genome Biol. 2004, 5: R73-10.1186/gb-2004-5-10-r73.
Yeo G, Holste D, Kreiman G, Burge CB: Variation in alternative splicing across human tissues. Genome Biol. 2004, 5: R74-10.1186/gb-2004-5-10-r74.
Zhang L, Yoder SJ, Enkemann SA: Identical probes on different high-density oligonucleotide microarrays can produce different measurements of gene expression. BMC Genomics. 2006, 7: 153-10.1186/1471-2164-7-153.
Shi L, Reid LH, Jones WD, Shippy R, Warrington JA, Baker SC, Collins PJ, de LF, Kawasaki ES, Lee KY, Luo Y, Sun YA, Willey JC, Setterquist RA, Fischer GM, Tong W, Dragan YP, Dix DJ, Frueh FW, Goodsaid FM, Herman D, Jensen RV, Johnson CD, Lobenhofer EK, Puri RK, Schrf U, Thierry-Mieg J, Wang C, Wilson M, Wolber PK, Zhang L, Amur S, Bao W, Barbacioru CC, Lucas AB, Bertholet V, Boysen C, Bromley B, Brown D, Brunner A, Canales R, Cao XM, Cebula TA, Chen JJ, Cheng J, Chu TM, Chudin E, Corson J, Corton JC, Croner LJ, Davies C, Davison TS, Delenstarr G, Deng X, Dorris D, Eklund AC, Fan XH, Fang H, Fulmer-Smentek S, Fuscoe JC, Gallagher K, Ge W, Guo L, Guo X, Hager J, Haje PK, Han J, Han T, Harbottle HC, Harris SC, Hatchwell E, Hauser CA, Hester S, Hong H, Hurban P, Jackson SA, Ji H, Knight CR, Kuo WP, LeClerc JE, Levy S, Li QZ, Liu C, Liu Y, Lombardi MJ, Ma Y, Magnuson SR, Maqsodi B, McDaniel T, Mei N, Myklebost O, Ning B, Novoradovskaya N, Orr MS, Osborn TW, Papallo A, Patterson TA, Perkins RG, Peters EH, Peterson R, Philips KL, Pine PS, Pusztai L, Qian F, Ren H, Rosen M, Rosenzweig BA, Samaha RR, Schena M, Schroth GP, Shchegrova S, Smith DD, Staedtler F, Su Z, Sun H, Szallasi Z, Tezak Z, Thierry-Mieg D, Thompson KL, Tikhonova I, Turpaz Y, Vallanat B, Van C, Walker SJ, Wang SJ, Wang Y, Wolfinger R, Wong A, Wu J, Xiao C, Xie Q, Xu J, Yang W, Zhang L, Zhong S, Zong Y, Slikker W: The MicroArray Quality Control (MAQC) project shows inter- and intraplatform reproducibility of gene expression measurements. Nat Biotechnol. 2006, 24: 1151-1161. 10.1038/nbt1239.
Irizarry RA, Warren D, Spencer F, Kim IF, Biswal S, Frank BC, Gabrielson E, Garcia JG, Geoghegan J, Germino G, Griffin C, Hilmer SC, Hoffman E, Jedlicka AE, Kawasaki E, Martinez-Murillo F, Morsberger L, Lee H, Petersen D, Quackenbush J, Scott A, Wilson M, Yang Y, Ye SQ, Yu W: Multiple-laboratory comparison of microarray platforms. Nat Methods. 2005, 2: 345-350. 10.1038/nmeth756.
Lu J, Lee JC, Salit ML, Cam MC: Transcript-based redefinition of grouped oligonucleotide probe sets using AceView: high-resolution annotation for microarrays. BMC Bioinformatics. 2007, 8: 108-10.1186/1471-2105-8-108.
Affymetrix - Technical Support Documentation for Human Genome U95 Set. 2006, [http://www.affymetrix.com/support/technical/byproduct.affx?product=hgu95]
AceView: a comprehensive annotation of human and worm genes with mRNAs or ESTs. 2006, [http://www.ncbi.nlm.nih.gov/IEB/Research/Acembly/]
Irizarry RA, Bolstad BM, Collin F, Cope LM, Hobbs B, Speed TP: Summaries of Affymetrix GeneChip probe level data. Nucleic Acids Res. 2003, 31: e15-10.1093/nar/gng015.
Partek Genomics Suite User Manual. Chapter 9. 2007
The authors would like to thank Danielle Thierry-Mieg and Jean Thierry-Mieg for their helpful feedback, and Tom Downey (Partek Incorporated) for helpful advice with the data analysis. This research was supported in part by the Intramural Research Program of the NIH.
JCL developed the methods, carried out the analysis and drafted the manuscript. JCL and MCC designed the study. DS performed the real-time PCR experiments. JL and DS assisted with the figures. MCC conceived of the study. All authors read and approved the final manuscript.
Electronic supplementary material
Additional file 1: Probe alignment failure conditions. Provides examples of probes failing to align for various causes. (DOC 27 KB)
Additional file 2: Minimum number of probes for reliable Affymetrix summarization measurements. Graph showing the correlation coefficient versus number of probes in a probe set matching to RefSeq in a cross platform comparison between Affymetrix and Agilent. (DOC 24 KB)
Additional file 3: Alignments and real-time PCR designs for 3 other "discordant" genes: CDC42, CALM1, FMO5. Alignments on the UCSC Genome browser for each platform's probe(set) against relevant AceView transcripts. Real-time PCR primers and probes are included. (DOC 365 KB)
Additional file 4: Perl and Matlab code used for sequence matching and analysis. The readme file contains descriptions for each script. (ZIP 22 KB)
About this article
Cite this article
Lee, J.C., Stiles, D., Lu, J. et al. A detailed transcript-level probe annotation reveals alternative splicing based microarray platform differences. BMC Genomics 8, 284 (2007). https://doi.org/10.1186/1471-2164-8-284
- Alternative Splice
- Cumulative Distribution Function
- Probe Sequence
- Log2 Fold Change
- Affymetrix Probe