RefGenes: identification of reliable and condition specific reference genes for RT-qPCR data normalization
© Hruz et al; licensee BioMed Central Ltd. 2011
Received: 27 May 2010
Accepted: 21 March 2011
Published: 21 March 2011
RT-qPCR is a sensitive and increasingly used method for gene expression quantification. To normalize RT-qPCR measurements between samples, most laboratories use endogenous reference genes as internal controls. There is increasing evidence, however, that the expression of commonly used reference genes can vary significantly in certain contexts.
Using the Genevestigator database of normalized and well-annotated microarray experiments, we describe the expression stability characteristics of the transciptomes of several organisms. The results show that a) no genes are universally stable, b) most commonly used reference genes yield very high transcript abundances as compared to the entire transcriptome, and c) for each biological context a subset of stable genes exists that has smaller variance than commonly used reference genes or genes that were selected for their stability across all conditions.
We therefore propose the normalization of RT-qPCR data using reference genes that are specifically chosen for the conditions under study. RefGenes is a community tool developed for that purpose. Validation RT-qPCR experiments across several organisms showed that the candidates proposed by RefGenes generally outperformed commonly used reference genes. RefGenes is available within Genevestigator at http://www.genevestigator.com.
Rationale for using reference genes
Reference genes, sometimes also called "housekeeping genes", frequently serve as internal controls in transcript quantification assays such as RT-qPCR. The need for internal controls in such assays arises from sample to sample biases related to variability in total RNA content, RNA stability, enzymatic efficiencies, or sample loading variation. To correct for this, the expression levels measured are frequently normalized to internal control genes. Ideally, such genes are expected to be invariable in their expression and therefore correlate strongly with the total amounts of mRNA present in each sample. Commonly used reference genes, such as beta-actin (ACTB), ubiquitin (UBQ), the 18 S ribosome small subunit (18S), beta-glucuronidase (GUS), or glyceraldehyde 3-phosphate dehydrogenase (GAPDH), have a strong tradition and historical track record. In fact, many manufacturers provide "housekeeping gene panels" containing a dozen such genes thought to be generally stable based on their biological function. In many laboratories, they are used as "general purpose" reference genes for a wide variety of experimental conditions.
Problems associated with reference genes
Despite their wide-spread use, the suitability of reference genes for any type of experiment is not given a priori. In fact, two types of problems can occur: 1) their expression can vary considerably depending on the experimental condition being tested, and 2) the majority of these genes is very strongly expressed, often resulting in a discrepancy in transcript abundance of several orders of magnitude relative to the target gene transcripts being quantified. Both sources of error can cause significant biases that can ultimately lead to wrong data interpretation, especially in those cases where a single gene is used for normalization. For example, [1–5] have described various problems associated with commonly used reference genes.
Current approaches for improved data normalization
Although limitations are universally recognized, still many laboratories use reference genes without appropriate validation [6, 7]. In an effort to improve the quality and normalization of RT-qPCR data, several approaches have been proposed.
A first approach consists of validating reference genes using data obtained from RT-qPCR data. Frequently, several genes are evaluated in parallel and the most stable are selected for further experimentation. So far, most studies have focused on validating a subset of commonly used reference genes for specific contexts such as tissue types. Overall, it appears that no reference gene was generally suitable for any type of context, and that the best candidates differ between different tissues. In some cases, even opposite results were found for different tissues. For example, Meller et al.  analyzed seven commonly used reference genes for their expression level stability in placenta and reported that TBP and SHDA exhibited highest stability. In contrast, of the 10 commonly used reference genes tested by Zhang and colleagues in human neutrophils , TBP appeared to be the least stable. A list of similar studies in which validations were performed in a variety of organisms and tissues is available in Additional file 1. Although these studies have their merits, they try to identify the best candidates from a small and a priori set of genes, assuming that at least one or a few of them are suitable for the experimental context under study.
A second approach is to normalize against multiple reference genes and to use appropriate statistical models to improve the selection of genes with minimal variance [8–14]. Most current software packages for RT-qPCR data analysis have incorporated one or the other of these methods. Three of the most popular algorithms are GeNorm , Norm finder  and Bestkeeper .
A more recent, data-driven method consists of using quantile normalization rather than reference genes, but this approach is designed for high-throughput RT-qPCR experiments involving many genes. For studies involving one or a few genes, data normalization using internal control genes remains the method of choice, provided a proper choice of reference genes and normalization algorithms [16, 17].
A fourth and quite successful approach has been to search for reference genes from a genome-wide background using microarray data. In most cases, large sets of microarray data were compiled for a specific or for a subset of conditions, and stable genes identified within these datasets were validated and recommended for future use. Validation experiments generally showed that these genes performed better than commonly used reference genes. For example, Czechowski and colleagues  selected stably expressed genes for a variety of experimental series for Arabidopsis. Partial overlap was found between some of these conditions, but overall each series had its specific set of most stably expressed genes. Saviozzi et al.  performed a meta-analysis of lung cancer transcription profiles and validated several new reference genes for this particular context. Other similar studies were done e.g. for T-helper cells , adipose tissues , peripheral blood , various human samples and cell lines , breast tumor tissues , breast cancer , human myocardium , mouse (universal) , and human (universal) . The use of microarrays to identify candidate reference genes for RT-qPCR normalization has been successful, but this extrapolation requires some precautions due to differences in the choice probe sequences between the two technologies (e.g. Affymetrixprobes typically target the 3' region of a transcript). Additionally, in microarray data, multiple probes (or probe sets) targeting the same transcript may exhibit different stability values due to cross- or weak hybridization. Therefore, in a RT-qPCR assay, novel candidates should always be validated against reference genes previously used in the laboratory.
Conclusions from published data
From the experimental evidence accumulated and published so far, we conclude that there are probably no genes that have a sufficient overall expression stability to be suitable for any type of assay. As previously suggested, reference genes should be selected according to the nature of the study [6, 7], for example according to the tissue type or stage of development, and should ideally not be sensitive to perturbations such as external stimuli, diseases, or even to genetic modifications. Moreover, reference genes are preferably selected from the complete genome rather than from a handful of commonly used reference genes.
No genes are generally stably expressed; all genes are regulated to a certain extent (non-generality clause)
For each biological context there exists a subset of genes with smaller expression variance in this context than genes that are most stably expressed across many conditions (context-specificity clause)
Genes that are stably expressed in a given biological context are likely to be stably expressed in similar contexts (context- relatedness clause)
Genes that are stably expressed in a given tissue of an organism are likely to be stably expressed in the same tissue from closely related species (orthology clause)
In this paper, we tested and substantiated these hypotheses by using data from more than 40,000 quality controlled and manually annotated microarrays from a wide variety of experimental contexts and from several organisms. We studied the properties of the expression level of genes across various microarray types. Finally, to validate our approach, we identified novel reference genes, examined their individual properties, and compared their performance to commonly used reference genes using RT-qPCR assays. We also present an online tool which helps to identify genes that show high expression stability in a chosen set of conditions. Researchers can thereby identify, from all genes represented on the microarrays, those which are most stably expressed across conditions that are similar to that of their own experiments, providing them with an objective choice of candidate reference genes.
Datasets used in this study
The Genevestigator database contains a large set of systematically annotated and quality controlled microarray data from several organisms . Owing to the high reproducibility of the Affymetrix system, its streamlined labeling and hybridization protocols, the normalization methods used, as well as our quality control measures, expression data from different laboratories show a high degree of homogeneity. The database therefore offers a unique opportunity to search for genes that have particular expression characteristics across experiments, for example reference genes that have minimal variance across a chosen set of conditions.
Validating our hypotheses
Hypothesis 1 (non-generality clause)
Hypothesis 2 (Context-specificity clause)
1) Genes selected for their stability within a chosen tissue type had a lower SD of expression than commonly used reference genes, both within these tissue types (up to 4-fold lower) and also as measured across all arrays (up to 1.5 fold lower).
2) For each tissue, the range of SD of the top 20 most stable transcripts was within 1.5 fold difference between the most stable and least stable gene (see also Additional file 4). In contrast, the SD of the 20 commonly used reference genes varied more than 5-fold, irrespective of the tissue type, indicating that for each tissue type several of these genes would be unsuitable for data normalization. None of the 20 commonly used reference genes was systematically ranked within the top 5 genes across every tissue type, and some even had highly variable ranks. For example, TFRC (probe set 1452661_at) had rank 1 in spinal cord and rank 20 in liver (see Additional file 5).
The second experiment consisted of identifying genes that are stable in seedlings, leaves and shoot apex of the model plant Arabidopsis, and to compare their expression with that of reference genes commonly used in this species using RT-qPCR. For each tissue type, 16, 16, and 10 samples were used, respectively. The results are provided in Figure 3. For seedlings and shoot apex, all candidates proposed by RefGenes showed higher stability in this experiment than the reference genes GAPDH, ACTB and UBQ10. In leaves, the most stable genes were GAPDH and one of the novel genes identified by RefGenes (same score). Overall, the RefGenes candidates had ranks 1, 3 and 5. In the RT-qPCR experiment, GAPDH performed better than one would have expected from the microarray data, in which the novel candidates were found to be more stable. This illustrates potential differences that may occur due to the different size and composition of experiments and samples underlying each of these datasets. In fact, the microarray dataset selected was composed of a large number of leaf samples from a variety of experimental conditions, whereas in the RT-qPCR assay there were 16 samples grown in the same conditions. It is also possible that there are discrepancies between the two technologies, e.g. due to the targeting of different regions or splice variants.
Overall, the results from mouse and Arabidopsis substantiate this hypothesis. The tissue-specific selection of reference genes using microarray data carried out in similar conditions allows to identify novel genes having higher expression stability and a more suitable expression range than commonly used reference genes. For both organisms and across all genes tested, the Cq values (i.e. the number of PCR cycles that elapse before a given threshold concentration of PCR product is reached) from the novel RefGenes candidates were higher than those of commonly used reference genes and closer to Cq values commonly found for most genes from the genome (see Additional file 7 for original experimental data).
Hypothesis 3 (Context-relatedness clause)
On average, the SD of expression within each tissue type increased 30% between probe sets of rank 1 and rank 20, and 43%, 54% and 67% between rank 1 and rank 50, 100 and 200, respectively (see Additional file 4). The above findings indicate that, for each tissue type, a specific set of approximately 10-20 candidate genes exists that has significantly smaller variance of expression across samples from this tissue. At the same time, in the suboptimal range of expression stability (ranks 20 to 50), for each tissue type several genes were found that also had stable expression in other tissue types. As shown in Additional file 4 however, these "suboptimal candidates" have SD of expression between 30% and 67% higher than the best candidates for each tissue type and therefore are expected to be of more limited utility as reference genes in these individual conditions.
To assess the feasibility of extrapolating candidate reference genes from related tissue types, we carried out a validation experiment on B-lymphocytes. For human B-lymphocytes, only 4 arrays were available in the human 47 k dataset at the time of experimentation. We therefore chose to work with an extended set of tissues that were the most closely related to B-lymphocytes as identified by clustering the Genevestigator anatomical profiles of 10 randomly chosen sets of 400 genes. 46 arrays covering three closely related tissue types (B-lymphocytes, 4 arrays; lymphoblast cells, 24 arrays; lymphocytes, 18 arrays) were selected. Six novel candidate reference genes proposed by Ref-Genes were selected for this study and were compared to five commonly used reference genes (SDHA, GAPDH, YWHAZ, B2 M, RPL13a). The RT-qPCR validation experiment was carried out on lymphoblastoid cell lines (LCLs) of 15 subjects. The results of the top 8 genes as selected by GeNorm are shown in Figure 3. Two of the candidate genes obtained from RefGenes performed best and yielded significantly lower M values in GeNorm than the other reference genes. The remaining RefGenes candidates were similarly or less stably expressed than the control reference genes. Although in the microarray data (comprising several tissue types) all candidates proposed by RefGenes were more stable than commonly used reference genes, in this particular experiment based on LCLs only, the ranking of variances was different. This illustrates that expanding the search to related tissues has the potential to yield significantly better candidates, but it may be necessary to test a larger number of candidates, as some of them may be of similar or lower quality than commonly used reference genes. It must be noted, however, that not only the variance, but also the expression intensity range should be considered in choosing a reference gene. In fact, the commonly used reference genes tested had lower Cq values (reflecting very high expression levels), and therefore the novel RefGenes candidates could be preferred if their Cq values are closer to those of a specific target gene and their variances are similar to alternative reference genes.
Hypothesis 4 (orthology clause)
Our fourth hypothesis was that the stability of expression of gene orthologs remains similar across related species. Here, we cannot provide a general proof of principle, but an initial set of evidence to substantiate this hypothesis.
As a case study, we checked whether orthologs of genes that are highly stable in mouse liver could be used as alternative reference genes for RT-qPCR experiments carried out on cattle liver and pig liver samples. In fact, although Genevestigator currently does not contain data from these species, we hypothesized that the positive results obtained with mouse liver could be reproduced in other species by choosing the corresponding orthologs. Due to the incompleteness of available annotations for orthologs across these species, from the four genes that were previously validated in mouse, two (GAK and VPS4A) were found in cattle and pig. We identified a further gene (PMPCA) that was stable in mouse microarray data and was available as an ortholog in cattle and pig. These three genes were compared to three commonly used reference genes (ACTB, GAPDH, and UBQ for cattle, and Histone H3, GAPDH and UBQ for pig) in a RT-qPCR experiment comprising 42 cattle liver samples and 48 pig liver samples. The application of both GeNorm and Normfinder to identify the most stable genes within the cattle dataset showed that the two best normalizers were GAK and VPS4A (Figure 3; see also Additional file 6). PMPCA performed similarly to commonly used reference genes. In pig, the extrapolation from mouse did not result in novel genes being significantly more stable than commonly used reference genes. In fact, expression stability was similar across most genes and was in a more narrow range as compared to the stability values obtained in other experiments (in the pig data, Avg M varied between 0.29 to 0.36). Histone H3, Ubiquitin and VPS4A performed best, followed by GAK, GAPDH and PMPCA. Concluding from the results of all three species, GAK and VPS4A seem to have a conserved expression stability and to be suitable candidates for normalizing RT-qPCR experiments on liver samples. Overall, our results show that genes that were highly stable in mouse liver had orthologs in other species that were also highly stable. In our experiments, they performed similarly or better than commonly used reference genes. This is particularly useful for those cases where the search for new reference genes is limited by the amount of microarray data available for a given species, but abundant data is available in related species.
The RefGenes tool
choosing a set of microarrays (samples)
choosing the range of expression.
Choosing a set of microarrays
The user can create selections of microarrays according to organism and to chosen sample properties, for example a set of human arrays from a particular tissue type. Currently, array selections can be done from sample annotations such as anatomical part, developmental stage, treatment, disease, genetic modification, or tumor type. Because the database is populated with a very large number of experiments, researchers can often identify subsets of arrays from a context similar to that from their own RT-qPCR experiment. Our recommendation is to select at least three independent studies comprising at least 60 arrays in total. If this cannot be reached within a specific context, it may be worth extending this context with closely related conditions. In the example described earlier with T-lymphocytes, we selected 137 arrays hybridized with transcripts from CD4 T-Lymphocyte samples.
Choosing the range of expression
Theoretically, as long as data normalization is carried out in the linear range of amplification of both target and reference gene, it is not necessary for them to be in the same range of expression. However, some experimenters prefer using reference genes that are in a similar range of expression as their genes of interest. In RefGenes, the user can define the upper and lower bounds of the search space such as to obtain candidate reference genes within these bounds. As an additional information, a bar below the graph indicates, for a given microarray platform, the typical ranges of low, medium, and high expression (where "Medium" indicates the interquartile range). We recommend to upload genes of interest as well as alternative reference genes for a comparison with new candidates that will be proposed by RefGenes. In the screen shot shown in Figure 5, we uploaded the probe set identifiers for GAPDH, TUBB, PPIA, B2 M, TBP, UBC, ACTB, RPL13A, as well as that of PIK3R1 as an example of a target gene to be measured by RT-qPCR in CD4 T-lymphocytes. We then defined the range of reference gene expression to be slightly above and below that of PIK3R1.
Searching for reference genes
The "Run" button allows to trigger the search algorithm based on the selections of arrays and genes. The Genevestigator engine searches for genes with the lowest variance within this selection of arrays and displays the top 25 probe sets. For each probe set, the mean and standard deviation are indicated. Mouse-over tooltips over each probe set provide additional information such as gene name and IDs for various gene models. In the present example, after launching the search by clicking on the "Run" button, RefGenes suggested 25 potential reference genes, of which the standard deviation of expression was between 0.22 and 0.31. As a comparison, the standard deviations of commonly used reference genes was between 0.35 and 0.98.
Validating potential reference genes
The candidate reference genes obtained can be pre-validated by checking their expression across all microarrays available for that array type. The user can verify whether there are particular conditions in which their expression varies unexpectedly. For example, one can create a new selection of genes obtained in RefGenes, and go to the Meta-Profile Analysis toolset to check their expression levels in different tissues (Anatomy tool), or their response to different diseases, chemicals, hormones, etc. (Conditions tool). In general, genes proposed by Ref-Genes appear to be very unresponsive to a wide variety of conditions. In the example with CD4 T-lymphocytes, one of the genes was unlikely to be a good candidate as it responded strongly to a subset of conditions in the Conditions tool. We also observed that most of the candidate genes had a slight response to various tumors and to oncolytic viruses (see Additional file 8).
Our approach builds on previous studies showing that reference genes identified from microarray data often performed better in normalizing RT-qPCR experiments than commonly used reference genes. In contrast to previous studies, our approach combines three levels: 1) it searches for the most stable candidates from a genome-wide set of genes (rather than from a small set of commonly used reference genes), 2) it allows to restrict the search to an expression range similar to that of own target genes, and 3) it allows users to flexibly choose, from a very large array compendium, context-specific sets of microarrays based on sample annotations. Additionally, based on the Genevestigator standardized data content, it allows users to cross-validate new candidates across a large set of experimental conditions prior to testing them in the laboratory. RefGenes therefore allows to select experimental conditions that are similar to that of a specific experiment and to obtain reliable and condition-specific candidates for the normalization of RT-qPCR or other types of transcript quantification data. Although Genevestigator currently contains more than 50,000 arrays, several experimental conditions may not yet be well populated (e.g. B-lymphocytes). In such cases, it is recommended to include additional arrays from related experimental conditions or tissues.
In our approach, we are extrapolating results from a variety of microarray experiments carried out within a specific biological context (e.g. tissue type) to predict gene stability in similar contexts. We show across several RT-qPCR experiments that the extrapolation is generally reliable. Nevertheless, because we are comparing different sets of biological experiments as well as two technologies, results may differ between the two platforms. The main source of discrepancy is likely to be due to differences in the types of biological experiments and samples between the predictor dataset (microarray) and the target experiment (e.g. RT-qPCR). It is also possible that the candidates proposed by RefGenes are biased by the inherent nature of microarray data as compared to RT-qPCR data, or by data transformation procedures during normalization. In fact, one would expect variance to depend linearly on the mean based on original intensities (which are proportional to molecular concentration). Nevertheless, and despite differences in sensitivity between the two technologies, we did not observe major discrepancies that would question the use of microarray data to identify stably expressed genes to be used as references for RT-qPCR. In fact, the experiments described above, as well as previously published work, e.g.,  demonstrate that the availability of quality controlled and normalized oligonucleotide microarray data (such as Affymetrix GeneChip arrays) allows to identify better reference gene candidates than commonly used reference genes. The use of different normalization methods or measures of variance is expected to influence the outcome of a search by RefGenes, but overall it is unlikely that genes that exhibit a high stability within a RT-qPCR experiment would not be identified by either of these methods at the microarray level. In particular, differences between popular algorithms, such as RMA and MAS5, are minor in the medium to high expression range for data from single experiments . This is the range where most RT-qPCR normalization genes are located. When combining data from multiple experiments, the method used to correct for cross-experiment effects will have an additional influence on the overall variance. The same holds true for batch effects within a single experiment. Here, we show a proof of principle of reference gene identification using a data compendium normalized with MAS5 (cross-normalized with global scaling) and several RT-qPCR validation studies. A further measure to in silico validate candidates proposed by RefGenes is to check how they respond to different conditions using the Conditions and Genotypes tools in the Meta-Profile Analysis toolset. In general, stably expressed genes respond very weakly to internal or external perturbations (see for example Additional file 8 figure D). Batch and experimental biases are minor in this dataset since we are looking at (log)ratio values that were calculated from individual treatment versus control sets of samples from the same batch or experiment.
We conclude that the identification of context-specific reference genes, combined with existing methods for normalization against multiple controls, is expected to significantly improve the quality and sensitivity of expression quantification experiments, facilitating the correct interpretation of RT-qPCR data. RefGenes is freely available for academic users (upon registration to prove one's affiliation), while for commercial users, RefGenes is available as part of a Genevestigator subscription. Ref Genes is a Genevestigator tool and is available at http://www.genevestigator.com.
Selection of reference genes
Data from Genevestigator was normalized, quality controlled, and annotated manually as described previously . In brief, Affymetrix expression array data used for this study was normalized using the MAS5 algorithm, with global scaling set to a target value of 1000. The quality of the arrays was assessed using various Bioconductor  packages, including AffyQCReport and SimpleAffy . Sample descriptions were annotated using the Genevestigator application ontologies for anatomical parts, stage of development, and experimental perturbations. Novel reference gene candidates used for experimental validation were obtained from RefGenes. The search algorithm identifies, for a chosen set of microarrays, those probe sets for which the standard deviation of signal intensities across these arrays is lowest.
In the below experiments, the set of commonly used reference genes was arbitrarily chosen from genes that had been previously used as references in the respective laboratories.
RT-qPCR for mouse liver
Mm GAK F CTGCCCACCAGGCATTTG
Mm GAK R CCATGTCACATACATATTCAATGTACCT
Mm MRPl46 F GGGAGCAGGCATTCCTACAG
Mm MRPl46 R GGTCCGGTCATTTTTTTTGTCA
Mm SRP72 F CACCCAGCAGACAGACAAACTG
Mm SRP72 R GCACTCATCGTAGCGTTCCA
Mm VPS4A F GACAACGTCAACCCTCCAGAAA
Mm VPS4A R TCTGTGGCTTTTGTCACCAGAT
Mm TUBB F GCAGTGCGGCAACCAGAT
Mm TUBB R AGTGGGATCAATGCCATGCT
Mm HPRT F GCTCGAGATGTCATGAAGGAGAT
Mm HPRT R AAAGAACTTATAGCCCCCCTTGA
Mm ACTB F CTAAGGCCAACCGTGAAAAGAT
Mm ACTB R CACAGCCTGGATGGCTACGT
Mm GAPDH F TCCATGACAACTTTGGCATTG
Mm GAPDH R CAGTCTTCTGGGTGGCAGTGA
RT-qPCR for human LCLs
Hs B2 M F TGCTGTCTCCATGTTTGATGTATCT
Hs B2 M R TCTCTGCTCCCCACCTCTAAGT
Hs GAPD F TGCACCACCAACTGCTTAGC
Hs GAPD R GGCATGGACTGTGGTCATGAG
Hs RPL13A F CCTGGAGGAGAAGAGGAAAGAGA
Hs RPL13A R TTGAGGACCTCTGTGTATTTGTCAA
Hs SDHA F TGGGAACAAGAGGGCATCTG
Hs SDHA R CCACCACTGCATCAAATTCATG
Hs YWHAZ F ACTTTTGGTACATTGTGGCTTCAA
Hs YWHAZ R CCGCCAGGACAAACCAGTAT
Hs BUD13 F GATGGAGATTTGCCTGTGGT
Hs BUD13 R ATTTGGCACTGGAACGAAAG
Hs EIF4EBP2 F TAGCCCTGGCACCTTAATTG
Hs EIF4EBP2 R AACTGAGCATCATCCCCAAC
Hs GOLT1B F CCTTATTGGTTGGCCTTTGA
Hs GOLT1B R AGCCAACAACGACAGGAAAG
Hs INTS4 F GCAGCTCCATGAAAGAGGAC
Hs INTS4 R ACCCAGATAAGCTGGACTGC
Hs SAP130 F GAGGCCAGTTTCTGCAGTTC
Hs SAP130 R GCACCAGGTGGTAGGTCACT
Hs TATDN2 F ACAAATGCTCTCCACCCCTA
Hs TATDN2 R TCCATCACCACCTCCCTATC
Hs ZNF410 F CTCCGAAAACATCTGGTGGT
Hs ZNF410 R CTGCAGGTGATGCTTTCTCA
RT-qPCR for cattle and pig liver
Bt ACTB F AACTCCATCATGAAGTGTGACG
Bt ACTB R GATCCACATCTGCTGGAAGG
Bt GAPDH F GTCTTCACTACCATGGAGAAGG
Bt GAPDH R TCATGGATGACCTTGGCCAG
Bt UBQ F AGATCCAGGATAAGGAAGGCAT
Bt UBQ R GCTCCACCTCCAGGGTGAT
Bt VPS4A F CAAAGCCAAGGAGAGCATTC
Bt VPS4A R ATGTTGGGCTTCTCCATCAC
Bt GAK F TCTGGGAAGTGGCAGAGAGT
Bt GAK R CGGCACGTCTGGTAGAAGAT
Bt PMPCA F CATCCCAGAATAAGTTTGGACAG
Bt PMPCA R AGAATCAGCAGACACAGCATACA
Ss UBIQ F AGATCCAGGATAAGGAAGGCAT
Ss UBIQ R GCTCCACCTCCAGGGTGAT
Ss Histon H3 F ACTGGCTACAAAAGCCGCTC
Ss Histon H3 R ACTTGCCTCCTGCAAAGCAC
Ss GAPDH F AGCAATGCCTCCTGTACCAC
Ss GAPDH R AAGCAGGGATGATGTTCTGG
Ss GAK F AATCGCAGTGATGTCCTTCC
Ss GAK R GCTTCGAGTCCAGAAACAGC
Ss VPS4A F CAAAGCCAAGGAGAGCATTC
Ss VPS4A R ATGTTGGGCTTCTCCATCAC
Ss PMPCA F CATCCCAGAATAAGTTTGGACAG
Ss PMPCA r AGAATCAGCAGACACAGCATACA
RT-qPCR for Arabidopsis tissues
Total RNA was isolated from 5 day old seedlings or from 15 day old leaves following the TRIzol protocol (Invitrogen). RNA quantity and quality was assayed via spectrophotometer analysis (Pharmacia Biotech). First-strand cDNA synthesis was performed with 3 μ g of total RNA using SuperScript II RNase H-reverse transcriptase (Invitrogen) and oligo-dT primers (Fermentas) according to the manufacturer's instructions. The 20-μ L cDNA reaction was diluted 1:100 with deionized water, and 4 μ L were used for each RT-PCR amplification. Amplifications were performed as technical duplicates and biological quadruplicates in 96-well plates in a 20-μ L reaction volume containing 10 μ L 2× Fast SYBR Green qPCR MasterMix (Applied Biosystem). Reactions were performed on a 7500 Fast Real-Time PCR System (Applied Biosystems). Primers for all amplifications, designed with PerlPrimer v1.1.10 (freeware by Owen Marshall), were located on exon-exon borders to prevent amplification of potentially contaminating genomic DNA.
At At3g24160 F ATATCAGACAGGCAGTCAGCG
AT At3g24160 R TGCTAAAGCATCGATACCACC
At At3g27820 F GCGGTGGCTATATCGGTATGG
At At3g27820 R AAAGAGACGTGCCATGCAGTG
At At1g13320 F CAAGTGAACCAGGTTATTGGGA
At At1g13320 R ATAGCCAGACGTACTCTCCAG
At At3g61710 F AGACACAGGTTGAACAGCCA
At At3g61710 R GTATGCTTCCACGTCCCTCG
At At1g32050 F TCACCTACTTGATTCACATTGGCT
At At1g32050 R ATCAATTGCTGCAAGCACAC
At At3g01150 F CCACCGGAGCAGAGATTACAC
At At3g01150 R CAACTTTCTTGCCGTCAGCAC
At At3G17920 F AACGACACTGTCAGATTCCA
At At3g17920 R CTACTTCCCGTTGCTTATAGGTG
At At2G17390 F CAGACTGTTGCAGCTGAACCT
At At2g17390 R GCTTTCAAACCCTCGACATCAC
At At5G51880 F CAGTATTGTAGCTGAGGTAGCTCC
At At5g51880 R CGCCTTTGGAGACATTCCTC
We acknowledge support of our research from the European Union (EU Framework Program 6, AGRON-OMICS (LSHG-CT-2006-037704)), CTI (Swiss Commission for Technology and Innovation), and ETH Zurich. cDNA from mouse liver samples were kindly provided by Gwendal Le Martelot from the laboratory of U. Schibler (Department of Molecular Biology, University of Geneva, Switzerland).
- Cui X, Zhou J, Qiu J, Johnson MR, Mrug M: Validation of Endogenous Internal Real-Time PCR Controls in Renal Tissues. Am J Nephrol. 2009, 30: 413-417. 10.1159/000235993.View ArticlePubMedPubMed CentralGoogle Scholar
- Guenin S, Mauriat M, Pellou J, Van Wuytswinkel O, Bellini C, Gutierrez L: Normalization of qRT-PCRdata: the necessity of adopting a systematic, experimental conditions-specific, validation of references. J Exp Bot. 2009, 60 (2): 487-493. 10.1093/jxb/ern305.View ArticlePubMedGoogle Scholar
- Meller M, Vadachkoria S, Luthy D, Williams M: Evaluation of housekeeping genes in placental comparative expression studies. Placenta. 2005, 26: 601-607. 10.1016/j.placenta.2004.09.009.View ArticlePubMedGoogle Scholar
- Svingen T, Spiller CM, Kashimada K, Harley VR, Koop- man P: Identification of suitable normalizing genes for quantitative real-time RT-PCR analysis of gene expression in fetal mouse gonads. Sex Dev. 2009, 3: 194-204. 10.1159/000228720.View ArticlePubMedGoogle Scholar
- Zhang X, Ding L, Sandford A: Selection of reference genes for gene expression studies in human neutrophils by real-time PCR. BMC Mol Biol. 2005, 6: 4-10.1186/1471-2199-6-4.View ArticlePubMedPubMed CentralGoogle Scholar
- Huggett J, Dheda K, Bustin S, Zumla A: Real-time RT-PCR normalization: strategies and considerations. Genes and Immunity. 2005, 6: 279-284. 10.1038/sj.gene.6364190.View ArticlePubMedGoogle Scholar
- Gutierrez L, Mauriat M, Pelloux J, Bellini C, Wuytswinkel OV: Towards a systematic validation of references in real-time RT-PCR. The Plant Cell. 2008, 20: 1734-1735. 10.1105/tpc.108.059774.View ArticlePubMedPubMed CentralGoogle Scholar
- Andersen C, Ledet-Jensen J, Orntoft T: Normalization of Real-Time quantitative reverse transcription- PCR data: a model-based variance estimation approach to identify genes suited for normalization, applied to bladder and colon cancer data sets. Cancer Research. 2004, 64: 5245-5250. 10.1158/0008-5472.CAN-04-0496.View ArticlePubMedGoogle Scholar
- Cai J, Deng S, Kumpf S, Lee P, Zagouras P, Ryan A, Gallagher D: Validation of rat reference genes for improved quantitative gene expression analysis using low density arrays. Biotechniques. 2007, 42 (4): 503-511. 10.2144/000112400.View ArticlePubMedGoogle Scholar
- Fischer M, Skowron M, Berthold F: Reliable transcript quantification by real-time reverse transcript-polymerase chain reaction in primary neuroblastoma using normalization to averaged expression levels of the control genes HPRT1 and SDHA. J Mol Diagnostics. 2005, 7: 89-96. 10.1016/S1525-1578(10)60013-X.View ArticleGoogle Scholar
- Szabo A, Perou C, Karaca M, Perreard L, Quackenbush J, Bernard P: Statistical modeling for selecting housekeeper genes. Genome Biology. 2004, 5: R59-10.1186/gb-2004-5-8-r59.View ArticlePubMedPubMed CentralGoogle Scholar
- Brunner A, Yakovlev I, Strauss S: Validating internal controls for quantitative plant gene expression studies. BMC Plant Biology. 2004, 4: 14-10.1186/1471-2229-4-14.View ArticlePubMedPubMed CentralGoogle Scholar
- Vandesompele J, De Preter K, Pattyn F, Poppe B, Van Roy N, De Paepe A, Speleman F: Accurate normalization of real-time quantitative RT-PCR data by geometric averaging of multiple internal control genes. Genome Biology. 2002, 3 (7): 0034.I-0034.II. 10.1186/gb-2002-3-7-research0034.View ArticleGoogle Scholar
- Lindbjerg Andersen J, Jensen Ledet, Orntoft TF: Normalization of Real-Time Quantitative Reverse Transcription-PCR Data: A Model-Based Variance Estimation Approach to Identify Genes Suited for Normalization, Applied to Bladder and Colon Cancer Data Sets. Cancer Research. 2004, 64: 5245-5250. 10.1158/0008-5472.CAN-04-0496.View ArticleGoogle Scholar
- Pfaffl M, Tichopad A, Prgomet C, Neuvians T: Determination of stable housekeeping genes, differentially regulated target genes and sample integrity: BestKeeper - Excel-based tool using pair-wise correlations. Biotechnology Letters. 2004, 26 (509): 515-Google Scholar
- Mar J, Kimura Y, Schroder K, Irvine K, Hayashizaki Y, Suzuki H, Hume D, Quackenbush J: Data-driven normalization strategies for high-throughput quantitative RT-PCR. BMC Bioinformatics. 2009, 10: 110-10.1186/1471-2105-10-110.View ArticlePubMedPubMed CentralGoogle Scholar
- Bustin S, Benes V, Garson J, Hellemans J, Huggett J, Kubista M, Mueller R, Nolan T, Pfaffl M, Shipley G, Vandesompele J, Wittwer C: The MIQE guidelines: minimum information for publication of quantitative real-time PCR experiments. Clinical Chemistry. 2009, 55 (4): 611-622. 10.1373/clinchem.2008.112797.View ArticlePubMedGoogle Scholar
- Czechowski T, Stiit M, Atlmann T, Udvardi M, Scheible W: Genome-Wide Identification and Testing of Superior Reference Genes for Transcript Normalization in Arabidopsis. Plant Physiol. 2005, 139: 5-17. 10.1104/pp.105.063743.View ArticlePubMedPubMed CentralGoogle Scholar
- Saviozzi S, Cordero F, Lo Iacono M, Novello S, Scagliotti G, Calogero R: Selection of suitable reference genes for accurate normalization of gene expression profile studies in non-small cell lung cancer. BMC Cancer. 2006, 6: 200-10.1186/1471-2407-6-200.View ArticlePubMedGoogle Scholar
- Hamalainen H, Tubman J, Vikman S, Kyrola T, Ylikoski E, Warrington J, Lahesmaa R: Identification and validation of endogenous reference genes for expression profiling of T helper cell differentiation by quantitative real-time RT-PCR. Anal Biochem. 2001, 299 (1): 63-70. 10.1006/abio.2001.5369.View ArticlePubMedGoogle Scholar
- Gabrielsson BG, Olofsson LE, Sjogren A, Jernas M, Elander A, Lonn M, Rudemo M, Carlsson LM: Evaluation of reference genes for studies of gene expression in human adipose tissue. Obes Res. 2005, 13: 649-652. 10.1038/oby.2005.72.View ArticlePubMedGoogle Scholar
- Stamova BS, Apperson M, Walker WL, Tian Y, Xu H, Adamczy P, Zhan X, Liu DZ, Ander BP, Liao IH, Gregg JP, Turner RJ, Jickling G, Lit L, Sharp FR: Identification and validation of suitable endogenous reference genes for gene expression studies in human peripheral blood. BMC Med Genomics. 2009, 2: 49-10.1186/1755-8794-2-49.View ArticlePubMedPubMed CentralGoogle Scholar
- Kwon MJ, Oh E, Lee S, Roh MR, Kim SE, Lee Y, Choi YL, In YH, Park T, Koh SS, Shin YK: Identification of novel reference genes using multiplatform expression data and their validation for quantitative gene expression analysis. PLoS ONE. 2009, 4: e6162-10.1371/journal.pone.0006162.View ArticlePubMedPubMed CentralGoogle Scholar
- Gur-Dedeoglu B, Konu O, Bozkurt B, Ergul G, Seckin S, Yulug IG: Identification of endogenous reference genes for qRT-PCR analysis in normal matched breast tumor tissues. Oncol Res. 2009, 17: 353-365. 10.3727/096504009788428460.View ArticlePubMedGoogle Scholar
- Popovici V, Goldstein DR, Antonov J, Jaggi R, Delorenzi M, Wirapati P: Selecting control genes for RT- QPCR using public microarray data. BMC Bio formatics. 2009, 10: 42-10.1186/1471-2105-10-42.View ArticleGoogle Scholar
- Pilbrow AP, Ellmers LJ, Black MA, Moravec CS, Sweet WE, Troughton RW, Richards AM, Frampton CM, Cameron VA: Genomic selection of reference genes for real-time PCR in human myocardium. BMC Med Genomics. 2008, 1: 64-10.1186/1755-8794-1-64.View ArticlePubMedPubMed CentralGoogle Scholar
- Frericks M, Esser C: A toolbox of novel murine house-keeping genes identified by meta-analysis of large scale gene expression profiles. Biochim Biophys Acta. 2008, 1779: 830-837.View ArticlePubMedGoogle Scholar
- Lee S, Jo M, Lee J, Koh S, Kim S: Identification of novel universal housekeeping genes by statistical analysis of microarray data. Biochem Mol Biol. 2007, 40 (2): 226-231.Google Scholar
- Hruz T, Laule O, Szabo G, Wessendorp F, Bleuler S, Oertle L, Widmayer P, Gruissem W, Zimmermann P: Genevestigator V3: A Reference Expression Database for the Meta-Analysis of Transcriptomes. Adv Bioinform. 2008Google Scholar
- Millenaar F, Okyere J, May S, van Zanten M, Voesenek L, Peeters A: How to decide? Different methods of calculating gene expression from short oligonucleotide array data will give different results. BMC Bioinformatics. 2006, 7: 137-10.1186/1471-2105-7-137.View ArticlePubMedPubMed CentralGoogle Scholar
- Gentleman R, Carey V, Douglas M, Bolstad B, Dettling M, Dudoit S, Ellis B, Gautier L, Ge Y, Gentry J, Hornik K, Hothorn T, Huber W, Iacus S, Irizarry R, Leisch F, Li C, Maechler M, Rossini A, sawitzki G, Smith C, Smyth G, Tierney L, Yang Y, Zhang J: Bioconductor: open software development for computational biology and bioinformatics. Genome Biol. 2004, 5: R80-10.1186/gb-2004-5-10-r80.View ArticlePubMedPubMed CentralGoogle Scholar
- Wilson C, Miller C: Simpleaffy: a BioConductor package for Affymetrix Quality Control and data analysis. Bioinformatics. 2005, 18: 3683-5. 10.1093/bioinformatics/bti605.View ArticleGoogle Scholar
- Fonjallaz P, Ossipow V, Wanner G, Schibler U: The two PAR leucine zipper proteins, TEF and DBP, display similar circadian and tissue-specific expression, but have different target promoter preferences. EMBO J. 1996, 15: 351-362.PubMedPubMed CentralGoogle Scholar
- Rozen S, Skaletsky H: Primer3 on the WWW for general users and for biologist programmers. Methods Mol Biol. 2000, 132: 365-386.PubMedGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.