Skip to main content
  • Methodology article
  • Open access
  • Published:

Evaluation of methods for amplification of picogram amounts of total RNA for whole genome expression profiling



For more than a decade, microarrays have been a powerful and widely used tool to explore the transcriptome of biological systems. However, the amount of biological material from cell sorting or laser capture microdissection is much too small to perform microarray studies. To address this issue, RNA amplification methods have been developed to generate sufficient targets from picogram amounts of total RNA to perform microarray hybridisation.


In this study, four commercial protocols for amplification of picograms amounts of input RNA for microarray expression profiling were evaluated and compared. The quantitative and qualitative performances of the methods were assessed. Microarrays were hybridised with the amplified targets and the amplification protocols were compared with respect to the quality of expression profiles, reproducibility within a concentration range of input RNA, and sensitivity. The results demonstrate significant differences between these four methods.


In our hands, the WT-Ovation pico system proposed by Nugen appears to be the most suitable for RNA amplification. This comparative study will be useful to scientists needing to choose an amplification method to carry out microarray experiments involving samples comprising only a few cells and generating picogram amounts of RNA.


Gene expression profiling using microarray technology is a powerful method to investigate the phenotype of complex biological systems [1]. Over the last decade, developments by academic and private sectors have improved the reproducibility, standardisation and accuracy, and have decreased the cost of this technology. However, the main drawback of this technology was the large amount of input RNA needed to carry out microarray experiments, preventing expression analysis on small samples. This problem has been largely overcome thanks to RNA amplification methods. Standard target preparation protocols now allow large-scale gene expression profiling to be performed from nanogram quantities of input RNA. However, cell selection technologies that allow the isolation of 1–100 cells such as cell-sorting methods [2] or laser capture microdissection (LCM) [35], have driven the development for further reduction. Only a few protocols are designed for the amplification of picogram amounts of input RNA and allow the potential investigation of the transcriptome of few cells isolated by cell-sorting techniques or LCM.

The most routinely used amplification method is based on linear amplification by in vitro transcription (IVT) of a cDNA template into complementary RNA (cRNA), using T7 RNA polymerase [68]. Several protocols based on this technique have been developed and are commonly used to perform gene expression profiling experiments using microarrays [6, 920]. Recently, a new RNA amplification system based on the linear isothermal amplification of double-stranded cDNA that encompasses a unique RNA/DNA heteroduplex at one end using the RNA-dependent DNA polymerase activity has been developed [21]. This technique has been used to perform gene expression profiling experiments [2229].

We assume that the purification of total RNA from cultured cells or tissue after isolation using these methods can be largely method-, cell- or tissue-dependent. In this study, to minimise this source of error and to focus on the amplification method, a commercial source of total RNA, i.e. human universal RNA, was used. We compared four commercial RNA amplification protocols to the standard target labelling procedure proposed by Affymetrix in side-by-side experiments to evaluate the most suitable method to perform gene expression profiling from picogram amounts of input RNA on Affymetrix GeneChip microarrays. The following amplification protocols were compared: i) Arcturus RiboAmp™ system, ii) Ambion MessageAmp™, iii) Epicentre TargetAmp™, and iv) Nugen WT-Amplification™ pico system. Protocols proposed by Arcturus, Ambion and Epicentre are adapted from the IVT method first described by Eberwine et al. [68]. The system proposed by Nugen is based on the RNA-dependent DNA polymerase activity [21]. Although amplification methods have already been evaluated elsewhere [15, 24, 26, 3033], no comparative study of RNA amplification procedures from picogram amounts has been published.


Qualitative and quantitative analysis of the input total RNA confirmed its high quality (Figure 1A).

Figure 1
figure 1

Quality of input RNA and targets synthesised from different amounts of input RNA. A, Bioanalyzer electrophoretic profile of the diluted Universal Human Reference RNA used as input for all amplifications. This profile corresponds to a classical and non-degraded human RNA with two fine characteristic peaks corresponding to 18S and 28S RNAs. 8.4 corresponds to the RNA Integrity Number (RIN) and reflects the high quality of this RNA B, electrophoretic profiles of cRNA obtained after one- and two-round Affymetrix amplification using 2 μg, and 100 ng of input RNA respectively or water as negative control. C, D, E, F, electrophoretic profiles of cRNA or cDNA obtained using Ambion (C), Arcturus (D), Epicentre (E) and Nugen (F) amplification systems from 250 pg and 500 pg of input RNA, or water as negative control.

Qualitative and quantitative analysis of amplification products

For each protocol, one RNA amplification was performed from 250 pg and one from 500 pg of human universal RNA by two operators in two independent laboratories. A negative control (amplification without total RNA) and a positive control (if available) were included in each experimental batch. The quality of each amplified product (cRNA or cDNA) was assessed using microfluidic electrophoresis (Figure 1C–F) and compared to the amplified aRNA obtained from 2 μg and 100 ng RNA inputs following the standard protocol proposed by Affymetrix (Figure 1B).

The size of the main population of aRNAs synthesised according the protocol proposed by Ambion (Figure 1C) ranged between 100 nt and 4000 nt with an average of 1000 nt which is shorter than the manufacturer's indicated length. Moreover, an unexpected short-sized aRNA population of 200 nt was consistently observed. The population of aRNA obtained using the Arcturus protocol ranged in size between 100 and 2000 nucleotides (nt) with an average of 500 nt, but aRNAs longer than 8000 nt were systematically observed (Figure 1D). The aRNA population generated according to the Epicentre TargetAmp™ protocol (Figure 1E) ranged in size between 25 nt and 1000 nt, with an average of 200 nt, which is shorter than indicated in the manufacturer's specifications. The electrophoretic traces of the aRNA obtained during the duplicate amplifications of 250 pg and 500 pg of starting total RNA were also different. The size of cDNAs obtained using the amplification method proposed by Nugen (Figure 1F) was distributed between 100 nt and 2000 nt (average: 500 nt) according to the manufacturer's protocol. However, a discrete population cDNA of 100 nt was systematically observed, clearly corresponding to non-specific products that were also detected on amplification of the negative control.

The quantities of aRNA and cDNA obtained after amplification are presented in Table 1. Yields were sufficient to perform target preparation and hybridisation according to the manufacturers' protocols except for amplification performed using Epicentre TargetAmp™ system. Moreover, yields obtained with the protocols proposed by Epicentre and Arcturus appeared to be laboratory-dependent and non-reproducible in our hands (twofold changes in the amounts of amplified cDNA). Regardless of the protocol used, similar yields of about 2 μg of non-specific amplification products were synthesised when amplification was performed without RNA (negative controls).

Table 1 aRNA and cDNA yields obtained after amplification using universal RNA, positive and/or negative controls.

Overall quality of expression profiles

After amplification, each labelled cRNA or cDNA target was biotinylated, fragmented and hybridised on Affymetrix HG U133 plus 2.0 to assess the impact of each protocol on expression profiles. Raw .CEL files were normalised using the MAS5 algorithm from Affymetrix, and metrics for all hybridisations were analysed and compared (Table 2). Targets synthesised with each of the methods assessed showed acceptable average background values compared to Affymetrix specifications, ranging between 20 and 100. Background values of chips hybridised with cDNA targets (Nugen WT-Amplification™) were homogeneous and significantly lower than those of the other chips. Percentage of present calls (%P, i.e. expressed genes) ranged from 40% to 50%, as expected when analysing human universal RNA, except for the hybridisation performed from 500 pg of input RNA according to the Arcturus RiboAmp™ method (about 30% of present calls). Biases toward amplification of 3' and 5' ends of GAPDH and β-Actin were also computed (Table 2) in order to evaluate the efficiencies of cDNA template synthesis and amplification reactions. The 3'/5' ratios for housekeeping genes should be at most 3 when one-round amplification is performed, and at most 10 for two-round amplification procedures. The 3'/5' ratios obtained were dramatically above the cut-off values when targets were synthesised using the protocols proposed by Arcturus, Ambion, and Epicentre but remained acceptable (below 10) for cDNA targets prepared according to the Nugen method.

Table 2 Comparison of hybridisation quality metrics of the evaluated RNA inputs and protocols.

Reproducibility and inter-system comparability

Raw signal distributions before (Figure 2A) and after normalisation (Figure 2B) were analysed and compared. After normalisation, the signal distributions of chips hybridised with all protocols were homogeneous and can be compared. Note that the results obtained, before normalisation, with RNA amplified according to the Ambion MessageAmp™ protocol highlight the discrepancies in signal distribution that appear to be batch- or laboratory-dependent.

Figure 2
figure 2

Box plots of signal intensities. A, raw data. B, data after MAS5 normalisation.

To assess the overall reproducibility of amplifications, Pearson's correlation coefficients between technical replicates were computed and averaged for each protocol (Figure 3A). The average of correlation coefficients for all protocols was about 0.95 indicating high reproducibility of measurements. Correlation coefficients between results obtained from 250 pg and 500 pg of RNA input were also averaged for each method to evaluate protocol reproducibility and robustness across quantitative modulations of RNA inputs (Figure 3A). Almost no difference was observed for correlations between technical replicates and correlations between 250 pg and 500 pg of RNA input for the Ambion and Nugen protocols, suggesting that the amount of RNA input has little impact on expression data. A lower correlation coefficient (0.924) was observed between the results obtained with different amounts of RNA input when using the Arcturus RiboAmp™ protocol.

Figure 3
figure 3

Statistical analysis of expression level measurements for assessing reproducibility and comparability of amplification chemistries. A, we calculated the Pearson's correlation coefficients between technical replicates (same chemistry, same amount of input RNA, but different laboratories). The correlation values were then averaged for each chemistry (grey bars). We also calculated correlation coefficients between results obtained from 250 pg and from 500 pg of RNA input (same chemistry, but different amount of RNA input) and averaged them for each chemistry in order to evaluate the robustness across quantitative variability of RNA input (black bars). Most Epicentre amplifications did not yield sufficient aRNA to carry out hybridisations, and Pearson's correlation coefficients could therefore not be calculated (*). B, Graphic representation of Pearson's correlation coefficients calculated for each pairwise comparison of all assays.

The correlation of the gene expression data obtained with each evaluated methods and the reference one-round and two-round Affymetrix amplification protocols were also compared to assess the value of each protocol (Figure 3B). Not surprisingly, reproducibility within a given protocol was higher than across protocols. Major discrepancies between hybridisations of cDNA synthesised according to the Nugen WT-Amplification™ protocol and aRNA produced according to the IVT amplification protocols (protocols proposed by Affymetrix, Ambion, Arcturus, and Epicentre; Pearson's correlation coefficient of about 0.7) were observed. Moreover, more marked discrepancies were observed between data from Affymetrix one-round IVT amplification and data from all two-round IVT amplifications, than between each of the two-round IVT amplifications. Not surprisingly, the most strongly correlated results were obtained using similar amplification systems.

Further assessment of the Nugen protocol

The Nugen WT-Ovation™ pico system was further characterised, as the overall best results were obtained using this protocol. Additional amplifications and microarray hybridisations from 50 pg, 100 pg and 1000 pg of input RNA were performed in duplicate as previously. The amounts of input RNA evaluated therefore ranged from 50 pg to 1 ng (50 pg, 100 pg, 250 pg, 500 pg, and 1000 pg). The quality of each amplified cDNA was assessed (Figure 4). Not surprisingly, the discrete peak corresponding to non-specific amplification products previously observed in negative controls, increased relative to the specific cDNA target quantity when the amount of input RNA decreased. Amplification yields (Table 3) decreased slightly with the amount of input RNA. Except for the amplifications performed from 50 pg of input RNA, more cDNA was generated than required for GeneChip hybridisation according to the Nugen WT-Amplification™ pico protocol (5 μg, Table 3). Amplified cDNA products, including those containing less than 5 μg, were biotinylated, fragmented and hybridised on Affymetrix HG U133 plus 2.0 under the same experimental conditions as those described previously. Hybridisation metrics were analysed and compared as described previously (Table 3). Average background values were low and homogeneous with those obtained previously with 250 pg and 500 pg of input RNA. The other metrics were within the expected range according to the usual specifications for amplifications of 1000 pg, 500 pg and 250 pg, but the percentages of present calls decreased for amplifications of 100 pg and 50 pg of RNA, and 3'/5' ratios for housekeeping genes were significantly higher for amplifications performed from 50 pg of RNA (Table 3). To further investigate the impact of RNA input amounts on expression data, Pearson's correlation coefficients between all experimental data were computed (Figure 5). A weaker correlation was observed for data obtained from the smallest amounts of input RNA (50 pg and 100 pg).

Table 3 cDNA yields and hybridisation quality metrics of Nugen experiments.
Figure 4
figure 4

Quality of cDNA targets synthesised following Nugen protocol from different amounts of input RNA. Bioanalyzer electrophoretic profiles of cDNA targets obtained after the amplification of 50 pg, 100 pg, 250 pg, 500 pg, and 1 ng of total RNA using Nugen chemistry.

Figure 5
figure 5

Reproducibility of expression data obtained using Nugen chemistry across amounts of input RNA. Pearson's correlation coefficients were computed and represented graphically for each pairwise comparison of assays. Lower correlations were observed for data obtained from smallest amounts of input RNA (50 pg and 100 pg).

To assess the sensitivity of Nugen system and to determine whether it allowed the measurement of differential gene expression, the expression profiles of two cell lines (SkBr3 and HCC38) were compared using the Nugen WT-Amplification™ pico system and the Affymetrix one-cycle IVT amplification. 500 pg and 2 μg of RNA of each cell line were amplified according to the protocols proposed by Nugen and Affymetrix, respectively, and hybridised on Affymetrix HG U133 plus 2.0 GeneChip. As expected, Affymetrix and Nugen protocols showed similar yields of reproducibility with correlation coefficients up to 0.90 between replicates (data not shown). Differential gene expression analysis was performed for each system using the present, absent, marginal increase, marginal decrease, increase and decrease criteria proposed by Affymetrix and implemented in GCOS software (Table 4). Although the two systems allowed identification of the same number of up- or down-regulated genes, only about 50% of these genes were differentially expressed in the same direction when using the other protocol. The other set of genes was mostly non-modulated. The direction of differential expression was divergent in only 0.3% of measurements between the Nugen WT-Amplification™ pico system and the Affymetrix one-round IVT amplification system. Another evaluation of the differential gene expression measurement has been performed. For each chemistry, ratios of the expression values obtained for each cell line were calculated and graphed (Figure 6). Although ratios show dispersion with respect to the chemistry, no particular bias was noticed. In addition, differences in the direction of differential expression were observed for 4% of the probesets (1100 over-expressed probesets with Nugen and down-expressed with Affymetrix were observed and inversely for 1166). Moreover, almost all of those probesets show a low differential expression (absolute value lower than 1, less than 2-fold over or lower expression).

Table 4 Comparison of differential gene expression data using Affymetrix one-round and Nugen chemistries.
Figure 6
figure 6

Comparison of differential gene expression data using Affymetrix one-round and Nugen chemistries. Targets were generated from RNAs of two cell lines using Affymetrix 1-round IVT and Nugen chemistries. After hybridisation, differential gene expression results were normalised (MAS5) and the expression ratio calculated for each probeset. Logarithm of ratios to the base 2 (Log2 ratios) were computed for each chemistries and graphed(X axis Nugen and Y axis Affymetrix). Differences in the direction of differential expression were only observed for 4% of the probesets (dots located in the upper-left quadrant and lower-right quadrant). Moreover, almost all of those probesets show a low differential expression (absolute value lower than 1, less than 2-fold over or lower expression). The slope of the regression line is 1.033 (p < 10-16) and it intercepts the Y axis at -0.02 (p < 10-12). The Pearson's correlation coefficient has been calculated between the expression ratios distribution (R = 0.321).


Gene expression profiling on several hundred cells isolated by cell-sorting technologies, or by LCM prompts the development of new amplification procedures. Over recent years, academic, private sector and commercial researchers have been developing tools and methods to generate expression profiles from small amounts of biological material. Improvements have been made in all steps of the process of expression profiling experiments such as sample collection, RNA purification, or acquisition and analysis of expression data. Over the last few years, improvements in RNA amplification methods now allow the synthesis of sufficient targets to perform microarray hybridisation on as little as picogram amounts of input RNA. In this study, we evaluated and compared four commercial RNA amplification protocols using picogram amounts of input RNA. This comparative study will be useful to researchers when planning new experiments involving samples derived from a few cells.

This comparative study was based on several assessments of amplification products. First of all, electrophoresis was performed and examined in combination with cRNA or cDNA yields. This analysis is performed routinely prior to hybridisation, as it provides an estimate of the overall amplification performance. Unusual traces or insufficient yield correspond to either abnormal input RNA, or amplification failure. The poor yield obtained with the protocol proposed by Epicentre is due to amplification failures since the quality of the commercial RNA has been checked. Experimental errors might be the cause of these failures. However, as amplifications were carried out in duplicate by two experienced operators in two laboratories, the quality of the batch and its reproducibility may be responsible for these errors.

The overall size of aRNA, estimated by the electrophoretic profile, has been previously described as a good metric when looking at within-sample fidelity [26]. As expected, a high level of consistency in amplified product sizes and electrophoretic profiles was observed within each technology, since all amplifications were performed using the same input RNA. The repeated observation of products of very large size (8,000–12,000 nt) obtained with the Arcturus RiboAmp™ kit are surprising and might be due to the transcription of non-specific ligation of cDNA templates. As for other microarray technologies, probes designed for Affymetrix gene expression assay are biased towards the 3' end of the transcripts: the length of the target is therefore not a critical metric provided the targets cover the first 700 bases from the 3' end of the transcripts. However some probes (10% at most) represent sequences over 600 bases from the 3' end, and short amplification products may therefore not address these probes. The impact of this issue can be easily estimated by the 3'/5' ratios of housekeeping genes. Affymetrix HG U133 plus 2.0 GeneChips include probe sets selected in the 5' region of housekeeping genes in addition to conventional probes within a maximum of 600 nt from the 3' end. The signal intensity ratio of the 3' probe over the 5' probe (3'/5' ratio) is a good metric to evaluate the qualitative performance of first strand cDNA synthesis and aRNA transcription (or cDNA replication for Nugen WT-Amplification™). Abnormally high ratios were obtained when using T7-IVT-based amplification chemistries suggesting that the 3' biased expression issue should be taken into consideration when analysing these data. The lower 3'/5' ratios observed in the Nugen WT-Amplification™ approach could be explained by the fact that i) in addition to the conventional poly-T priming for the initial reverse transcription, the system proposed by Nugen also includes random priming, and ii) amplification is performed in one cycle thus avoiding shortening of targets at the 5' end by performing a random primed reverse transcription of first-round amplified aRNA.

The percentage of present call has been previously described as a good metric when evaluating the sensitivity of a method [30, 34]. Gene expression analysis performed on small amounts of input RNA, can be logically expected to give a reduced sensitivity. However, only Arcturus RiboAmp™ chemistry showed significantly reduced sensitivity compared to the standard procedure. Poor sensitivity was also observed when conducting experiments using Nugen WT-Amplification™ system using the lowest amounts of input RNA (50 pg and 100 pg), suggesting that the minimum input limits of the protocol had been reached.

With respect to hybridisation specificities, the Nugen technology shows a fundamental difference as it generates a single-stranded cDNA target whereas others protocols yields cRNA targets. As RNA/DNA interactions are stronger than DNA/DNA interactions, cDNA hybridisations should theoretically be more specific but also less sensitive. However, the protocol proposed by Nugen was not associated with decreased sensitivity and the lower average background value of the chips hybridised with cDNA targets (Nugen) suggests reduced non-specific target/background interactions but additional studies should be conducted to evaluate the potential increased specificity of the probe/target interaction and its biological impact on expression profiling.

Practical criteria should be considered to choose an amplification approach to carry out expression profiling experiments. These include completion time, handling difficulties and labour intensiveness. Major differences were observed between the various protocols evaluated in terms of these criteria. IVT-based amplifications (Ambion MessageAmp™, Arcturus RiboAmp™, and Epicentre TargetAmp™) involve numerous steps and are therefore time-consuming and labour-intensive. However, the high quality of technical support and optimisation of chemistries (most reagents are conveniently pre-dispensed and pre-mixed) simplify the handling of the Ambion and Arcturus systems. The Nugen technology is fundamentally different from the IVT-based amplifications. Fewer steps are needed to achieve amplification, and the process does not include delicate RNA handling during the amplification process. The Nugen WT-Amplification™ protocol is therefore shorter and easier to complete, and consequently less error-prone. Ultimately, investigators will need to compare experimental results obtained by different laboratories. Experimental variables (such as operator) on expression data could be limited if fewer steps are needed to achieve amplification.

When expression profiling experiments are performed on just a few cells, it is currently impossible to strictly assess the quality and quantity of the purified RNA. Even the most modern and accurate spectrophotometers or microfluidic-based electrophoresis chips require at least 100 pg of RNA to characterise nucleic acids extracted from such minute samples. The results presented here show that a two-fold variation of the amount of input RNA had almost no impact on the transcriptomes analysed when starting with picogram amounts of RNA. Moreover, high reproducibility within a given protocol (correlation coefficient of about 0.95) was observed for amplifications that were carried out in two different laboratories by two different operators. This shows that trained laboratories could conduct amplifications with the technologies proposed by Ambion, Arcturus, or Nugen and produce data that could effectively be compared across laboratories using the same amplification protocols. However, the results obtained in this study indicate large variations between different protocols. This suggests, as previously shown, that i) when conducting expression profiling experiments the same amplification protocol should be used in order to maximize the comparability of the results [26, 31, 33, 35, 36], and ii) that RNA amplification affects the expression measurements [35, 3739]. However, researchers who already have a large volume of Affymetrix two-round amplification data, and who want to conduct a project including comparison of these data, might decide to choose the Ambion MessageAmp™ amplification protocol despite its very high bias towards the 3' to 5' ends, as expression profiles estimated according to this protocol exhibited the best correlation with the results of Affymetrix amplification (correlation coefficient of 0.89).

Amplifications were performed by two operators in two different laboratories in order to mimic "real experimental conditions" of expression profiling. In our hands and under these experimental conditions, Nugen WT-Amplification™ pico protocol appeared the most suitable. Additional experiments were performed in order to further assess this system. Amplifications were performed on amounts of input RNA ranging from 50 pg to 1 ng to test the system at the upper and lower limits of input amounts corresponding to a few cells isolated by FACS or LCM. The results obtained show that the overall quality, comparability and reproducibility of expression measurements were very good for RNA input amounts ranging from 250 pg to 1000 pg. The system was less efficient with 100 pg and 50 pg of RNA inputs with respect to sensitivity and reproducibility. It is important to analyse this result in the light of manufacturer's specifications indicating that the minimal RNA input of the system is 500 pg.

The results of a differential gene expression experiment using Nugen WT-Amplification™ chemistry or Affymetrix one-round IVT amplification were also compared. If we strictly count the number of probesets with the same status (Decrease, Increase, Marginal Increase, Marginal Decrease or No Change) in both chimistries, discrepancies were observed only for 25% of probesets. However the direction of differential expression diverged in few measurements. These results show that most genes have similar differentially expressed patterns and that one amplification protocol does not create an artificial variability of the measurements compared to the other. The observed discrepancies do not appear to be due to the decreased sensitivity of one of the two protocols because the same proportion of genes was modulated when using the Affymetrix and Nugen protocols. Although the effects of RNA amplification on differential gene expression measurements have been previously reported [26, 35, 3739], a large proportion of these discrepancies might be due to fundamental differences between the two approaches, such as the influence of the molecular nature of the targets (RNA or DNA) on expression measurement, or the use of random priming to synthesise double-stranded cDNA templates.

The preservation of the relative abundance levels of gene transcripts is an important issue when performing RNA amplification prior to genome-wide expression measurements. This issue has been widely studied in comparing expression measurements i) from the amplification of different amounts of RNA [11, 21, 40], ii) from amplified and unamplified materials [14, 21, 41, 42], iii) using different amplification procedures [11, 15, 26, 43], iv) to a gold standard amplification procedure[26, 44], v) using different expression evaluation methods such as quantitative-reverse-transcription-Ploymerase-Chain-Reaction (qRT-PCR) [21, 26, 36, 43]. Most of these studies were performed using IVT-based amplification methods. Those methods were different from the ones evaluated in this report, and were not optimised for picogram amounts of input RNA. Only two studies were conducted using Nugen amplification technology but not the WT-Amplification™ pico system evaluated here [21, 26]. The general conclusion that could be drawn from these articles is that either IVT-based or Nugen-like RNA amplifications were globally able to maintain relative transcripts abundance with only slight differences. However, it has been pointed out that, in most of these reports, the statistical analyses or the comparison with qRT-PCR data were restricted only to subsets of genes such as outliers or highly expressed genes [31, 37, 38]. Furthermore, several studies have seriously questioned the preservation of the relative transcript abundance during RNA amplification. Sequence dependent biases [35, 37], and a drop of fidelity for low expressed transcripts [10, 39, 45, 46] have been demonstrated. In addition, it has been shown that low expressed genes were subject to stochastic fluctuations that increase as the sample size decreases [31, 38, 46]. However, we obtained high correlations between technical replicates using either Ambion, Arcturus or Nugen methods (Figure 3A). It shows that no or negligible stochastic fluctuations occur at these levels of input RNA (500 pg and 250 pg). On the other hand, stochastic event could explain the lower reproducibility observed for smaller amount of input RNA (50 pg and 100 pg) using Nugen method.

Therefore, a) we do not recommend to perform amplification from less than 250 pg of input RNA, and b) when it is possible, researchers should try to increase the RNA input quantity to at least 500 pg to be more confident in the biological interpretation of the results, particularly concerning low express transcripts.


In this study, we evaluated and compared four commercial RNA amplification protocols using picogram amounts of input RNA. An operational flow chart was designed to evaluate the effects of laboratory and operator intervariability on expression results. In our hands, the WT-Ovation™ pico system proposed by Nugen appears the most suitable for amplification and gene expression analysis. The amplification method proposed by Nugen is fast, easy to perform, and does not require several rounds of amplification or exponential PCR cycles. It provides a high quality expression profile that appears to allow identification of differentially expressed genes. Finally, the reproducibility of the results of amplification across laboratories and across amounts of RNA input indicates that this system is an efficient tool to conduct gene expression profiling experiments from LCM or cell-sorted isolated samples.


RNA preparation and assessment

RNA derived from SkBr3 and HCC38 cells was purified using the RNeasy Mini Kit (Qiagen) including on-column DNase (Qiagen) digestion as described by the manufacturer's protocol. The Universal Human Reference RNA (Stratagene) representing a pool of 10 different human cell lines was used as control RNA.

After nucleic acid quantification using a ND-1000 spectrophotometer (Nanodrop Technologies), all RNAs were serially diluted in RNAse-free water to obtain a 250 pg/μL stock solution. RNA quality was ensured by analysing separation trace of RNA using the RNA6000 PicoAssay for the Bioanalyzer 2100 (Agilent). Aliquots were prepared and stored at -80°C. The same RNA was used for all experiments as starting RNA for amplification. Each aliquot was used once.

When provided within the amplification kits, internal RNA controls were also used as starting material (MessageAmp™ II aRNA Amplification (Ambion), RiboAmp™ HS RNA Amplification Kit (Arcturus)).


All amplification experiments were carried out in duplicate by two trained operators in two different laboratories in order to assess the consistency and robustness of amplification and labelling protocols. Microarray hybridisations, quantitative and qualitative measurements were performed by the same experienced technician on the same instruments to ensure that expression level discrepancies were only due to amplification and labelling procedures.

Amplification and labelling of small RNA samples

RNA amplifications were performed using the following kits: One- and two-round amplification kit (Affymetrix), RiboAmp™ HS RNA Amplification Kit (Arcturus), MessageAmp™ II aRNA Amplification (Ambion), TargetAmp™ 2-Round Aminoallyl-aRNA Amplification (Epicentre), and WT-Amplification™ Pico (NuGEN). For all experiments, the manufacturers' protocols were strictly followed.

Briefly, the standard protocol described by Affymetrix amplifies and produces after a single round T7 amplification, more than 40 μg of labelled cRNA from 1–4 micrograms of total RNA. Total RNA is used for cDNA synthesis using an oligo-dT-T7 primer. The cDNA is used as template for double-strand DNA (dsDNA) synthesis and purification. Linear amplification and labelling of complementary RNA (cRNA) is performed by in-vitro transcription. When input RNA quantity is below standard requirements, a two-round amplification protocol is performed with 10–100 ng of total RNA. In this case, the first IVT does not use any labelled nucleotide to generate unlabelled cRNA. This cRNA is used for reverse transcription (RT) with random primers, dsDNA synthesis and finally labelled cRNA synthesis.

The MessageAmp™ II aRNA Amplification Kit (Ambion) is based on the RNA amplification protocol described by Eberwine et al. [6], and designed to generate sufficient material to hybridise an Affymetrix Genechip. The procedure to synthesise cRNA is similar to the Affymetrix two-round amplification and consists of RT with oligo(dT) primer bearing a T7 promoter followed by dsDNA and unlabelled cRNA synthesis. A second round of amplification is performed with random primers to generate DNA. The sense DNA then undergoes second strand synthesis and clean-up to become a template for the second in vitro transcription (IVT) using labelled nucleotides.

RiboAmp HS version C (Arcturus RiboAmp HS protocol) enables target synthesis from 100 pg to 500 ng. Version C of RiboAmp HS is composed of two-round amplification similar to the protocols proposed by Affymetrix or Ambion. Reactions were performed according to the manufacturer's protocol.

The TargetAmp 2-Round Aminoallyl-aRNA Amplification Kit 1.0 (Epicentre) is designed to be an improvement of the other linear T7 RNA amplification process described above to produce microgram amounts of aminoallyl-aRNA from as little as 10 pg of total RNA. Two rounds of amplification combine two generations of SuperScript Reverse Transcriptases from Invitrogen.

In contrast with other manufacturer protocols, the WT-Ovation™ Pico RNA Amplification System (Nugen) is not based on T7 polymerase cRNA synthesis. Nugen has designed a technique called Ribo-SPIA™, which is a three-step process that generates amplified cDNA from as little as 500 picograms of total RNA[21]. First strand cDNA is prepared from total RNA using a unique first strand DNA/RNA chimeric primer mix. The primers have a DNA portion that hybridises either to the 5' portion of the poly(A) sequence or randomly across the transcript. Reverse transcriptase extends the 3' DNA end of each primer generating first strand cDNA/mRNA hybrid. Second strand cDNA synthesis step generates double stranded products with RNA-DNA heteroduplex at one end. The third step is the DNA amplification, called SPIA™ amplification using a specific DNA/RNA chimeric primer, DNA polymerase and RNase H in a homogeneous isothermal assay that provides highly efficient amplification of DNA sequences. RNase H is used to degrade RNA in the DNA/RNA heteroduplex at the 5' end of the first cDNA strand. This results in the exposure of a DNA sequence that is available for binding a second SPIA™ DNA/RNA chimeric primer. DNA polymerase then initiates replication at the 3' end of the primer, displacing the existing forward strand. The RNA portion at the 5' end of the newly synthesised strand is again removed by RNase H, exposing part of the unique priming site for initiation of the next round of cDNA synthesis. The process of SPIA™ DNA/RNA primer binding, DNA replication, strand displacement and RNA cleavage is repeated, resulting in rapid accumulation of cDNA with a sequence complementary to the original mRNA.

The labeled cRNA targets are synthesised using the genechip IVT labelling kit (Affymetrix) from dsDNA obtained with Affymetrix and Arcturus protocols. TargetAmp amplification products (Epicentre protocol) are labelled using the Biotin-X-X-NHS kit (Epicentre). WT-Ovation™ Pico products (NuGEN) are labelled using the FL-Ovation™ cDNA Biotin Module V2 (NuGEN). Each labeled cRNA targets are synthesised according to manufacturer's protocols.

Amplification products quantification and quality control

The quantity and quality of the amplified cRNA or cDNA were assessed by a ND-1000 spectrophotometer (Nanodrop Technologies), Agilent Bioanalyzer and RNA 6000 nanoChips (Agilent Technologies, Santa Clara, CA), respectively.

Microarray hybridisation

Hybridisation mixtures were prepared according to Affymetrix procedures to accommodate 10–20 μg of labelled cRNA targets from Affymetrix, Arcturus, Ambion and Epicentre amplifications, or 5 μg of cDNA targets from NuGEN amplification. If less than 10 μg of cRNA or 5 μg of cDNA targets were generated, the entire quantity of material was used as input. Human Genome U133 Plus 2.0 GeneChips (Affymetrix) were hybridised, revealed and washed according to the Affymetrix protocol. GeneChips were scanned using a 7 G scanner (Affymetrix) and images (DAT files) were converted to CEL files using GCOS software (Affymetrix). All of the microarray raw data have been deposited in the Gene Expression Omnibus under the accession number GSE15398

Data Analysis

Data analysis was performed using expression console V 1.1 (Affymetrix) and genome analysis tools (Partek). Differential gene expression analysis was performed using GCOS software (Affymetrix).


  1. Duggan DJ, Bittner M, Chen Y, Meltzer P, Trent JM: Expression profiling using cDNA microarrays. Nat Genet. 1999, 21: 10-14. 10.1038/4434.

    Article  CAS  PubMed  Google Scholar 

  2. Ibrahim SF, Engh van den G: Flow cytometry and cell sorting. Adv Biochem Eng Biotechnol. 2007, 106: 19-39.

    CAS  PubMed  Google Scholar 

  3. Emmert-Buck MR, Bonner RF, Smith PD, Chuaqui RF, Zhuang Z, Goldstein SR, Weiss RA, Liotta LA: Laser capture microdissection. Science. 1996, 274: 998-1001. 10.1126/science.274.5289.998.

    Article  CAS  PubMed  Google Scholar 

  4. Bonner RF, Emmert-Buck M, Cole K, Pohida T, Chuaqui R, Goldstein S, Liotta LA: Laser capture microdissection: molecular analysis of tissue. Science. 1997, 278: 1481-1483. 10.1126/science.278.5342.1481.

    Article  CAS  PubMed  Google Scholar 

  5. Suarez-Quian CA, Goldstein SR, Pohida T, Smith PD, Peterson JI, Wellner E, Ghany M, Bonner RF: Laser capture microdissection of single cells from complex tissues. Biotechniques. 1999, 26: 328-335.

    CAS  PubMed  Google Scholar 

  6. Eberwine J, Yeh H, Miyashiro K, Cao Y, Nair S, Finnell R, Zettel M, Coleman P: Analysis of gene expression in single live neurons. Proc Natl Acad Sci USA. 1992, 89: 3010-3014. 10.1073/pnas.89.7.3010.

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  7. Van Gelder RN, von Zastrow ME, Yool A, Dement WC, Barchas JD, Eberwine JH: Amplified RNA synthesized from limited quantities of heterogeneous cDNA. Proc Natl Acad Sci USA. 1990, 87: 1663-1667. 10.1073/pnas.87.5.1663.

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  8. Phillips J, Eberwine JH: Antisense RNA Amplification: A Linear Amplification Method for Analyzing the mRNA Population from Single Living Cells. Methods. 1996, 10: 283-288. 10.1006/meth.1996.0104.

    Article  CAS  PubMed  Google Scholar 

  9. McClintick JN, Jerome RE, Nicholson CR, Crabb DW, Edenberg HJ: Reproducibility of oligonucleotide arrays using small samples. BMC Genomics. 2003, 4: 4-10.1186/1471-2164-4-4.

    Article  PubMed Central  PubMed  Google Scholar 

  10. Luzzi V, Holtschlag V, Watson MA: Expression profiling of ductal carcinoma in situ by laser capture microdissection and high-density oligonucleotide arrays. Am J Pathol. 2001, 158: 2005-2010.

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  11. Baugh LR, Hill AA, Brown EL, Hunter CP: Quantitative analysis of mRNA amplification by in vitro transcription. Nucleic Acids Res. 2001, 29: E29-10.1093/nar/29.5.e29.

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  12. Scherer A, Krause A, Walker JR, Sutton SE, Seron D, Raulf F, Cooke MP: Optimized protocol for linear RNA amplification and application to gene expression profiling of human renal biopsies. Biotechniques. 2003, 34: 546-550.

    CAS  PubMed  Google Scholar 

  13. Ohyama H, Zhang X, Kohno Y, Alevizos I, Posner M, Wong DT, Todd R: Laser capture microdissection-generated target sample for high-density oligonucleotide array hybridisation. Biotechniques. 2000, 29: 530-536.

    CAS  PubMed  Google Scholar 

  14. Zhao H, Hastie T, Whitfield ML, Borresen-Dale AL, Jeffrey SS: Optimization and evaluation of T7 based RNA linear amplification protocols for cDNA microarray analysis. BMC Genomics. 2002, 3: 31-10.1186/1471-2164-3-31.

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  15. Klur S, Toy K, Williams MP, Certa U: Evaluation of procedures for amplification of small-size samples for hybridisation on microarrays. Genomics. 2004, 83: 508-517. 10.1016/j.ygeno.2003.09.005.

    Article  CAS  PubMed  Google Scholar 

  16. Mahadevappa M, Warrington JA: A high-density probe array sample preparation method using 10- to 100-fold fewer cells. Nat Biotechnol. 1999, 17: 1134-1136. 10.1038/15124.

    Article  CAS  PubMed  Google Scholar 

  17. Kube DM, Savci-Heijink CD, Lamblin AF, Kosari F, Vasmatzis G, Cheville JC, Connelly DP, Klee GG: Optimization of laser capture microdissection and RNA amplification for gene expression profiling of prostate cancer. BMC Mol Biol. 2007, 8: 25-10.1186/1471-2199-8-25.

    Article  PubMed Central  PubMed  Google Scholar 

  18. Rudnicki M, Eder S, Perco P, Enrich J, Scheiber K, Koppelstatter C, Schratzberger G, Mayer B, Oberbauer R, Meyer TW, Mayer G: Gene expression profiles of human proximal tubular epithelial cells in proteinuric nephropathies. Kidney Int. 2007, 71: 325-335. 10.1038/

    Article  CAS  PubMed  Google Scholar 

  19. Diboun I, Wernisch L, Orengo CA, Koltzenburg M: Microarray analysis after RNA amplification can detect pronounced differences in gene expression using limma. BMC Genomics. 2006, 7: 252-10.1186/1471-2164-7-252.

    Article  PubMed Central  PubMed  Google Scholar 

  20. Ding Y, Xu L, Chen S, Jovanovic BD, Helenowski IB, Kelly DL, Catalona WJ, Yang XJ, Pins M, Ananthanarayanan V, Bergan RC: Characterization of a method for profiling gene expression in cells recovered from intact human prostate tissue using RNA linear amplification. Prostate Cancer Prostatic Dis. 2006, 9: 379-391. 10.1038/sj.pcan.4500888.

    Article  CAS  PubMed  Google Scholar 

  21. Kurn N, Chen P, Heath JD, Kopf-Sill A, Stephens KM, Wang S: Novel isothermal, linear nucleic acid amplification systems for highly multiplexed applications. Clin Chem. 2005, 51: 1973-1981. 10.1373/clinchem.2005.053694.

    Article  CAS  PubMed  Google Scholar 

  22. Tanney A, Oliver GR, Farztdinov V, Kennedy RD, Mulligan JM, Fulton CE, Farragher SM, Field JK, Johnston PG, Harkin DP, et al: Generation of a non-small cell lung cancer transcriptome microarray. BMC Med Genomics. 2008, 1: 20-10.1186/1755-8794-1-20.

    Article  PubMed Central  PubMed  Google Scholar 

  23. Ouillette P, Erba H, Kujawski L, Kaminski M, Shedden K, Malek SN: Integrated genomic profiling of chronic lymphocytic leukemia identifies subtypes of deletion 13q14. Cancer Res. 2008, 68: 1012-1021. 10.1158/0008-5472.CAN-07-3105.

    Article  CAS  PubMed  Google Scholar 

  24. Watson JD, Wang S, Von Stetina SE, Spencer WC, Levy S, Dexheimer PJ, Kurn N, Heath JD, Miller DM: Complementary RNA amplification methods enhance microarray identification of transcripts expressed in the C. elegans nervous system. BMC Genomics. 2008, 9: 84-10.1186/1471-2164-9-84.

    Article  PubMed Central  PubMed  Google Scholar 

  25. Lovatt D, Sonnewald U, Waagepetersen HS, Schousboe A, He W, Lin JH, Han X, Takano T, Wang S, Sim FJ, et al: The transcriptome and metabolic gene signature of protoplasmic astrocytes in the adult murine cortex. J Neurosci. 2007, 27: 12255-12266. 10.1523/JNEUROSCI.3404-07.2007.

    Article  CAS  PubMed  Google Scholar 

  26. Viale A, Li J, Tiesman J, Hester S, Massimi A, Griffin C, Grills G, Khitrov G, Lilley K, Knudtson K, et al: Big results from small samples: evaluation of amplification protocols for gene expression profiling. J Biomol Tech. 2007, 18: 150-161.

    PubMed Central  PubMed  Google Scholar 

  27. Sherwood RI, Jitianu C, Cleaver O, Shaywitz DA, Lamenzo JO, Chen AE, Golub TR, Melton DA: Prospective isolation and global gene expression analysis of definitive and visceral endoderm. Dev Biol. 2007, 304: 541-555. 10.1016/j.ydbio.2007.01.011.

    Article  CAS  PubMed  Google Scholar 

  28. Keller MA, Addya S, Vadigepalli R, Banini B, Delgrosso K, Huang H, Surrey S: Transcriptional regulatory network analysis of developing human erythroid progenitors reveals patterns of coregulation and potential transcriptional regulators. Physiol Genomics. 2006, 28: 114-128. 10.1152/physiolgenomics.00055.2006.

    Article  CAS  PubMed  Google Scholar 

  29. Chung CH, Parker JS, Ely K, Carter J, Yi Y, Murphy BA, Ang KK, El-Naggar AK, Zanation AM, Cmelak AJ, et al: Gene expression profiles identify epithelial-to-mesenchymal transition and activation of nuclear factor-kappaB signaling as characteristics of a high-risk head and neck squamous cell carcinoma. Cancer Res. 2006, 66: 8210-8218. 10.1158/0008-5472.CAN-06-1213.

    Article  CAS  PubMed  Google Scholar 

  30. Bak M, Conley L, Hedegaard J, Larsen LA, Sorensen P, Bendixen C, Tommerup N: Evaluation of two methods for generating cRNA for microarray experiments from nanogram amounts of total RNA. Anal Biochem. 2006, 358: 111-119. 10.1016/j.ab.2006.08.023.

    Article  CAS  PubMed  Google Scholar 

  31. Nygaard V, Hovig E: Options available for profiling small samples: a review of sample amplification technology when combined with microarray profiling. Nucleic Acids Res. 2006, 34: 996-1014. 10.1093/nar/gkj499.

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  32. Singh R, Maganti RJ, Jabba SV, Wang M, Deng G, Heath JD, Kurn N, Wangemann P: Microarray-based comparison of three amplification methods for nanogram amounts of total RNA. Am J Physiol Cell Physiol. 2005, 288: C1179-1189. 10.1152/ajpcell.00258.2004.

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  33. Wang J, Hu L, Hamilton SR, Coombes KR, Zhang W: RNA amplification strategies for cDNA microarray experiments. Biotechniques. 2003, 34: 394-400.

    PubMed  Google Scholar 

  34. Cole K, Truong V, Barone D, McGall G: Direct labeling of RNA with multiple biotins allows sensitive expression profiling of acute leukemia class predictor genes. Nucleic Acids Res. 2004, 32: e86-10.1093/nar/gnh085.

    Article  PubMed Central  PubMed  Google Scholar 

  35. van Haaften RI, Schroen B, Janssen BJ, van Erk A, Debets JJ, Smeets HJ, Smits JF, Wijngaard van den A, Pinto YM, Evelo CT: Biologically relevant effects of mRNA amplification on gene expression profiles. BMC Bioinformatics. 2006, 7: 200-10.1186/1471-2105-7-200.

    Article  PubMed Central  PubMed  Google Scholar 

  36. Goff LA, Bowers J, Schwalm J, Howerton K, Getts RC, Hart RP: Evaluation of sense-strand mRNA amplification by comparative quantitative PCR. BMC Genomics. 2004, 5: 76-10.1186/1471-2164-5-76.

    Article  PubMed Central  PubMed  Google Scholar 

  37. Degrelle SA, Hennequet-Antier C, Chiapello H, Piot-Kaminski K, Piumi F, Robin S, Renard JP, Hue I: Amplification biases: possible differences among deviating gene expressions. BMC Genomics. 2008, 9: 46-10.1186/1471-2164-9-46.

    Article  PubMed Central  PubMed  Google Scholar 

  38. Nygaard V, Holden M, Loland A, Langaas M, Myklebost O, Hovig E: Limitations of mRNA amplification from small-size cell samples. BMC Genomics. 2005, 6: 147-10.1186/1471-2164-6-147.

    Article  PubMed Central  PubMed  Google Scholar 

  39. Nygaard V, Loland A, Holden M, Langaas M, Rue H, Liu F, Myklebost O, Fodstad O, Hovig E, Smith-Sorensen B: Effects of mRNA amplification on gene expression ratios in cDNA experiments estimated by analysis of variance. BMC Genomics. 2003, 4: 11-10.1186/1471-2164-4-11.

    Article  PubMed Central  PubMed  Google Scholar 

  40. Li L, Roden J, Shapiro BE, Wold BJ, Bhatia S, Forman SJ, Bhatia R: Reproducibility, fidelity, and discriminant validity of mRNA amplification for microarray analysis from primary hematopoietic cells. J Mol Diagn. 2005, 7: 48-56.

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  41. Rudnicki M, Eder S, Schratzberger G, Mayer B, Meyer TW, Tonko M, Mayer G: Reliability of t7-based mRNA linear amplification validated by gene expression analysis of human kidney cells using cDNA microarrays. Nephron Exp Nephrol. 2004, 97: e86-95. 10.1159/000078642.

    Article  CAS  PubMed  Google Scholar 

  42. Scheidl SJ, Nilsson S, Kalen M, Hellstrom M, Takemoto M, Hakansson J, Lindahl P: mRNA expression profiling of laser microbeam microdissected cells from slender embryonic structures. Am J Pathol. 2002, 160: 801-813.

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  43. Gold D, Coombes K, Medhane D, Ramaswamy A, Ju Z, Strong L, Koo JS, Kapoor M: A comparative analysis of data generated using two different target preparation methods for hybridisation to high-density oligonucleotide microarrays. BMC Genomics. 2004, 5: 2-10.1186/1471-2164-5-2.

    Article  PubMed Central  PubMed  Google Scholar 

  44. Patel OV, Suchyta SP, Sipkovsky SS, Yao J, Ireland JJ, Coussens PM, Smith GW: Validation and application of a high fidelity mRNA linear amplification procedure for profiling gene expression. Vet Immunol Immunopathol. 2005, 105: 331-342. 10.1016/j.vetimm.2005.02.018.

    Article  CAS  PubMed  Google Scholar 

  45. Goley EM, Anderson SJ, Menard C, Chuang E, Lu X, Tofilon PJ, Camphausen K: Microarray analysis in clinical oncology: pre-clinical optimization using needle core biopsies from xenograft tumors. BMC Cancer. 2004, 4: 20-10.1186/1471-2407-4-20.

    Article  PubMed Central  PubMed  Google Scholar 

  46. Schlingemann J, Thuerigen O, Ittrich C, Toedt G, Kramer H, Hahn M, Lichter P: Effective transcriptome amplification for expression profiling on sense-oriented oligonucleotide microarrays. Nucleic Acids Res. 2005, 33: e29-10.1093/nar/gni029.

    Article  PubMed Central  PubMed  Google Scholar 

Download references


This work was supported by the Institut Curie, CNRS, INSERM, by the European Union under the auspices of the FP7 collaborative project TuMIC, contract no. HEALTH-F2-2008-201662, to CD and DG and by grants from FRM, ANR MRare (HirGenet) and E-Rare (HSCR) to MCZ, CB and SL. The authors would like to thank T. Dubois and colleagues for preparing the cell lines.

Author information

Authors and Affiliations


Corresponding author

Correspondence to Charles Decraene.

Additional information

Authors' contributions

MCZ, CB and CD designed the study. MCZ and DG performed the experiments. MCZ, DG and CD performed the data analysis. MCZ, DG and CD drafted the manuscript. CB, JPT, SL and CD supervised the study. All authors read and approved the final manuscript.

Authors’ original submitted files for images

Rights and permissions

Open Access This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution License ( ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Clément-Ziza, M., Gentien, D., Lyonnet, S. et al. Evaluation of methods for amplification of picogram amounts of total RNA for whole genome expression profiling. BMC Genomics 10, 246 (2009).

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: