Evaluation of high throughput gene expression platforms using a genomic biomarker signature for prediction of skin sensitization
© Forreryd et al.; licensee BioMed Central Ltd. 2014
Received: 7 January 2014
Accepted: 2 May 2014
Published: 16 May 2014
Allergic contact dermatitis (ACD) develops upon exposure to certain chemical compounds termed skin sensitizers. To reduce the occurrence of skin sensitizers, chemicals are regularly screened for their capacity to induce sensitization. The recently developed Genomic Allergen Rapid Detection (GARD) assay is an in vitro alternative to animal testing for identification of skin sensitizers, classifying chemicals by evaluating transcriptional levels of a genomic biomarker signature. During assay development and biomarker identification, genome-wide expression analysis was applied using microarrays covering approximately 30,000 transcripts. However, the microarray platform suffers from drawbacks in terms of low sample throughput, high cost per sample and time consuming protocols and is a limiting factor for adaption of GARD into a routine assay for screening of potential sensitizers. With the purpose to simplify assay procedures, improve technical parameters and increase sample throughput, we assessed the performance of three high throughput gene expression platforms - nCounter®, BioMark HD™ and OpenArray® - and correlated their performance metrics against our previously generated microarray data. We measured the levels of 30 transcripts from the GARD biomarker signature across 48 samples. Detection sensitivity, reproducibility, correlations and overall structure of gene expression measurements were compared across platforms.
Gene expression data from all of the evaluated platforms could be used to classify most of the sensitizers from non-sensitizers in the GARD assay. Results also showed high data quality and acceptable reproducibility for all platforms but only medium to poor correlations of expression measurements across platforms. In addition, evaluated platforms were superior to the microarray platform in terms of cost efficiency, simplicity of protocols and sample throughput.
We evaluated the performance of three non-array based platforms using a limited set of transcripts from the GARD biomarker signature. We demonstrated that it was possible to achieve acceptable discriminatory power in terms of separation between sensitizers and non-sensitizers in the GARD assay while reducing assay costs, simplify assay procedures and increase sample throughput by using an alternative platform, providing a first step towards the goal to prepare GARD for formal validation and adaption of the assay for industrial screening of potential sensitizers.
KeywordsGenomic biomarker signature GARD Microarrays nCounter® BioMark HD™ OpenArray®
Allergic contact dermatitis (ACD) is characterized by redness of the skin, accompanied by periodic and recurrent episodes of itching . The disease is a type IV delayed type hypersensitivity reaction initiated and mediated by cytotoxic CD8+ T cells and CD4+ Th1 cells  and develops upon repeated or prolonged exposure to contact allergens . With a prevalence of 15-20% [4, 5], ACD has rapidly become a major occupational and environmental health problem [6, 7]. ACD is a chronic condition and the recommendation to affected individuals is complete avoidance of inducing contact allergen .
Contact allergens capable of inducing ACD are termed skin sensitizers. An important group of skin sensitizers are chemical compounds present in common household products such as cosmetics and personal care products. To limit and control the use of sensitizers in such products, chemicals are regularly screened for their capacity to induce sensitization. Historically, such assays have relied exclusively on animal experimentation, with the murine local lymph node assay (LLNA)  being the preferred method. However, as of March 2013, an EU legislation  imposed a ban on the use of animals for safety assessment of cosmetic products, regardless of the availability of non-animal test as an alternative to animal testing. Thus, the demand for alternative in vitro methods for prediction of chemical sensitization is urgent.
Recently, we developed the Genomic Allergen Rapid Detection (GARD) assay, a novel alternative to animal testing for identification and risk assessment of human skin sensitizing chemicals using a predictive genomic biomarker signature termed the GARD prediction signature (GPS) . The GPS was established using a panel of reference chemicals comprising 18 well known sensitizers and 20 non-sensitizers. By stimulating the myeloid cell line MUTZ-3 with the panel of reference chemicals, we were able to identify the 200 most potent discriminatory transcripts between non-sensitizers and sensitizers. The information given by differentially expressed transcripts in the GPS was used to train a support vector machine model (SVM) . Subsequently, the SVM model is used for classification of unknown chemical compounds as either sensitizers or non-sensitizers.
The technical format currently used for transcriptional analysis in the GARD assay is Affymetrix® whole-transcriptome microarrays. The array platform has been valuable during assay development to identify differentially regulated genes in the GPS from the entire transcriptome, yet it suffers from drawbacks in terms of low sample throughput, high cost per sample and time consuming protocols. Furthermore, the microarray platform has known limitations in terms of sensitivity, reproducibility and dynamic range [12–15]. For an in vitro method to be used for regulatory purposes and eventually for industrial screening of sensitizers, it needs to be validated according to internationally recognized procedures . With the purpose to prepare GARD for formal validation under the supervision of The European Union Reference Laboratory for alternatives to animal testing (EURL ECVAM), and in order to simplify assay procedures, improve technical parameters and increase sample throughput, the GARD assay would benefit from a technical platform transfer. The number of available technologies for high throughput quantitative transcriptome analysis is steadily increasing, but only a handful of comparisons between gene expressions measurements on various platforms exist. Thus, there is a need to evaluate and compare results obtained from the various technologies to assess reliability and biological significance of measurements. We performed a systematic head to head comparison to assess the performance of three of the most prominent high throughput gene expression platforms, including the nCounter® analysis system (NanoString® technologies) , BioMark HD™ system (Fluidigm® corporation)  and the OpenArray® system (Life Technologies™) . The nCounter® analysis system is a novel hybridization based technology enabling gene expression measurements to be performed directly from cell lysate. The technology use transcript specific color coded molecular probe pairs to capture and count individual transcripts and has several advantages in comparison to microarray platform including easy protocols, less hands-on time and higher sample throughput . BioMark HD™ and OpenArray® are RT-qPCR based technologies which is considered as the gold standard for quantitative transcription analysis due to its high sensitivity, high reproducibility and large dynamic range [19–21]. RT-qPCR is however a low throughput technology in its conventional format. Utilizing slightly different strategies, both BioMark HD™ and the OpenArray® system provides technologies that aims to conserve the intrinsic analytical benefits of the conventional RT-qPCR while enabling gene expression measurement in a high throughput format . Both systems use streamlined protocols that enable progression from cDNA into results in less than three hours for the OpenArray® system and less than seven hours for the BioMark HD™ system. In this report, we present a per application relevant comparison and evaluation of the nCounter®, BioMark HD™ and the OpenArray® platforms in the context of the GARD assay. This report is not intended to serve as a general recommendation of a particular platform, but rather to investigate the trade-offs in terms of price, throughput, protocols, analytical performance and applicability of a selection of high throughput platforms for the GARD assay. Primary focuses were to compare non-technical parameters such as sample throughput, price per sample and simplicity of protocols between the platforms as well as to evaluate the more technical parameters in terms of precision and data consistency within each platform, to assess inter-platform consistency, and to determine if transcriptional analysis performed on the evaluated platforms could be applied to the GARD model to classify sensitizers from non-sensitizers. In conclusion, we found that it was possible to achieve acceptable detection sensitivity, reproducibility and discriminatory power of the GARD assay while at the same time simplify assay procedures and reduce assay cost when using any of the suggested high-throughput platforms evaluated in this study.
Biological model for evaluation of high throughput platforms and phenotypic analysis of unstimulated MUTZ-3 cells
Phenotype of MUTZ-3 cells
Cell surface marker
% positive cells
Inducible up-regulation of CD86 cell surface marker in response to stimulation of MUTZ-3 with skin sensitizers
List of chemical compounds used during evaluation of platforms
Potency according to LLNA
GARD input concentration (μM)
Transcriptional profiling of MUTZ-3 using high throughput gene expression platforms
List of transcripts used during evaluation of platforms
Entrez gene ID
DELTAGene™ assay ID
NanoString® probe ID
Life technologies™ assay ID
Comparison of platforms
300 ng total RNA/sample
200 ng total RNA/sample
125 ng cDNA/sample
120 ng cDNA/sample
Time for analysis
~4 days from RNA to results
22 h from RNA to results with a hands on time of 15 minutes.
7 h from cDNA to results with a hands on time of ~ 4 h
3 h from cDNA to results with a hands on time of 20 minutes.
Preprocessing of data
Gene expression data obtained on evaluated platforms were normalized prior to any analysis as described in Methods. Due to issues with a batch of samples during RNA preparation, one of the replicates from the following chemical stimulations had to be removed from analysis on all platforms: p-phenylendiamine, geraniol, eugenol and 1-butanol. In addition, one of the replicates from the following chemical stimulations had to be removed from analysis on nCounter® platform due to platform specific issues: 2-aminophenol and water. Total dataset analyzed on nCounter® consisted of 42 samples. In addition to the samples removed due to issues during RNA preparation, one of the replicates from the following chemical stimulations had to be removed from analysis on BioMark HD™ and OpenArray® platforms due to insufficient amounts of cDNA: propylene glycol, methyl salicylate, geraniol and dimethyl sulfoxide. Total dataset analyzed on BioMark HD™ and OpenArray® consisted of 40 samples. All stimulations except geraniol was present in at least biological duplicates. For chemical stimulations consisting of two replicates, averaged values were calculated from duplicate reactions instead of on triplicate as applied to remaining stimulations. The total number of sample shared between all platforms comprised 38 samples.
Comparison of the number of detected genes in the 38 samples shared between all platforms
Intra-platform reproducibility and data consistency
Comparison of transcriptional profiles from different platforms as predictive models for skin sensitization
The GARD assay was recently developed as an in vitro alternative to animal testing for identification and classification of skin sensitizers. The assay classifies chemicals as either skin sensitizers or non-sensitizers with high accuracy, sensitivity and specificity, using a genomic biomarker signature in the myeloid cell line MUTZ-3. The MUTZ-3 cell line is ideal for assay development as they resemble dendritic cells (DCs) which are important modulators of immune reactions in response to foreign substances . The use of a cell line in the GARD assay ensures a constant supply of cells and enables a large number of cells to be grown via standardized protocols in short time, allowing for a capability to scale up the format of the assay. We believe that the testing strategy behind the GARD assay has potential to replace animal experimentation for classification of chemicals, but that the technical platform currently used for transcriptome analysis, the microarray platform, is a limiting factor for adaption of GARD into a routine assay for analysis and screening of potential sensitizers. To improve GARD and place the assay in a better position for formal validation following an established assessment procedure with the ultimate aims to simplify assay procedures, improve technical parameters and increase sample throughput, we assessed the performance of three high throughput platforms for gene expression measurements and correlated their performance metrics against our previously generated microarray data . We measured the levels of 30 representative genes from the GPS across 48 samples on all platforms. Samples comprised 16 chemical stimulations in biological triplicate reactions and included both sensitizers and non-sensitizers. To achieve a comprehensive evaluation, we applied an experimental design allowing us to perform measurements on all platforms from the same chemical stimulation and a single RNA preparation. Thus, only platform-specific protocols downstream from RNA isolation discriminated between measurements on the different platforms.
The key findings from the current study are threefold. Firstly, good intra-platform reproducibility of gene expression data for all platforms was observed. Secondly, all evaluated platforms displayed modest to low correlation of gene expression measurements compared to Affymetrix® microarray data. Thirdly, all platforms were able to discriminate most of the extreme and moderate skin sensitizers from non-sensitizers when gene expression data obtained from the various platforms were subjected to PCA analysis.
High intra-platform reproducibility of gene expression measurements was considered a key criterion during the evaluation of platforms. High reproducibility might reduce number of replicates needed for measurements, affecting experimental design, sample throughput and eventually also costs. Considering that evaluated platforms not only use different technology for gene expression measurements but also different protocols for preparation of samples prior to final quantification, we chose to calculate precision based on biological replicate measurements where replicates for each stimulation was prepared individually for analysis according to protocols for a certain platform. Thus, the estimated precision included both technical variations during final measurements as well as variations possibly introduced during sample preparation prior to quantification. The present study demonstrates high intra-platform precision for all platforms. The majority of replicate CV median measurements for nCounter®, BioMark HD™ and OpenArray® were in the range between 5-15% which was slightly higher than the CV values observed on the Affymetrix® platform. In contrast to the CV values observed on the Affymetrix® platform, the distribution of replicate CV values varies between stimulations on evaluated platforms. The distribution of replicate CV values for a certain stimulation is however comparable across the evaluated platforms. Considering that a single stimulation was prepared for analysis on nCounter®, BioMark HD™ and OpenArray®, while Affymetrix® data was based on previously generated data it is likely that the higher CV values observed for the evaluated platforms in comparison to Affymetrix® originate from sample preparation and not from the quantification itself. In addition, evaluated genes were chosen by a data-driven approach, using the Affymetrix® data as an exploratory data set. Thus, the very low CV values observed for Affymetrix® data might be explained by a selection bias. The multiple steps included in sample preparation (RNA to cDNA preparation, data acquisition, normalization of data) are all possible steps for introduction of variations. The nCounter® system has the simplest protocol since measurements can be performed directly on RNA samples and in a single reaction. The OpenArray® system requires reverse transcription, but most steps in the analysis is fully automated using a mechanic liquid handler. Finally, the BioMark HD™ system requires both reverse transcription, pre-amplification and several steps of technical pipetting. However, these differences did not seem to affect the reproducibility of the measurement to any large extent as indicated by the similarity in CV values across platforms.
In contrast to reproducibility measurements, we also reported differences in the number of transcripts that could be detected on each of the evaluated platforms. Reasons for not detecting a transcript can be explained by a bad probe for the specific gene or insufficient sample target concentration. Since high frequencies of undetected genes correlated well with low levels of expression, we suggest that the major contribution in this study was due to transcript levels under the limit of detection for the specific platform. Results indicate superior sensitivity of the BioMark HD™ platform in comparison to both nCounter® and OpenArray®. The increased detection sensitivity may be linked to the additional cDNA pre-amplification step implemented prior to RT-qPCR on BioMark HD™. In contrast, the nCounter® platform does not involve any target amplification and the OpenArray® technology involves amplification only during the RT-qPCR reaction when using standard protocols. An unexpected observation was also that the performance of the reference transcripts were different between the platforms (data not shown). While both GAPDH and HPRT1 performed equally well on nCounter®, only GAPDH performed satisfactory on the BioMark HD™ and the OpenArray® platforms suggesting that care must be taken in selecting appropriate reference genes.
Equally important as reproducibility was to achieve consistency of gene expression measurements across platforms. This would provide a possibility to directly compare new measurements to previous data and to use SVM model trained on historical microarray data for classification of new samples measured on alternative platforms. However, the cross-platform comparison of log2 fold change measurement indicates modest to poor correlation between gene expressions data measured on the different platforms. We suggest that the major contributions to poor correlations are attributable to either platform specific differences in protocols, data processing or differences inherent to each technology. Contributing factors may include slight differences in probe sequences, small differences in the location of probes or primers and the lack of industrial standards across different technologies. Since the selection of primers and probes in this study was based on probe annotations, slight differences in the location of probes or primers on the target sequence might result in the detection of different types of splice variants on the different technologies. Previous experiments have shown that it is possible to achieve improved correlations across platforms using probes matched at exon levels . Other groups have also stated that differences in probes across microarray platforms can be a major cause of discordance [26, 27]. We do not have full access to the complete primer and probe sequences for all platforms preventing us from investigating the actual contribution of this factor in this experiment. We feel that the low concordance of gene expression measurements between evaluated platforms and to Affymetrix® microarray data will prevent a direct comparison of previously generated microarray data to new measurements on an alternative platform in this type of application.
Finally, we evaluated the overall structure and similarities of gene expression measurements from the various platforms in order to investigate if data from evaluated platforms contained enough biological information to distinguish sensitizers from non-sensitizers in PCA analysis. All platforms were able to distinguish strong sensitizers as well as several of the moderate sensitizers from the non-sensitizers. However, information contained in the gene expression data were not sufficient to distinguish weak sensitizers from non-sensitizers on any of the evaluated platforms. Previous work has reported variations in transcriptional profiles related to the relative potency of stimulating agent , indicating a smaller variation between weak sensitizers and non-sensitizers in comparison to strong and moderate sensitizers. Although significant efforts were made in order to select target genes with highest discriminatory power between sensitizers and non-sensitizers in this study, the inability to accurately classify weak sensitizers on the evaluated platforms could potentially be an artifact generated by the smaller number of genes included in this study (n =28) in comparison to the complete GARD signature (n = 200). Therefore, we filtered the Affymetrix® data set to include the same genes as analyzed by evaluated platforms. Results indicate that the genes selected for this study contains sufficient information to distinguish also the weak sensitizers as the Affymetrix® data illustrated a more obvious separation between weak sensitizers and non-sensitizers in comparison to evaluated platforms (Figure 5). Considering that the GARD signature was initially selected based on Affymetrix® microarray data and the poor correlations observed between Affymetrix® and evaluated platforms, we suggested that a reasonable explanation to why evaluated platforms were not able to completely distinguish all sensitizers from all non-sensitizers derives from differences in technology between platforms, i.e., the same factors that contributed to the poor correlation between platforms as discussed above. In support of this argument, the PCA plot constructed from data measured on the hybridization based nCounter® platform shows most similarities to the PCA plot constructed from Affymetrix® data. Alternatively, the observed differentiation between weak sensitizers and non-sensitizers in the Affymetrix® data may also be due to a selection bias, as the Affymetrix® data is the historical data set used to identify the genomic predictors. Therefore, we cannot exclude the possibility that including a larger set of genes from the GPS to be analyzed on the evaluated platforms might provide more information relevant for the separation also of weak sensitizer as a larger set of genes would allow for a data driven approach to select for better predictors also on evaluated platforms. In addition, we observed that the separation of sensitizers were seen along the second principal component in PCA plots for gene expression data from the BioMark HD™ and OpenArray® data instead of along the first principal component as seen with Affymetrix® and nCounter® data. The observed separation along the second principal component indicates that much of the variation in the datasets may be attributable to systematic artifacts from the technologies and not from the transcriptional variations. This has previously been shown for other high-throughput technologies as reviewed by .
Other important parameters to consider are price per assay, simplicity of protocols, time to results and sample throughput. These parameters had to be balanced in relation to the technical parameters in order to select a suitable platform for GARD. In comparison to the Affymetrix® platform, evaluated platforms enable higher sample throughput, having shorter turnaround time for results and provides more flexible solutions for focused gene expression of a specific sets of genes. The nCounter® platform has the additional advantage of not requiring reverse transcription, being highly multiplexed regarding the amount of transcripts to be measured in a single reaction, requires low amount of hands-on time, provides fully automated liquid handling steps and has the easiest workflow. The BioMark HD™ system is most cost effective and provides a straightforward and simple method for data normalization. The OpenArray® system has an easy work flow and streamlined protocol were most liquid handling steps are automated and enables progression from cDNA into results in less than three hours.
In summary, all of the evaluated platforms produced high quality gene expression data, demonstrated acceptable reproducibility of gene expression measurements and retained discriminatory power for separation of strong and moderate sensitizers. Although slight differences between the high-throughput platforms in terms of cost per sample, sample throughput and simplicity of protocols were observed, the evaluated platforms were superior in relation to the microarrays when considering these parameters.
In this study, we evaluated the performance of three high-throughput platforms using a restricted set of probes from the GARD biomarker signature. We showed that it was possible to achieve acceptable detection sensitivity, reproducibility and discriminatory power between strong and moderate sensitizers and non-sensitizers in the GARD assay and at the same time reduce time to results and assay costs, simplify assay procedures and increase sample throughput by using a high throughput platform. As a final remark, we conclude that all of the evaluated platforms are suitable candidates to replace microarrays as the technical platform for GARD. Changing the platform for gene expression measurement will be a first step in order to prepare GARD for validation and industrial screening of potential sensitizers.
A panel of 16 chemical compounds comprising eight sensitizers and eight non-sensitizers as defined by the LLNA assay were used for stimulation of cells. The sensitizers were 2-aminophenol, 2-nitro-1,4-phenylenediamine, 2-hydroxyetylacrylate, p-phenylenediamine, etylenediamine, geraniol, penicillin G and eugenol. The non-sensitizers were propylene glycol, ethyl vanillin, 1-butanol, salicylic acid, methyl Salicylate, dimethyl formamide and the vehicle controls dimethyl sulfoxide and water. All chemicals were purchased from Sigma-Aldrich (St. Louis, MO). Chemical compounds were dissolved in either dimethyl sulfoxide or water . Each chemical compound was diluted into a concentration corresponding to the GARD input concentration. Establishment of GARD input concentration has been extensively described elsewhere [10, 29]. Sensitizing potency, GARD input concentration and solvents for each chemical compound are summarized in Table 2.
Cell cultures, phenotypic analysis and chemical stimulations
Maintenance, phenotypic analysis and stimulation of the human myeloid leukemia-derived cell line MUTZ-3 were performed as previously described . In short, phenotypic analysis of MUTZ-3 cells was performed using flow cytometry prior to each experiment to ensure that cells were not differentiated. Monoclonal antibodies used during phenotypic analysis: CD1a (DakoCytomation, Glostrup, Denmark), CD34, CD86, HLA-DR (BD Biosciences, Franklin Lakes, NJ), all FITC-conjugated. CD14 (DakoCytomation), CD54, CD80 (BD Biosciences), all PE-conjugated. Propidium iodide (BD Biosciences) was used to estimate cell viability and FITC- and PE- conjugated mouse IgG1 (BD Biosciences) were used as isotype controls. Samples were analyzed on FACSCanto II instrument using FACS Diva software for data acquisition. A total of 10, 000 events were acquired and data were imported into FCS Express V4 (De Novo Software, Los Angeles, CA) for further analysis. Gates were set to exclude non-viable cells and cell debris based on light scattering properties. During chemical stimulation, MUTZ-3 cells were seeded in 24 well-plates and stimulated with chemical compounds. All stimulations were performed in biological triplicates, performed at different time points using different cell cultures. After 24 h incubation, cells were harvested. Maturity state of the cells were controlled by analyzing cell surface expression of CD86 using flow cytometry as described above. In parallel, harvested cells were lysed in TRIzol® reagent (Life Technologies™, Carlsbad, CA) and stored at −20°C until RNA extraction.
RNA extraction and cDNA preparation
RNA was isolated from chemically stimulated MUTZ-3 cells using TRIzol® reagent. Purity and concentration of RNA in each sample were confirmed using Agilent Bioanalyzer 2100 (Agilent Technologies, Santa Clara, CA) according to standard protocol provided by the manufacturer. Each sample was diluted into 200 ng/μl of total RNA and divided into two identical 10 μl samples (2 μg total RNA). One of the samples was further diluted into 20 ng/μl of total RNA and analyzed on nCounter® platform. The other sample was reverse transcribed into cDNA using the High capacity cDNA reverse transcription kit (Life Technologies™) according to standard protocols provided by the manufacturer. In short, 10 μl of a reverse transcription master mix containing MultiScribe™ reverse transcriptase and random primers was prepared for each sample and added to 2 μg of total RNA (10 μl at 200 ng/μl) for a 20 μl reaction. The following thermal protocol was used: 25°C, 10 min; 37°C, 120 min; 85°C, 5 min; 4°C hold. A reaction efficiency of 100% was assumed. The cDNA samples were divided into two identical 10 μl samples and stored at −20°C until further downstream processing for analysis on the BioMark HD™ platform and the OpenArray® platform.
Primers and probes
A total of 33 transcripts were selected for the evaluation. The set of transcripts included 30 genes from GPS as well as three reference genes (ABCB4, HPRT1, GAPDH) for normalization of data. A probe set targeting the 33 transcripts was obtained from NanoString® (NanoString® Technologies, Seattle, WA) for analysis on the nCounter® platform. Pairs of primers targeting the same 33 transcripts were obtained from DELTAGene™ (Fluidigm®, San Francisco, CA) for analysis on the BioMark HD™ platform. DELTAGene™ quantification of gene expression was based on SYBR® Green hybridization chemistry. Pairs of primers and probes targeting the same 33 transcripts were obtained from Life Technologies™ (Life Technologies™, Carlsbad, CA) for analysis on the OpenArray® platform. OpenArray® quantification of gene expression was based on TaqMan® hydrolysis chemistry. A complete list of accession numbers for transcripts is provided in Table 3.
Measurement of gene expression on nCounter® system
Total RNA samples from chemically stimulated MUTZ-3 cells, prepared as described above, were sent to NCCR Frontiers in Genetics (Geneva, Switzerland) on dry ice for analysis on the nCounter® system. An amount of 200 ng (10 μl) of total RNA from each sample was analyzed on the nCounter® system using standardized protocol for gene expression analysis provided by NanoString®. Each sample was analyzed in a separate multiplexed reaction. Data was imported into nSolver™ analysis software using NanoString® raw code count collector tool. Normalization of data was performed according to NanoString® analysis guidelines. For negative control normalization, the mean of the counts for all negative controls in each sample plus two standard deviations was subtracted from counts for the remaining transcripts in same sample. For positive control normalization, a normalization reference was first generated by calculating the sum of the counts for the positive spike in transcripts in each sample and then calculating the average of these sums across all samples. A scaling factor for each sample was then calculated by dividing the sum of the counts from the positive spike in transcripts from each sample with the normalization reference. Remaining code counts were multiplied by the sample specific scaling factor. Normalized counts were compiled into Microsoft Excel and further normalized against the reference genes GAPDH and HPRT1. For normalization to reference genes, the geometric mean of the counts for GAPDH and HPRT1 for each sample was calculated, and the average across all samples was used as the normalization reference. A scaling factor for normalization of remaining code counts was calculated and applied as described above for positive control normalization. Reference genes were selected based on internal control parameters included in an nSolver Excel macro developed by NCCR Frontiers in Genetics using the geNorm method . For a gene to be considered as detected, the normalized gene counts for a specific transcript had to be significantly (Student’s t test, p < 0.05) above background threshold count value for the negative controls.
Measurement of gene expression on BioMark™ HD system
Specific Target Amplification (STA) was performed on cDNA samples using TaqMan® PreAmp Master Mix (Life Technologies™) and standard protocols provided by manufacturer. In short, 1.25 μl of each cDNA sample was combined with 2.5 μl of 2x TaqMan PreAmp Master Mix in wells of a 96-well PCR plate. 0.5 μl of a pre-amplification primer mix comprising a mixture of pooled DELTAGene™ assays (500nM of each primer) was mixed with 0.75 μl dH2O and added to each sample. The PCR plate was transferred to a thermal cycler and subjected to the following thermal protocol: 95°C, 10 min; 14 cycles (95°C ,15 s; 60°C, 4 min); 4°C hold. Samples were treated with Exonuclease I (New England BioLabs, Ipswich, MA) to remove unincorporated primers by adding 2 μl (at 4 U/μl) to each STA reaction. The PCR plate was once again transferred to a thermal cycler and subjected to the following thermal protocol: 37°C, 30 min; 80°C, 15 min; 4°C hold. All samples were then diluted 10× in TE-buffer (10 mM Tris–HCl, 0.1 mM EDTA, pH 8) (Sigma-Aldrich) and sent to Veterinærinstituttet (DTU, Copenhagen, Denmark) on dry ice for analysis on the BioMark HD™ system. Operation of instruments and handling and processing of the IFC controller HX were performed using standardized protocol for gene expression analysis provided by Fluidigm®. Samples were prepared for loading on a 96:96 Dynamic array™ IFC by combining 2.25 μl of each preamplified cDNA sample with 2.5 μl 2× SsoFast™ EvaGreen® Supermix with low ROX (BioRad, Hercules, CA) and 0.25 μl 20× DNA binding dye loading reagent (Fluidigm®). A total of 5 μl of each pre amplified cDNA sample and 5 μl of each DeltaGene assay were dispensed into their corresponding inlets on the Dynamic array™ and samples were subjected to RT-qPCR reaction using the following thermal cycling protocol: 70°C, 40 min; 60°C, 30 s; 95°C, 1 min; 35 cycles (96°C, 5 s; 60°C, 20 s) and melting curve using a ramp from 60°C to 95°C at 1°C/3 s. Data was collected with Fluidigm® Real-Time PCR analysis software using linear baseline correction method and global auto Cq threshold method. Normalizations of data were performed using comparative Cq method . The reference gene used in this study, GAPDH, was selected based on internal control parameters included in software. A transcript was considered as undetected in a certain chemical stimulation when unprocessed Cq value exceeded 35.
Measurement of gene expression on OpenArray® system
cDNA samples from chemically stimulated MUTZ-3 cells, prepared as described above, were sent to Life Technologies™ demo laboratory (Saint Aubin, France) on dry ice for analysis on the OpenArray® system. Loading of samples, operation of instruments and RT-qPCR cycling were performed using standardized protocol for gene expression analysis provided by Life Technologies™. In short, 1.2 μl of each cDNA sample was combined with 2.5 μl of 2× TaqMan® OpenArray® Real-Time PCR Master Mix (Life Technologies™) and 1.3 μl dH2O and transferred to an OpenArray® 384-Well Sample Plate. Samples were loaded into the custom designed OpenArray® plates using QuantStudio™ 12 K flex AccuFill™ system. The OpenArray® plates were removed from the AccuFill™ system, transferred to an OpenArray® carrier, covered with immersion fluid (All reagents from QuantStudio™ 12 K flex OpenArray® accessories kit, Life Technologies™) and loaded into the QuantStudio™ 12 K flex instrument for RT-qPCR cycling. Samples were subjected to standard thermal cycling protocol provided by Life technologies™. Data was collected with Life Technologies™ Expression Suit analysis software v 1.0.3 using linear baseline correction method and the global auto Cq threshold method. Normalization of data was performed using the comparative Cq method . The reference gene used in this study, GAPDH was selected based on internal control parameters included in software. A transcript was considered as undetected in a certain chemical stimulation when unprocessed Cq value exceeded 35.
Measurement of gene expression on Affymetrix® HuGene 1.0 ST arrays
Affymetrix® gene expression data used for comparative analyses in this study was obtained from previously published experiments . Maintenance, phenotypic analysis and stimulation of cells were carried out as described above. Preparation of cDNA, hybridization, washing and scanning of Human Gene 1.0 ST Arrays (Affymetrix®, Santa Clara, CA) as well as RMA normalization of data was performed according to standardized protocol provided by the manufacturer (Affymetrix®) and as previously described . Gene expression data was filtered to contain only the 30 genes from the 16 chemical compound stimulations as analyzed by nCounter®, BioMark HD™ and OpenArray®.
Where μsample is the normalized mean for chemically stimulated samples and μcontrol is the normalized mean for vehicle controls. For PCR-based methods, ΔCqsample is the normalized mean quantification cycle for chemically stimulated samples and ΔCqcontrol is the normalized mean quantification cycle for vehicle control. Calculations accounts for the fact that Cq values obtained from the RT-qPCR methods as well as the RMA normalized Affymetrix® data were already in log-space.
Comparison of transcriptional profiles
Normalized gene expression measurements from each platform were compiled into the software Qlucore Omics Explorer 2.1 (Qlucore AB, Lund, Sweden). Gene expression data was filtered to include only those genes detected in at least two of the three replicates. Data was investigated and visualized using Principal Component Analysis.
This work was supported by grants from the Swedish Fund for Research Without Animal Experiments, Vinnova, the Swedish Research Council, Swedish Research Council Formas and the Faculty of Engineering (LTH). We would like to thank Ann-Charlott Olsson for technical support and microarray sample preparation.
- Akhavan A, Cohen SR: The relationship between atopic dermatitis and contact dermatitis. Clin Dermatol. 2003, 21 (2): 158-162. 10.1016/S0738-081X(02)00372-3.PubMedView ArticleGoogle Scholar
- Fonacier LS, Dreskin SC, Leung DY: Allergic skin diseases. J Allergy Clin Immunol. 2010, 125 (2 Suppl 2): S138-S149.PubMedView ArticleGoogle Scholar
- Karlberg AT, Bergstrom MA, Borje A, Luthman K, Nilsson JL: Allergic contact dermatitis–formation, structural requirements, and reactivity of skin sensitizers. Chem Res Toxicol. 2008, 21 (1): 53-69. 10.1021/tx7002239.PubMedView ArticleGoogle Scholar
- Thyssen JP, Linneberg A, Menne T, Johansen JD: The epidemiology of contact allergy in the general population–prevalence and main findings. Contact Dermatitis. 2007, 57 (5): 287-299. 10.1111/j.1600-0536.2007.01220.x.PubMedView ArticleGoogle Scholar
- Peiser M, Tralau T, Heidler J, Api AM, Arts JH, Basketter DA, English J, Diepgen TL, Fuhlbrigge RC, Gaspari AA, Johansen JD, Karlberg AT, Kimber I, Lepoittevin JP, Liebsch M, Maibach HI, Martin SF, Merk HF, Platzek T, Rustemeyer T, Schnuch A, Vandebriel RJ, White IR, Luch A: Allergic contact dermatitis: epidemiology, molecular mechanisms, in vitro methods and regulatory aspects. Current knowledge assembled at an international workshop at BfR, Germany. Cell Mol Life Sci. 2012, 69 (5): 763-781. 10.1007/s00018-011-0846-8.PubMed CentralPubMedView ArticleGoogle Scholar
- Diepgen TL, Coenraads PJ: The epidemiology of occupational contact dermatitis. Int Arch Occup Environ Health. 1999, 72 (8): 496-506. 10.1007/s004200050407.PubMedView ArticleGoogle Scholar
- Diepgen TL: Occupational skin-disease data in Europe. Int Arch Occup Environ Health. 2003, 76 (5): 331-338. 10.1007/s00420-002-0418-1.PubMedView ArticleGoogle Scholar
- Basketter DA, Evans P, Fielder RJ, Gerberick GF, Dearman RJ, Kimber I: Local lymph node assay - validation, conduct and use in practice. Food Chem Toxicol. 2002, 40 (5): 593-598. 10.1016/S0278-6915(01)00130-2.PubMedView ArticleGoogle Scholar
- European Parliament, Council of the European Union: REGULATION (EC) No 1223/2009 of the European parliament and of the council of 30 November 2009 on cosmetic products. Official J European Union. 2009, L342: 59-209.Google Scholar
- Johansson H, Lindstedt M, Albrekt AS, Borrebaeck CA: A genomic biomarker signature can predict skin sensitizers using a cell-based in vitro alternative to animal tests. BMC Genomics. 2011, 12: 399-10.1186/1471-2164-12-399.PubMed CentralPubMedView ArticleGoogle Scholar
- Noble WS: What is a support vector machine?. Nat Biotechnol. 2006, 24 (12): 1565-1567. 10.1038/nbt1206-1565.PubMedView ArticleGoogle Scholar
- Murphy D: Gene expression studies using microarrays: principles, problems, and prospects. Adv Physiol Educ. 2002, 26 (1–4): 256-270.PubMedView ArticleGoogle Scholar
- Draghici S, Khatri P, Eklund AC, Szallasi Z: Reliability and reproducibility issues in DNA microarray measurements. Trends Genet. 2006, 22 (2): 101-109. 10.1016/j.tig.2005.12.005.PubMed CentralPubMedView ArticleGoogle Scholar
- Liang P: MAQC papers over the cracks. Nat Biotechnol. 2007, 25 (1): 27-28. 10.1038/nbt0107-27. author reply 28–29PubMedView ArticleGoogle Scholar
- Larkin JE, Frank BC, Gavras H, Sultana R, Quackenbush J: Independence and reproducibility across microarray platforms. Nat Methods. 2005, 2 (5): 337-344. 10.1038/nmeth757.PubMedView ArticleGoogle Scholar
- OECD: OECD Series on Testing and Assessment No 34. Guidance Document on the Validation and International Acceptance of New or Updated Test Methods for Hazard Assessment. 2005, Paris, France: Organisation for Economic Cooperation and Development, 96-Google Scholar
- Geiss GK, Bumgarner RE, Birditt B, Dahl T, Dowidar N, Dunaway DL, Fell HP, Ferree S, George RD, Grogan T, James JJ, Maysuria M, Mitton JD, Oliveri P, Osborn JL, Peng T, Ratcliffe AL, Webster PJ, Davidson EH, Hood L, Dimitrov K: Direct multiplexed measurement of gene expression with color-coded probe pairs. Nat Biotechnol. 2008, 26 (3): 317-325. 10.1038/nbt1385.PubMedView ArticleGoogle Scholar
- Spurgeon SL, Jones RC, Ramakrishnan R: High throughput gene expression measurement with real time PCR in a microfluidic dynamic array. PLoS One. 2008, 3 (2): e1662-10.1371/journal.pone.0001662.PubMed CentralPubMedView ArticleGoogle Scholar
- Morrison T, Hurley J, Garcia J, Yoder K, Katz A, Roberts D, Cho J, Kanigan T, Ilyin SE, Horowitz D, Dixon JM, Brenan CJ: Nanoliter high throughput quantitative PCR. Nucleic Acids Res. 2006, 34 (18): e123-10.1093/nar/gkl639.PubMed CentralPubMedView ArticleGoogle Scholar
- Mackay IM, Arden KE, Nitsche A: Real-time PCR in virology. Nucleic Acids Res. 2002, 30 (6): 1292-1305. 10.1093/nar/30.6.1292.PubMed CentralPubMedView ArticleGoogle Scholar
- Shi L, Tong W, Fang H, Scherf U, Han J, Puri RK, Frueh FW, Goodsaid FM, Guo L, Su Z, Han T, Fuscoe JC, Xu ZA, Patterson TA, Hong H, Xie Q, Perkins RG, Chen JJ, Casciano DA: Cross-platform comparability of microarray technology: intra-platform consistency and appropriate data analysis procedures are essential. BMC Bioinforma. 2005, 6 (Suppl 2): S12-10.1186/1471-2105-6-S2-S12.View ArticleGoogle Scholar
- Brenan C, Morrison T: High throughput, nanoliter quantitative PCR. Drug Discovery Today. 2005, 2 (3): 247-253. 10.1016/j.ddtec.2005.08.017.PubMedView ArticleGoogle Scholar
- Hu ZB, Ma W, Zaborski M, MacLeod R, Quentmeier H, Drexler HG: Establishment and characterization of two novel cytokine-responsive acute myeloid and monocytic leukemia cell lines, MUTZ-2 and MUTZ-3. Leukemia. 1996, 10 (6): 1025-1040.PubMedGoogle Scholar
- Santegoets SJ, Masterson AJ, van der Sluis PC, Lougheed SM, Fluitsma DM, van den Eertwegh AJ, Pinedo HM, Scheper RJ, de Gruijl TD: A CD34(+) human cell line model of myeloid dendritic cell differentiation: evidence for a CD14(+)CD11b(+) Langerhans cell precursor. J Leukoc Biol. 2006, 80 (6): 1337-1344. 10.1189/jlb.0206111.PubMedView ArticleGoogle Scholar
- Kuo WP, Liu F, Trimarchi J, Punzo C, Lombardi M, Sarang J, Whipple ME, Maysuria M, Serikawa K, Lee SY, McCrann D, Kang J, Shearstone JR, Burke J, Park DJ, Wang X, Rector TL, Ricciardi-Castagnoli P, Perrin S, Choi S, Bumgarner R, Kim JH, Short GF, Freeman MW, Seed B, Jensen R, Church GM, Hovig E, Cepko CL, Park P, et al: A sequence-oriented comparison of gene expression measurements across different hybridization-based technologies. Nat Biotechnol. 2006, 24 (7): 832-840. 10.1038/nbt1217.PubMedView ArticleGoogle Scholar
- Shippy R, Sendera TJ, Lockner R, Palaniappan C, Kaysser-Kranich T, Watts G, Alsobrook J: Performance evaluation of commercial short-oligonucleotide microarrays and the impact of noise in making cross-platform correlations. BMC Genomics. 2004, 5: 61-10.1186/1471-2164-5-61.PubMed CentralPubMedView ArticleGoogle Scholar
- Canales RD, Luo Y, Willey JC, Austermiller B, Barbacioru CC, Boysen C, Hunkapiller K, Jensen RV, Knight CR, Lee KY, Ma Y, Maqsodi B, Papallo A, Peters EH, Poulter K, Ruppel PL, Samaha RR, Shi L, Yang W, Zhang L, Goodsaid FM: Evaluation of DNA microarray results with quantitative gene expression platforms. Nat Biotechnol. 2006, 24 (9): 1115-1122. 10.1038/nbt1236.PubMedView ArticleGoogle Scholar
- Ringner M: What is principal component analysis?. Nat Biotechnol. 2008, 26 (3): 303-304. 10.1038/nbt0308-303.PubMedView ArticleGoogle Scholar
- Johansson H, Albrekt AS, Borrebaeck CA, Lindstedt M: The GARD assay for assessment of chemical skin sensitizers. Toxicol In Vitro. 2013, 27 (3): 1163-1169. 10.1016/j.tiv.2012.05.019.PubMedView ArticleGoogle Scholar
- Vandesompele J, De Preter K, Pattyn F, Poppe B, Van Roy N, De Paepe A, Speleman F: Accurate normalization of real-time quantitative RT-PCR data by geometric averaging of multiple internal control genes. Genome Biol. 2002, 3 (7): research0034-research0034.11. doi:10.1186/gb-2002-3-7-research0034PubMed CentralPubMedView ArticleGoogle Scholar
- Livak KJ, Schmittgen TD: Analysis of relative gene expression data using real-time quantitative PCR and the 2(−Delta Delta C(T)) Method. Methods. 2001, 25 (4): 402-408. 10.1006/meth.2001.1262.PubMedView ArticleGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.