- Open Access
Integrative analysis of multi-omics data for identifying multi-markers for diagnosing pancreatic cancer
BMC Genomics volume 16, Article number: S4 (2015)
- The Erratum to this article has been published in BMC Genomics 2017 18:88
microRNA (miRNA) expression plays an influential role in cancer classification and malignancy, and miRNAs are feasible as alternative diagnostic markers for pancreatic cancer, a highly aggressive neoplasm with silent early symptoms, high metastatic potential, and resistance to conventional therapies.
In this study, we evaluated the benefits of multi-omics data analysis by integrating miRNA and mRNA expression data in pancreatic cancer. Using support vector machine (SVM) modelling and leave-one-out cross validation (LOOCV), we evaluated the diagnostic performance of single- or multi-markers based on miRNA and mRNA expression profiles from 104 PDAC tissues and 17 benign pancreatic tissues. For selecting even more reliable and robust markers, we performed validation by independent datasets from the Gene Expression Omnibus (GEO) and the Cancer Genome Atlas (TCGA) data depositories. For validation, miRNA activity was estimated by miRNA-target gene interaction and mRNA expression datasets in pancreatic cancer.
Using a comprehensive identification approach, we successfully identified 705 multi-markers having powerful diagnostic performance for PDAC. In addition, these marker candidates annotated with cancer pathways using gene ontology analysis.
Our prediction models have strong potential for the diagnosis of pancreatic cancer.
The development of early diagnostic biomarkers and innovative therapeutic strategies to prevent the progression of cancers is urgent. However, common biomarker development strategies, based on gene expression alone, have only limited potential to identify novel biomarkers. Due several distinguishing characteristics, microRNAs (miRNAs) have become new potential biomarkers in cancer genetics. miRNAs are small noncoding RNA molecules which "micro-manage" messenger RNA (mRNA) expression by reducing its translation and stability . Recent studies show that in particular, miRNAs play a crucial role in cancer cell proliferation , apoptosis , angiogenesis , metastasis , and chemoresistance  by changing the expression of both oncogenes and tumor suppressors  in pancreatic cancer. These biological roles of miRNAs represent their potential as diagnostic biomarkers for pancreatic cancer.
An important step of estimating the gene-regulatory activity of miRNAs is accurately predicting their targets and monitoring their expression levels. Several computational target prediction tools have been developed, such as TargetScan version 6.2 , PITA version hg18 , and miRvestigator . However, these in silico target prediction tools suffer from high false positive rates because the tools use only sequence complementarity and assume structural stability (following putative assembly) to predict a specific miRNA's target . As miRNA regulatory activation often depends on the distinct tissue being studied (e.g., cancer tissue), the use of condition (i.e., stress, S-phase, etc.)-specific miRNA and mRNA expression data is required to find true miRNA activity . Therefore, the use of miRNAs as potential biomarkers in dismal cancers such as pancreatic cancer remains difficult.
Pancreatic cancer is one of the most hard-to-diagnose and aggressive malignancies, despite increasing knowledge of its etiology . Because of its highly lethal nature and silent symptoms, pancreatic cancer has remained one of the leading causes of cancer-related death . Among the several types of pancreatic cancers, pancreatic ductal adenocarcinoma (PDAC) is the most abundant cancer type which accounts for about 85% of exocrine pancreatic cancers. Although recent advances in gene expression profiling technology, such as microarray and massively parallel sequencing, enable researchers to discover gene-based biomarkers for PDAC diagnosis, there are no highly effective diagnostic markers for PDAC. In order to improve the survival rate of PDAC patients, it is important to identify efficient diagnostic, prognostic, and therapy response markers.
In this study, we performed a novel approach to identify diagnostic markers for PDAC by integrating miRNA and mRNA expression profiles. Using paired miRNA and mRNA expression profiling, we successfully identified promising mRNA and miRNA markers. By determining differential miRNA expression profiles and interaction with their target genes in PDAC, as compared to normal pancreatic tissues, we estimated miRNA expression levels in independent datasets lacking miRNA expression (i.e., having mRNA data only), and validated the diagnostic performance of miRNA marker candidates.
Results and discussion
In this section, we firstly identified multi-markers using mRNA and miRNA expression data from 104 PDAC tissues and 17 benign pancreatic tissues, using support vector machine (SVM) classification and leave-one-out cross-validation (LOOCV). Then, using miRNA target interactions constructed using publically available target prediction tools, we validated marker candidates in independent datasets to select more reliable markers. In the case of independent datasets lacking miRNA expression, we used estimated miRNA activity for validation (based on the expression levels of the miRNA target mRNA transcripts). After validation of the selected candidates, we used other cancer datasets to evaluate and annotate their functions, as shown in Figures 1 and 2.
Identification of multi-marker candidates from PDAC expression data
For identification of multi-marker candidates for PDAC, we used miRNA and mRNA expression data from 121 total pancreatic tissues of 104 PDAC tumors and 17 benign tissues . To prevent overfitting of imbalanced data, LOOCV and SVM with sample class weights were applied, as described in the Methods section. After evaluation analysis using PDAC and independent datasets, we identified 705 multi-markers for 27 miRNAs, and 289 genes for PDAC diagnosis.
Table1 shows the 39 identified multi-markers with high accuracy (BAs > 0.85 and AUC > 0.85 in our dataset) for diagnosis of PDAC in our training datasets and independent datasets. Specifically, miR-107 was upregulated in PDAC, and miR-107 was recently found to be silenced by promoter DNA methylation in pancreatic cancer . However, DNA demethylation events could induce miR-107 expression showing that epigenetic mechanisms regulating miRNA levels may be involved in pancreatic carcinogenesis. Likewise, miR-135b was reported as a biomarker for PDAC , ovarian cancer, and colon cancer , in which it promotes proliferation, invasion, and metastasis , and miR-135b was similarly upregulated in our findings. By contrast, downregulation of miR-148a was reported in pancreatic, bladder, and lung cancers, and miR-148a was preventative of tumor angiogenesis and cancer progression . miR-21 is also a well-known potential biomarker for diagnosis, prognosis, and chemosensitivity of pancreatic cancer. As most miR-21 targets are tumor suppressors, miR-21 is associated with various cancers such as those of the breast, ovary, cervix, colon, lung, liver, brain, esophagus, prostate, pancreas, and thyroid . miR-222 has also been reported as differentially expressed in most pancreatic cancers, in which it promotes poor survival rates .
In Table2, 27 miRNAs were identified for efficacy in the diagnosis of PDAC. Of these, 22 were previously known to be differentially expressed in pancreatic cancer . However, miR-941, miR-28, mir-487a, mir-299, and mir-503 have never been reported in pancreatic cancer.
Out of 289 target genes, 142 were coregulated by more than one miRNA. Table3 lists 17 target genes that were coregulated by more than 6 miRNAs. Although there are complex interactions between these target genes and miRNAs, their expression direction was required to be negatively correlated (e.g., miRNAs upregulated and targets downregulated) for PDAC vs. normal conditions in miRNA-target gene network (Figure 3). The function of most co-regulated target genes correlated with cancer metabolism and cancer progression, through such processes as attenuated apoptosis, abnormal development, angiogenesis, and transcriptional dysregulation.
Estimating the relationship between miRNA activity and miRNA targets
In our previous study , we used the average balanced accuracy (BA), i.e., the arithmetic mean of sensitivity and specificity of target-genes, as a metric for miRNA activity performance. In this paper, we modified the estimation algorithm to improve accuracy of miRNA activity (Figure 2). The main difference was that reliable miRNA-target gene relationships were determined by testing pancreatic cancer datasets for estimating miRNA activity.
Using GSE32688 dataset  with both mRNA expression and miRNA expression, we evaluated our current and previous miRNA estimation algorithm by comparing the estimated and observed BAs of specific miRNAs. The mean-squared errors were 0.01515 and 0.04877 for our new and previous miRNA estimation algorithms, respectively.
Diagnostic performance of selected markers in other cancers
Using our selected PDAC multi-markers, we evaluated their diagnostic performance in lymphoma and breast, hepatocellular, and lung cancers. All independent datasets were collected from the GEO. Figure 4 presents our selected multi-markers for the four other cancers. Most miRNA markers showed weak association with other cancers (besides PDAC).
In conclusion, we developed a novel single and multi-marker identification approach for PDAC diagnosis by analyzing integrated mRNA and miRNA gene expression profiles. To overcome overfitting of imbalanced data, we applied a SVM model with sample class weights and cross-validation, based on sample partitioning in our dataset and independent datasets. Finally, we identified 705 multi-markers for 27 miRNAs and 289 genes as promising potential biomarkers for pancreatic cancer.
Methods and materials
Expression profile datasets
To identify multi-markers in pancreatic cancer, we used mRNA and miRNA expression data from 104 PDAC patients and 17 normal pancreatic patients, following surgery for kidney stones and non-malignant pancreatic disease at Seoul National University Hospital (SNUH) (The detailed experiment and pre-processing steps are described in ). All human subjects studies were approved by the Institutional Review Board of Seoul National University Hospital. In this dataset, mRNA and miRNA expression levels were profiled on Affymetrix (Santa Clara, CA, USA) HuGene 1.0 ST (33,297 probes) arrays and Affymetrix GeneChip miRNA 3.0 (25,016 probes) arrays, respectively. We used 5,617 human miRNA probes, out of 25,016 probes, on the Affymetrix GeneChip miRNA 3.0 array.
For validation with independent datasets of selected multi-marker candidates, we collected expression datasets for PDAC (GSE32688 , GSE15471 , and GSE16515 ), lymphoma (LP; GSE14879 ), breast cancer (BC; GSE10780 ), hepatocellular carcinoma (HCC; GSE6764 ), and lung carcinoma (LC; GSE19188 ) from the Gene Expression Omnibus (GEO) . All collected expressed data were performed using quantile normalization and RMA normalization by R package.
miRNA and mRNA biomarker identification for diagnosis of pancreatic cancer
We developed a novel approach to identify candidate mRNA and miRNA multi-markers for PDAC. The schematic workflow of our pipeline is depicted in Figure 1. Paired miRNA and mRNA expression, and miRNA-mRNA networks were integrated to predict performance for diagnosis of PDAC. This approach is composed of five steps. First, the relationships between miRNA and its target genes were constructed by miRNA target prediction tools. Second, mRNA and miRNA biomarker candidates were detected using our PDAC expression data. In the third step, mRNA and miRNA biomarker candidates were validated by independent datasets. Fourth, diagnostic performances of the validated marker candidates were checked in other cancers. Finally, in the last step, the biological functions of the validated marker candidates were annotated.
Step 1: Prediction of miRNA-target gene interaction
Although many miRNA studies have been performed, only a few miRNA targets have been well validated. To collect reliable miRNA-target relationships covering almost all miRNAs, we employed several in silico prediction algorithms. First, we used all validated target information for 567 miRNAs from miRTarBase 4.0 , and predicted target information for 2,735 miRNAs from three miRNA target prediction methods such as TargetScan version 6.2 , PITA version hg18 , and miRvestigator . These three prediction methods were evaluated as reliable methods in . In this paper, we used 1,357,560 miRNA-target relationship data for 2,735 miRNAs and 18,505 targeted genes. For detecting more reliable miRNA-target relationships for specific conditions such as PDAC, only negatively correlated expressed target genes (correlation coefficient < -0.3 and p-value < 0.05 using linear regression) were chosen (Figure 2). Finally, 33,422 miRNA-target relationship data points, for 1,176 miRNAs and 6,424 targeted genes, were used in this study.
Step 2: Identification of multi-marker candidates with PDAC data
To identify multi-marker candidates, we focused on classification performance with PDAC tissues and benign tissues. In this step, support vector machine (SVM) was applied for qualitative classification evaluated with leave-one-out cross validation (LOOCV). In consideration of our imbalanced sample size (i.e., having many more cancer than benign sample datasets), SVM was employed with sample class weights (α cancer = 1 and α normal = 6.117647) . BA, area under the curve (AUC), and p-values from the permutation tests were used for assessing the performance of each prediction model. Using LOOCV, we calculated BA and AUC values from the prediction accuracies of each marker in the testing dataset. BA is defined as an average of sensitivity and specificity, and is a more appropriate evaluation measure for imbalanced datasets than conventional accuracy (i.e., the proportion of the true results among the number of total test datasets). The permutation p-values were calculated from empirical null distribution of BAs by 1 × 106 sample permutations for markers with high BAs.
Using the miRNA and mRNA target relationships generated in step 1, 1504 multi-markers for 217 genes and 56 miRNAs were selected with BAs > 0.8, AUC > 0.8, and Bonferroni adjusted p-values < 0.05 for genes and miRNAs, respectively.
Step 3: Evaluation of prediction performance in independent PDAC datasets
To avoid selection of markers with specific data-dependency or specific platform-dependency, all identified single or multi-markers were evaluated using three public, independent PDAC datasets collected from the GEO  (Table2). Of the three, PDAC dataset1 had both mRNA and miRNA expression microarray profiles from GSE32688 , while PDAC dataset2 and dataset3 had only mRNA expression profiles using microarray data from GSE15471  and GSE16515 . To select reliable and robust miRNA-target gene multi-markers, miRNAs and their putative target genes having negatively correlated expression, and BAs > 0.7 in PDAC dataset1, were selected.
To validate miRNA prediction performance in the profile datasets (PDAC datasets 2 and 3) containing only mRNA expression, we estimated the expression of specific miRNAs using their predicted miRNA-target gene relationships. In Figure 2, linear regression models were fitted with miRNA and mRNA expression data from the 104 cancer tissues and 17 benign tissues. Then, the expression of the miRNAs of interest was estimated by regression models and its targeted-gene expression data in the independent datasets. Using this estimated miRNA expression, its prediction performance could then be calculated. We extracted the multi-markers with BAs > 0.7 in one or more of the PDAC datasets 2 and/or 3. Finally, after validation with the three independent PDAC datasets, we selected 712 miRNA-target gene multi-markers for 30 miRNAs and 290 genes.
Step 4: Evaluation of prediction performance in other cancer datasets
To examine the feasibility of repurposing our identified marker candidates for other cancers, we collected other cancer datasets having mRNA expression data for lymphoma , breast cancer , hepatocellular carcinoma , and lung carcinoma  from GEO datasets. Based on SVM-LOOCV evaluation analysis, the selected single and multi-markers were evaluated.
Step 5: Gene ontology analysis and miRNA-mRNA network generation using the identified biomarkers
The targeted genes of the identified multi-markers were annotated for gene ontology pathways/processes (GO) using PANTHER . In this analysis, markers with annotation results with Bonferroni-corrected p-values < 0.05 were selected. Using this GO annotation, miRNA-target gene relationships of identified multi-markers were represented by the network generated by Cytoscape 3.1.1  (Figure 3).
Area under curve
Gene Expression Omnibus
Pancreatic ductal adenocarcinoma
Support vector machine
the Cancer Genome Atlas
Bartel DP, Chen CZ: Micromanagers of gene expression: the potentially widespread influence of metazoan microRNAs. Nature Reviews Genetics. 2004, 5 (5): 396-400.
Johnson CD, Esquela-Kerscher A, Stefani G, Byrom M, Kelnar K, Ovcharenko D, et al: The let-7 microRNA represses cell proliferation pathways in human cells. Cancer Research. 2007, 67 (16): 7713-7722. 10.1158/0008-5472.CAN-07-1083.
Hermeking H: The miR-34 family in cancer and apoptosis. Cell Death Diff. 2010, 17 (2): 193-199. 10.1038/cdd.2009.56.
Kuehbacher A, Urbich C, Dimmeler S: Targeting microRNA expression to regulate angiogenesis. Trends Pharmacol. 2008, 29 (1): 12-15. 10.1016/j.tips.2007.10.014.
Nicoloso MS, Spizzo R, Shimizu M, Rossi S, Calin GA: MicroRNAs--the micro steering wheel of tumour metastases. Nature Reviews Cancer. 2009, 9 (4): 293-302. 10.1038/nrc2619.
Bhutia YD, Hung SW, Krentz M, Patel D, Lovin D, Manoharan R, et al: Differential processing of let-7a precursors influences RRM2 expression and chemosensitivity in pancreatic cancer: role of LIN-28 and SET oncoprotein. PLoS One. 2013, 8 (1): e53436-10.1371/journal.pone.0053436.
Srivastava SK, Arora S, Singh S, Bhardwaj A, Averett C, Singh AP: MicroRNAs in pancreatic malignancy: progress and promises. Cancer Letters. 2014, 347 (2): 167-174. 10.1016/j.canlet.2014.02.015.
Lewis BP, Burge CB, Bartel DP: Conserved seed pairing, often flanked by adenosines, indicates that thousands of human genes are microRNA targets. Cell. 2005, 120 (1): 15-20. 10.1016/j.cell.2004.12.035.
Kertesz M, Iovino N, Unnerstall U, Gaul U, Segal E: The role of site accessibility in microRNA target recognition. Nature Genetics. 2007, 39 (10): 1278-1284. 10.1038/ng2135.
Plaisier CL, Bare JC, Baliga NS: miRvestigator: web application to identify miRNAs responsible for co-regulated gene expression patterns discovered through transcriptome profiling. Nucleic Acids Research. 2011, 39 (Web Server issue): W125-W131.
Rajewsky N: microRNA target predictions in animals. Nature genetics. 2006, S8-S13. 38 Suppl
Le HS, Bar-Joseph Z: Integrating sequence, expression and interaction data to determine condition-specific miRNA regulation. Bioinformatics. 2013, 29 (13): i89-i97. 10.1093/bioinformatics/btt231.
Chan A, Diamandis EP, Blasutig IM: Strategies for discovering novel pancreatic cancer biomarkers. Journal of Proteomics. 2013, 81: 126-134.
Hezel AF, Kimmelman AC, Stanger BZ, Bardeesy N, Depinho RA: Genetics and biology of pancreatic ductal adenocarcinoma. Genes Dev. 2006, 20 (10): 1218-1249. 10.1101/gad.1415606.
Kwon MS, Kim Y, Lee S, Namkung J, Yun T, Yi SG, et al: Biomarker development for pancreatic ductal adenocarcinoma using integrated analysis of mRNA and miRNA expression. Bioinformatics and Biomedicine (BIBM), 2014 IEEE International Conference. 2014, 273-278.
Lee KH, Lotterman C, Karikari C, Omura N, Feldmann G, Habbe N, et al: Epigenetic silencing of MicroRNA miR-107 regulates cyclin-dependent kinase 6 expression in pancreatic cancer. Pancreatology. 2009, 9 (3): 293-301. 10.1159/000186051.
Munding JB, Adai AT, Maghnouj A, Urbanik A, Zollner H, Liffers ST, et al: Global microRNA expression profiling of microdissected tissues identifies miR-135b as a novel biomarker for pancreatic ductal adenocarcinoma. Int J Cancer. 2012, 131 (2): E86-E95. 10.1002/ijc.26466.
Valeri N, Braconi C, Gasparini P, Murgia C, Lampis A, Paulus-Hock V, et al: MicroRNA-135b promotes cancer progression by acting as a downstream effector of oncogenic pathways in colon cancer. Cancer Cell. 2014, 25 (4): 469-483. 10.1016/j.ccr.2014.03.006.
Xu WG, Shang YL, Cong XR, Bian X, Yuan Z: MicroRNA-135b promotes proliferation, invasion and migration of osteosarcoma cells by degrading myocardin. Int J Oncol. 2014, 45 (5): 2024-2032.
Xu Q, Liu LZ, Yin Y, He J, Li Q, Qian X, et al: Regulatory circuit of PKM2/NF-kappaB/miR-148a/152-modulated tumor angiogenesis and cancer progression. Oncogene. 2015
Garzon R, Marcucci G, Croce CM: Targeting microRNAs in cancer: rationale, strategies and challenges. Nature Rev Drug Discov. 2010, 9 (10): 775-789. 10.1038/nrd3179.
Greither T, Grochola LF, Udelnow A, Lautenschlager C, Wurl P, Taubert H: Elevated expression of microRNAs 155, 203, 210 and 222 in pancreatic tumors is associated with poorer survival. Int J Cancer. 2010, 126 (1): 73-80. 10.1002/ijc.24687.
Donahue TR, Tran LM, Hill R, Li Y, Kovochich A, Calvopina JH, et al: Integrative survival-based molecular profiling of human pancreatic cancer. Clin Cancer Res. 2012, 18 (5): 1352-1363. 10.1158/1078-0432.CCR-11-1539.
Badea L, Herlea V, Dima SO, Dumitrascu T, Popescu I: Combined gene expression analysis of whole-tissue and microdissected pancreatic ductal adenocarcinoma identifies genes specifically overexpressed in tumor epithelia. Hepatogastroenterology. 2008, 55 (88): 2016-2027.
Pei H, Li L, Fridley BL, Jenkins GD, Kalari KR, Lingle W, et al: FKBP51 affects cancer cell response to chemotherapy by negatively regulating Akt. Cancer Cell. 2009, 16 (3): 259-266. 10.1016/j.ccr.2009.07.016.
Eckerle S, Brune V, Doring C, Tiacci E, Bohle V, Sundstrom C, et al: Gene expression profiling of isolated tumour cells from anaplastic large cell lymphomas: insights into its cellular origin, pathogenesis and relation to Hodgkin lymphoma. Leukemia. 2009, 23 (11): 2129-2138. 10.1038/leu.2009.161.
Chen DT, Nasir A, Culhane A, Venkataramu C, Fulp W, Rubio R, et al: Proliferative genes dominate malignancy-risk gene signature in histologically-normal breast tissue. Breast Cancer Res Treat. 2010, 119 (2): 335-346. 10.1007/s10549-009-0344-y.
Wurmbach E, Chen YB, Khitrov G, Zhang W, Roayaie S, Schwartz M, et al: Genome-wide molecular profiles of HCV-induced dysplasia and hepatocellular carcinoma. Hepatology. 2007, 45 (4): 938-947. 10.1002/hep.21622.
Hou J, Aerts J, den Hamer B, van Ijcken W, den Bakker M, Riegman P, et al: Gene expression-based classification of non-small cell lung carcinomas and survival prediction. PLoS One. 2010, 5 (4): e10312-10.1371/journal.pone.0010312.
Barrett T, Wilhite SE, Ledoux P, Evangelista C, Kim IF, Tomashevsky M, et al: NCBI GEO: archive for functional genomics data sets--update. Nucleic Acids Research. 2013, 41 (Database issue): D991-D995.
Hsu SD, Lin FM, Wu WY, Liang C, Huang WC, Chan WL, et al: miRTarBase: a database curates experimentally validated microRNA-target interactions. Nucleic Acids Research. 2011, 39 (Database issue): D163-D169.
Plaisier CL, Pan M, Baliga NS: A miRNA-regulatory network explains how dysregulated miRNAs perturb oncogenic processes across diverse cancers. Genome Research. 2012, 22 (11): 2302-2314. 10.1101/gr.133991.111.
Chang CC, Lin CJ: LIBSVM: A Library for Support Vector Machines. Acm T Intel Syst Tec. 2011, 2 (3):
Mi H, Muruganujan A, Casagrande JT, Thomas PD: Large-scale gene function analysis with the PANTHER classification system. Nature Protocols. 2013, 8 (8): 1551-1566. 10.1038/nprot.2013.092.
Shannon P, Markiel A, Ozier O, Baliga NS, Wang JT, Ramage D, et al: Cytoscape: a software environment for integrated models of biomolecular interaction networks. Genome Research. 2003, 13 (11): 2498-2504. 10.1101/gr.1239303.
Publication of this work was supported by the National Research Foundation of Korea (NRF) grant funded by the Korean government (MSIP) (2012R1A3A2026438, 2013M3A9C4078158, 2013R1A1A3010025) and Healthcare Group, Future Technology R&D Division, SK telecom Co.
This article has been published as part of BMC Genomics Volume 16 Supplement 9, 2015: Selected articles from the IEE International Conference on Bioinformatics and Biomedicine (BIBM 2014): Genomics. The full contents of the supplement are available online at http://www.biomedcentral.com/bmcgenomics/supplements/16/S9.
The authors declare that they have no competing interests.
MK performed the analysis, and drafted the manuscript. YK performed the analysis of microarray. SL participated in the design of the study. JN, TY, SY and SH performed the microarray experiment. MK, SK and JJ conducted the sample collection and preparation. TP and JJ conceived of the study, and participated in its design and coordination. TP helped to draft the manuscript. All authors write, read and approved the final manuscript.
An erratum to this article is available at http://dx.doi.org/10.1186/s12864-016-3464-x.
About this article
Cite this article
Kwon, MS., Kim, Y., Lee, S. et al. Integrative analysis of multi-omics data for identifying multi-markers for diagnosing pancreatic cancer. BMC Genomics 16, S4 (2015). https://doi.org/10.1186/1471-2164-16-S9-S4
- Pancreatic Cancer
- Support Vector Machine
- miRNA Expression
- Independent Dataset
- mRNA Expression Data