- Open Access
Fully automated web-based tool for identifying regulatory hotspots
BMC Genomics volume 21, Article number: 616 (2020)
Regulatory hotspots are genetic variations that may regulate the expression levels of many genes. It has been of great interest to find those hotspots utilizing expression quantitative trait locus (eQTL) analysis. However, it has been reported that many of the findings are spurious hotspots induced by various unknown confounding factors. Recently, methods utilizing complicated statistical models have been developed that successfully identify genuine hotspots. Next-generation Intersample Correlation Emended (NICE) is one of the methods that show high sensitivity and low false-discovery rate in finding regulatory hotspots. Even though the methods successfully find genuine hotspots, they have not been widely used due to their non-user-friendly interfaces and complex running processes. Furthermore, most of the methods are impractical due to their prohibitively high computational complexity.
To overcome the limitations of existing methods, we developed a fully automated web-based tool, referred to as NICER (NICE Renew), which is based on NICE program. First, we dramatically reduced running and installing burden of NICE. Second, we significantly reduced running time by incorporating multi-processing. Third, besides our web-based NICER, users can use NICER on Google Compute Engine and can readily install and run the NICER web service on their local computers. Finally, we provide different input formats and visualizations tools to show results. Utilizing a yeast dataset, we show that NICER can be successfully used in an eQTL analysis to identify many genuine regulatory hotspots, for which more than half of the hotspots were previously reported elsewhere.
Even though many hotspot analysis tools have been proposed, they have not been widely used for many practical reasons. NICER is a fully-automated web-based solution for eQTL mapping and regulatory hotspots analysis. NICER provides a user-friendly interface and has made hotspot analysis more viable by reducing the running time significantly. We believe that NICER will become the method of choice for increasing power of eQTL hotspot analysis.
Regulatory hotspots are genetic variations that regulate the level of expression of thousands of genes [1,2,3,4]. Finding hotspots can guide us to understand the causes and mechanism of many complex diseases and traits . Thus far, genetic studies have been focused on finding regulatory hotspots using eQTL mapping. However, recent studies have reported that many of the previously identified hotspots do not replicate and that these are “spurious hotspots” induced by various unknown confounding effects such as non-biological effects during sample preparation and expression measurements. Several methods have been proposed to remove these confounding effects [6,7,8,9].
Next-generation Intersample Correlation Emended (NICE)  is one such method that has been reported to show superior sensitivity and specificity compared to others. In spite of its advantages, the NICE program is not widely used because of two main drawbacks. NICE is neither very user friendly nor very efficient in terms of the computing performance. It is not user friendly because prior to executing a NICE program, users are required to install several specific packages, create a script file, and perform self-debug. It is also impractical to run NICE on real datasets, as most of the eQTL datasets contain hundreds of thousands of SNPs (Single Nucleotide Polymorphisms), and hotspot analysis tools such as NICE use very complicated statistical models.
To resolve these issues, we introduce a fully automated hotspot analysis program referred to as NICE-Renew (NICER). NICER is created as a web-based tool, where users can activate an analysis by simply clicking and uploading data on the web browser. Besides, users may run NICER on Google Cloud Compute Engine or even download and install the web software as docker image to run NICER web service on their local computers or servers, in which their private data can be processed using their own resources. NICER has enhanced computing performance by incorporating multi-processing concepts in the program, for which the running time reduces linear to the number of processes used. In addition, NICER allows different data formats and provides some visualization tools, which help users better understand their result and provide a fast, more meaningful view in context.
Utilizing a yeast dataset, we show that NICER can be successfully used in an eQTL analysis to identify 29 genuine regulatory hotspots, of which 17 were previously reported elsewhere.
In this paper, we introduce a fully automated hotspot analysis tool referred to as NICER, which provides enhanced NICE in the form of a website as well as in the form of downloadable software. The website and the documentation of the program can be accessed from the NICER website:
Fully-automated web-based program
A majority of NICE users are biologists, who may not have the required experience in computer science to run the NICE program. NICER is created as a web-based tool, where users can activate an analysis by simply clicking on the web browser (Fig. 1). The execution is completely hidden from the user, and the user does not need to check each stage of running the program. After the analysis has been completed, NICER automatically sends a hyperlink to the email provided by the user. From the hyperlink, users can download the result file from the server. This means that after uploading the input data to NICER, users do not have to keep their computers running while performing the analysis and that they are notified of the results via e-mail.
Google cloud compute engine
We allow users to run NICER on Google Compute Engine (GCE), which has several advantages as compared to an ordinary high-computing server. The GCE has more computational power to run programs with more threads. It is protected by Google, and suspicious activities are flagged and banned. As GCE is virtually created as a docker container, server hardware components such as CPU, RAM, and HDD can be flexibly modified, which is helpful to increase the number of parallel processes and shorten the execution time if needed. However, because the web service is uploaded to GCE, users may have to consider the sensitivity of the data and additional costs for using GCE, which they can avoid by using the free NICER on our server. For those who want to avoid the process burden of signing up to the Google Cloud service and installing NICER on it, we also provide a Google Cloud Compute Engine server link upon request.
For those who do not want to upload their data onto either our server or the GCE, we provide NICER as a downloadable version. The downloadable NICER is provided as a web software docker image file along with the source code. Users can easily download and install the docker image to run the NICER web service on their local computer or server with a few lines of code. Users do not need to worry about any initial preparation steps for running NICE such as building the running environment, installing specific packages required to run NICE program, creating a script file to run the NICE, or preparing required input data such as t-test statistics, as they are all incorporated and implemented inside the NICER program. NICER and its detailed documentation is provided on the NICER website http://cblab.dongguk.edu/NICER/NICE_index.jsp In addition, users are allowed to alter or update the source code to run alternative tests.
NICER includes graphic analysis tools to assist with interpreting analysis results. After the eQTL mapping, p-values are provided as a result. To identify the hotspots from the p-values, eQTL map is one of the most commonly used tools for the analysis. eQTL shows the strength of associations between every SNP (x-axis) and gene (y-axis) on 2-dimensional space that helps analyzing patterns of associations at a glance. A plot that shows the average of negative logarithm of p-values is another tool that can help with identifying regulatory hotspots from the p-values. NICER provides these plots as an additional service to the NICE program. Users can upload and use their own p-value tables as well. The results of the plot can be seen in a pop-up page, and the corresponding image is sent to the users’ personal e-mails for safekeeping.
Input data format
NICER allows three input formats of genotype and phenotype for the analysis. In addition to the format for original NICE method, binary PLINK  format and VCF, which are the most commonly used formats in Genome-Wide Association Study (GWAS) and eQTL analysis are added. Since data format varies depending on the dataset, input format compatibility in NICER saves time to preprocess the data beforehand. Users can select their data format from the tab inside the website.
NICER runs on a high-performance computing server and enhances the analysis by implementing parallel processing. Within the NICE algorithm, the value of genome data is calculated in the units of SNPs and as the same algorithm is used for each unit, it could run separately for each SNP in parallel. NICER reduces the execution time by dividing the input matrix data into multiple sets and running them in parallel. As the NICE algorithm is complexly intertwined with different software for each stage, a multi-processing technique is used instead of multi-threading. Thus, the web server splits the input data into multiple sets and creates processes to run NICE, and the web engine keeps track of each process. Parallel processing shortens the execution time considerably as compared to the original NICE method.
Results and discussion
NICER has shown significant improvement in terms of performance and user friendliness.
As shown in Fig. 2, the execution time decreases significantly when more threads are used. The results shown here are those obtained for an evaluation of a renowned yeast dataset . The running time reduces linearly to the number of processes used; thus when the number of computing processes used is doubled, the execution time halves. Furthermore, the number of SNPs did not have any effect on the reduction of execution time, which could be attributed to multi-threading. NICER can reduce running time from 8 months to less than 3 days in an analysis of the yeast data of 42,052 SNPs and 5720 genes , utilizing 1000 processes in parallel.
NICER analysis using the yeast dataset
We evaluated the proposed method by using a yeast dataset that contains 1012 meiotic segregants with 5720 genes and 42,052 SNPs . After adjusting for batch effects and the growth covariate by using the ComBat method in the SVA R package , a significant number of eQTLs were identified on the basis of the NICER p-value of < 5 × 10− 5 (Fig. 3A). SNPs that regulate genes within 10 kb were defined as cis-eQTL.The thresholds for identifying the regulatory hotspots were based on a binominal test with the Bonferroni-corrected p-values of < 0.05/total number of SNPs (42,052). We estimated that the number of eQTL in each SNP followed a binomial distribution with the parameters n = total number of eQTLs except for cis-eQTLs across the whole genome and p = 1/42,052, which denotes the equal probability of eQTL in each SNP. If these SNPs had significantly more eQTLs than expected by chance, the genetic positions corresponding to the SNPs were defined as regulatory hotspots. To determine the putative regulators for a given hotspot, the cis-eQTL genes in the corresponding hotspot regions were regarded as the causal regulators. Next, we divided the whole genome of the Yeast into 602 20-kb bins to compare with the results of other studies related to Yeast eQTL hotspots [14,15,16,17,18,19,20]. If the neighboring bins had eQTL hotspots, then the bins were merged into a single bin and a gene. The results showed that among the 29 identified hotspots, 17 eQTL hotspots had been previously identified (Fig. 3 and Table 1).
NICER is a user-friendly web application to effectively identify eQTL hotspots. By reducing the installation steps and hiding the complicated running steps from the users, NICER lowers the entry barrier from non-computer experts to use eQTL analysis. NICER can be easily accessed through the Internet and the NICER web service could be run not only on the top of the NICER server but also on the Google Compute Engine or users’ local computers with a very simple installing process. Moreover, NICER provides useful tools that visualize analysis results. Applying NICER on the yeast dataset, we effectively found many hotspots, where more than half of the hotspots contain putative regulators reported by previous studies elsewhere.
Availability and requirements
Project name: NICER
Project home page: http://cblab.dongguk.edu/NICER/NICE_index.jsp
Operating system: CentOS7
Programming Language: Java, R
Other requirements: Apache Tomcat 9
Any restrictions to use by non-academics: permission by the author
Availability of data and materials
Expression quantitative trait loci
Google Compute Engine
Genome-Wide Association Study
Next-Generation Intersample Correlation Emended
Variant call format
Brem RB, Kruglyak L. The landscape of genetic complexity across 5,700 gene expression traits in yeast. Proc Natl Acad Sci U S A. 2005;102(5):1572–7.
Keurentjes JJB, Fu J, Terpstra IR, Garcia JM, van den Ackerveken G, Snoek LB, Peeters AJM, Vreugdenhil D, Koornneef M, Jansen RC. Regulatory network construction in Arabidopsis by using genome-wide gene expression quantitative trait loci. Proc Natl Acad Sci U S A. 2007;104(5):1708–13.
Chesler EJ, Lu L, Shou S, Qu Y, Gu J, Wang J, Hsu HC, Mountz JD, Baldwin NE, Langston MA, Threadgill DW, Manly KF, Williams RW. Complex trait analysis of gene expression uncovers polygenic and pleiotropic networks that modulate nervous system function. Nat Genet. 2005;37(3):233–42.
Cheung VG, Spielman RS, Ewens KG, Weber TM, Morley M, Burdick JT. Mapping determinants of human gene expression by regional and genome-wide association. Nature. 2005;437(7063):1365–9.
Westra HJ, Franke L. From genome to function by studying eQTLs. Biochim Biophys Acta. 2014;1842(10):1896–902.
Kang HM, Ye C, Eskin E. Accurate discovery of expression quantitative trait loci under confounding from spurious and genuine regulatory hotspots. Genetics. 2008;180(4):1909–25.
Leek JT, Storey JD. Capturing heterogeneity in gene expression studies by surrogate variable analysis. PLoS Genet. 2007;3(9):1724–35.
Listgarten J, Kadie C, Schadt EE, Heckerman D. Correction for hidden confounders in the genetic analysis of gene expression. Proc Natl Acad Sci U S A. 2010;107(38):16465–70.
Fusi N, Stegle O, Lawrence ND. Joint modelling of confounding factors and prominent genetic regulators provides increased accuracy in genetical genomics studies. PLoS Comput Biol. 2012;8(1):e1002330.
Joo JWJ, Sul JH, Han B, Ye C, Eskin E. Effectively identifying regulatory hotspots while capturing expression heterogeneity in gene expression studies. Genome Biol. 2014;15(4):r61.
Purcell S, Neale B, Todd-Brown K, Thomas L, Ferreira MAR, Bender D, Maller J, Sklar P, de Bakker PIW, Daly MJ, Sham PC. PLINK: a toolset for whole-genome association and population-based linkage analysis. Am J Hum Genet. 2007;81(3):559–75.
Bloom JS, Ehrenreich IM, Loo WT, Lite TL, Kruglyak L. Finding the sources of missing heritability in a yeast cross. Nature. 2013;494(7436):234–7.
Johnson WE, Li C, Rabinovic A. Adjusting batch effects in microarray expression data using empirical Bayes methods. Biostatistics. 2007;8(1):118–27.
Yvert G, Brem RB, Whittle J, Akey JM, Foss E, Smith EN, Mackelprang R, Kruglyak L. Trans-acting regulatory variation in Saccharomyces cerevisiae and the role of transcription factors. Nat Genet. 2003;35(1):57–64.
Brem RB, Yvert G, Clinton R, Kruglyak L. Genetic dissection of transcriptional regulation in budding yeast. Science. 2002;296(5568):752–5.
Zhu J, Zhang B, Smith EN, Drees B, Brem RB, Kruglyak L, Bumgarner RE, Schadt EE. Integrating large-scale functional genomic data to dissect the complexity of yeast regulatory networks. Nat Genet. 2008;40(7):854–61.
Lee SI, Dudley AM, Drubin D, Silver PA, Krogan NJ, Pe'er D, Koller D. Learning a prior on regulatory potential from eQTL data. PLoS Genet. 2009;5(1):e1000358.
Curtis RE, Kim S, Woolford JL Jr, Xu W, Xing EP. Structured association analysis leads to insight into Saccharomyces cerevisiae gene regulation by finding multiple contributing eQTL hotspots associated with functional gene modules. BMC Genomics. 2013;14(1):196.
Lin L, Chen Q, Hirsch JP, Yoo S, Yeung K, Bumgarner RE, Tu Z, Schadt EE, Zhu J. Temporal genetic association and temporal genetic causality methods for dissecting complex networks. Nat Commun. 2018;9(1):3980.
Albert FW, Bloom JS, Siegel J, Day L, Kruglyak L. Genetics of trans-regulatory variation in gene expression. Elife. 2018;7:e35471.
About this supplement
This article has been published as part of BMC Genomics Volume 21 Supplement 10, 2020: Selected articles from the 18th Asia Pacific Bioinformatics Conference (APBC 2020): genomics. The full contents of the supplement are available online at https://bmcgenomics.biomedcentral.com/articles/supplements/volume-21-supplement-10
This research and the publication costs were supported by R&D program for Advanced Integrated-intelligence for IDentifiacation (AIID) through the National Research Foundation of Korea (NRF) funded by Ministry of Science and ICT (NO. 2018M3E3A1057288); by Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Science, ICT & Future Planning (No. 2017R1C1B5017497). The funding body did not play any role in the design of the study and collection, analysis, and interpretation of data and in writing the manuscript.
Ethics approval and consent to participate
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Choi, J.H., Kim, T., Jung, J. et al. Fully automated web-based tool for identifying regulatory hotspots. BMC Genomics 21, 616 (2020). https://doi.org/10.1186/s12864-020-07012-z
- Regulatory hotspot
- Parallel processing
- Web-based tool
- Google cloud compute engine (GCE)
- VCF (variant call format)