Volume 14 Supplement 8

## Selected articles from the International Conference on Intelligent Biology and Medicine (ICIBM 2013): Genomics

# Simultaneous inferences based on empirical Bayes methods and false discovery rates ineQTL data analysis

- Arindom Chakraborty
^{1, 2}, - Guanglong Jiang
^{1, 2}, - Malaz Boustani
^{3}, - Yunlong Liu
^{1, 2}, - Todd Skaar
^{4}and - Lang Li
^{1, 2, 4}Email author

**14(Suppl 8)**:S8

**DOI: **10.1186/1471-2164-14-S8-S8

© Chakraborty et al.; licensee BioMed Central Ltd. 2013

**Published: **9 December 2013

## Abstract

### Background

Genome-wide association studies (GWAS) have identified hundreds of genetic variants associated with complex human diseases, clinical conditions and traits. Genetic mapping of expression quantitative trait loci (eQTLs) is providing us with novel functional effects of thousands of single nucleotide polymorphisms (SNPs). In a classical quantitative trail loci (QTL) mapping problem multiple tests are done to assess whether one trait is associated with a number of loci. In contrast to QTL studies, thousands of traits are measured alongwith thousands of gene expressions in an eQTL study. For such a study, a huge number of tests have to be performed ($~1{0}^{6}$). This extreme multiplicity gives rise to many computational and statistical problems. In this paper we have tried to address these issues using two closely related inferential approaches: an empirical Bayes method that bears the Bayesian flavor without having much *a priori* knowledge and the frequentist method of false discovery rates. A three-component t-mixture model has been used for the parametric empirical Bayes (PEB) method. Inferences have been obtained using Expectation/Conditional Maximization Either (ECME) algorithm. A simulation study has also been performed and has been compared with a nonparametric empirical Bayes (NPEB) alternative.

### Results

The results show that PEB has an edge over NPEB. The proposed methodology has been applied to human liver cohort (LHC) data. Our method enables to discover more significant SNPs with FDR<10% compared to the previous study done by Yang et al. (*Genome Research*, 2010).

### Conclusions

In contrast to previously available methods based on p-values, the empirical Bayes method uses local false discovery rate (lfdr) as the threshold. This method controls false positive rate.

## Introduction

Genome-wide association studies (GWASs) have done a remarkable progress in searching for susceptibility genes. In GWAS, instead of one gene at a time, variation across the entire genome is tested for association with disease risk. GWASs exploit the linkage disequilibrium (LD) relationships among single nucleotide polymorphisms (SNPs), making it possible to assay genome by testing a finite number of SNPs. Till date, the signals that can be discovered through GWAS has not been reported exhaustively. It is important to annotate SNPs information on expression for the better understanding of the genes and mechanisms driving the association. In many situations, there are more common variants truly associated with disease. These variants are highly likely to be expression quantitative trait loci (eQTLs). eQTLs are derived from polymorphisms in the genome that result in differential measurable transcript levels. Microarrays are used to measure gene expression levels across genetic mapping populations. For at least a subset of complex disorders, gene expression levels could be used as a surrogate/biomarker for classical phenotypes. The gene underlying the eQTL is considered to be an excellent candidate for phenotypic QTL.

eQTL mapping is a statistical technique to locate genomic intervals, that are likely to regulate the expression of each transcript, by correlating quantitative measurements of mRNA expression with genetic polymorphisms segregating in a population. In a GWAS, millions of SNPs are tested at once. Associations that initially appear to be significant must be statistically adjusted to account for the large number of tests being performed. A large number of false positives will result in if this correction is ignored. The multiple-testing correction, however, sets a very high threshold for genome-wide significance, on the order of $5\times 1{0}^{-8}$ when a million SNPs are tested. In the vast majority cases, however, association studies have achieved only limited success. Large sample sizes are needed to achieve sufficient statistical power to detect risk alleles with effects weak enough to have escaped detection in the past; the disease risk alleles identified by GWASs so far do have weak effects, each with odds ratios of 1.1 or 1.2 [1].

Two closely related inferential procedures for multiple testing have been discussed in this work-afrequentist approach based on Benjamini and Hochberg's ([2]) false discovery rate procedure, and an empirical Bayes methodology developed in Efron et al. [3, 4]. These two methods are not only very closely related, they can be used to support each other. In a classic two-sample problem in a microarray experiment, these approaches have been discussed by Efron and Tibshirani[5]. However, they have considered nonparametric empirical Bayes (NPEB) model. Parametric Bayesian modeling has been considered by Newton et al. [6], Lee et al. [7], Kendziroski et *al*. [8–10], Gelfond et *al*. [11]. Hierarchical models like gamma-gamma [6] or lognormal-normal [8] are used quite often in PEB procedures. These models suffer from a serious drawback that the variation is constant among genes. An extension has been done to these models by considering gene specific variations[12]. The application of empirical Bayes has been somehow not very common in literature. The obvious reason is that, experimenters have not brought us many data sets having the parallel structure necessary for empirical Bayes to do its stuff. Because of the recent surge in high-throughput ([13]) technologies and genome projects, many genome studies are now underway. These studies have become a major data generator in the post-genomics era. Empirical Bayes procedures seem to be particularly well-suited for combining information in expression data.

One of the fundamental statistical problems in microarray gene expression analysis is the need to reduce dimensionality of the transcripts. This can be achieved by identifying differentially expressed (DE) genes under different conditions or groups. Regulatory network can be obtained by associating differential expressions with the genotype of molecular markers. It is possible to have a large number of DE genes that influences a certain phenotype while their relative proportion is very small. It is very important to identify these DE genes from among the number of recorded genes [6, 7, 9, 14, 15]. Empirical Bayes methods provide a natural approach to reduce the dimensionality significantly [16, 17]. Following the empirical Bayes approach DE genes are identified using the posterior probability for differential expression. EB approaches detect a DE gene by sharing information across the whole genome.

The development of the empirical Bayes methodologies that improve the power to detect DE genes essentially reduces to the choice of whether gene-specific effects should be modeled as fixed or random [18]. Both mean and error variance can be of either of these two: fixed or random. Fixed mean and random error variance has been considered by Wright and Simon [19] and Cui et al. [20] whereas Lonnstedt et al. [21], Tai and Speed [22], Lonnstedt and Speed [23] have considered both the parameters to be random. Random mean effect with homogeneous fixed error variance has been considered by Newton et al. [6, 24], Kendziroski et al. [9] and Kendziroski et al. [10]. However an extension to this fixed error variance has been considered by Gelfond et al. [11]. They have considered discrete uniform prior for the variance component.

The paper is organized as follows. In the Methods section we introduce the necessary notations for our additive genetic model along with the notions of false discovery rate (fdr). In this section we have tried to establish the relationship between fdr and empirical Bayes. Methods section also describes, the proposed Expectation/Conditional Maximization Either (ECME) (Liu and Rubin [25]) in details. This algorithm generalizes the Expectation-Maximization algorithm with better convergence rate. A simulation study has been performed and described in the Results section. We show that proposed parametric empirical Bayes performs better compared to nonparametric empirical Bayes in terms of controlled fdr. In the Results section, as an application, we have applied the proposed methodology to the Liver Cohort (LHC) dataset. We conclude the article the Discussion section.

## Methods

*G*

_{ i }

*i*= 1

*.....l*as the genomic marker(i.e. SNP), and

*T*

_{ j }(

*j*= 1

*......J*) as the transcripts. The identified eQTLs refer to the significant Gs that are associated with Ts. These associations can be found using a test statistics based on all $n$ samples. The genetic model for this association can be one of the three models: dominant, recessive and additive. Under the dominance model, we can have two genotypes for each of the SNPs. However for an additive model, three genotype groups are available. A transcript ${T}_{j}$ is assumed to be associated with marker ${G}_{i}$ if the mean level of expression of transcript ${T}_{j}$ for one genotype group is different from that of the other genotype group corresponding to that marker. Let ${\mu}_{T,G}^{\left(1\right)}$ and ${\mu}_{T,G}^{\left(0\right)}$ be the group means corresponding to the genotypes ${G}_{i}$. To test the hypothesis ${H}_{0}:{\mu}_{T,G}^{\left(1\right)}={\mu}_{T,G}^{\left(0\right)}$, a few test statistics are proposed for microarray data analysis[26]. The present work is based on the statistic proposed by Efron et

*al*. [4]. The test statistic is defined as

where ${S}_{ij}$ is the usual standard deviations and ${a}_{0i}$ is defined to minimize the difference in the coefficient of variation of ${Z}_{ij}$ within classes of genes with approximately equal variance. A drawback of calculating ${a}_{0i}$ is the computational cost. Note that if ${a}_{0i}=0$, this reduces to usual t-statistic. Here ${a}_{0i}$ is considered to be 90^{th} percentile of all ${S}_{ij}$ values (Efron el *al*. [4]).

*F*

_{ i }be the minor allele frequency of the

*i*th SNP then we model the distribution of

*Z*

_{ ij }as a mixture model of the form:

*Z*

_{ ij }for nonzero associations between ${G}_{i}$ and ${T}_{j}$ and ${f}_{0}\left(.\right)$ denotes the distribution of ${Z}_{ij}$ for the zero associations. ${\delta}_{ij}$ isdefined as

with ${\mu}_{0i}=0,{\tau}_{0i}^{2}=1$. Mixing proportions ${\pi}_{ik}$ are nonnegative constantsand sum to one for fixed *i*. ${f}_{0}\left(.\right)$ corresponds to distribution for no associationwhereas ${f}_{1}\left(.\right)$ and ${f}_{2}\left(.\right)$ correspond to distributions related to positive and negativeassociation respectively. In a recent work, Noma and Matsui [27], have used semiparametric hierarchical mixture model where the distribution of mean expression level of a transcript is considered to be a three-component mixture distribution.

Full Bayesian analysis of (4) will require prior specifications of $\mathit{\pi},\mathit{\theta},\mathit{\nu},{f}_{0}\left(Z\right)$ and ${f}_{1}\left(Z\right)$. However, one can use the massively parallel structure of microarray data to estimate an empirical Bayes estimate of the posterior probability. These huge data motivates to be quite empirical rather than specifying *a-priori* models in favor of data-based investigations [27].

### Empirical Bayes, false discovery rates (fdr) and local false discovery rate (lfdr)

False discovery rate (fdr) is defined as the expected proportion of errors committed by falsely rejecting null hypotheses. Benjamini and Hochberg's [2]fdr criterion has very close relation with the empirical Bayes analysis. This relation improved the connection between Bayesian and frequentist testing theory. The close connection between fdr and the empirical Bayes methodology follows directly from Bayes theorem and this has been established by the "Equivalence theorem"[28]. Tail area rejection regions like $\left\{{Z}_{ij}<z\right\}$ are common in the frequentist framework. According to this theorem, if the tail area rejection region is taken to be as large as possible subject to the constraint that the estimated Bayes proportions of false discoveries is less than $\alpha $, then the frequentist expected proportion of false discoveries is also less than $\alpha $.

*al*. [4]) and ${p}_{oi}$ is estimated from the nonnegative constraint

All other parameters will be estimated by EM algorithm assuming ${f}_{i0}\left(.\right)$ to be known. There are some practical difficulties with the lfdr that relies on densities. The estimation of null becomes more problematic in the far tails. It is relatively easier to work with cumulative distribution function than work with densities. Identification of discoveries by lfdr may not be reproducible for a new data. Therefore, even in empirical Bayes framework, fdr should be preferred.

#### Nonparametric empirical Bayes (NPEB)

The main difference between parametric empirical Bayes (PEB) and nonparametric empirical Bayes (NPEB) is the way in which ${f}_{1}\left(.\right)\phantom{\rule{0.3em}{0ex}}\mathsf{\text{and}}{f}_{2}\left(.\right)$ are treated. In PEB model, the functional form of ${f}_{1}\left(.\right)\phantom{\rule{0.3em}{0ex}}\mathsf{\text{and}}{f}_{2}\left(.\right)$ are known, i.e., we have a parametric family of priors. In contrast, the NPEB does not assume the functional form to be known. Though NPEB methods are quite powerful, these are more suitable for large sample analyses. To compute the fdr under NPEB setup, we have followed the algorithm proposed by Efron et al. [4].

#### ECME algorithm

To fit a mixture model, EM algorithm is widely used. In case of *t* distribution the mean parameter $\mu $ and variance component ${\tau}^{2}$ can easily be estimated by EM algorithm assuming that degrees of freedom $\nu $ is known. However when $\nu $ is unknown EM still can be used as demonstrated by Lange, Little and Taylor [29]. But this method appears to be very slow (Liu and Rubin [30]) and an extension has been proposed by Meng and Rubin [31] as ECM algorithm. This is a generalization of EM algorithm where the E step remains the same butthe M step is replaced by CM (constrained or conditional maximization) step. ECM algorithm is basically a generalized EM (GEM) as shown by Meng and Rubin [31]. Incidentally, the rate of convergence, in terms of iterations, for this ECM algorithm is slower compared to EM. To overcome this computational problem, Liu and Rubin [30] propose an efficient algorithm ECME which is again an extension of ECM algorithm. Though this is not a GEM, it converges faster.

and ${U}_{i}$ s are independently distributed gamma variables.

*t*distribution. In ECME algorithm, this result has been extended to cover the present set up of a 3-component mixture of

*t*distribution. For the sake of brevity, in this section we omit the suffix

*ij*for all the variables. To define

*t*distribution with mean $\mu $, variance ${\tau}^{2}$ and degrees of freedom $\nu $, we proceed as follows:

then marginally, $Z~t\left(\mu ,{\tau}^{2},\nu \right)$.

#### E-Step

which is the posterior probability that $\mathsf{\text{Z}}$ belongs to the k-th component of the mixture based on current fit ${\mathit{\psi}}^{\left(\mathsf{\text{t}}\right)}$.

#### CM-step

To get an efficient algorithm, let us partition $\mathit{\psi}$ as $({\mathit{\psi}}_{1}^{\text{'}},{\mathit{\psi}}_{2}^{\text{'}})\text{'}$ where ${\mathit{\psi}}_{1}$ contains all the parameters except parameters corresponding to degree of freedom of t-distributions. The above M-step is replaced by two CM-steps, as follows.

**CM-Step 1**. Keeping ${\mathit{\psi}}_{2}$ fixed, i.e. $\mathit{\nu}$ is fixed at ${\nu}^{\left(\mathsf{\text{t}}\right)}$, maximize $\mathsf{\text{Q}}\left(\mathbf{\psi};{\mathbf{\psi}}^{\left(\mathsf{\text{t}}\right)}\right)$ to get ${\mathbf{\psi}}_{1}^{\left(t+1\right)}$

**CM-Step 2**. Now fix ${\mathbf{\psi}}_{1}$ at ${\mathbf{\psi}}_{1}^{\left(t+1\right)}$ and calculate ${\mathbf{\psi}}_{2}^{\left(t+1\right)}$ by maximizing $\mathsf{\text{Q}}\left(\mathbf{\psi};{\mathbf{\psi}}^{\left(\mathsf{\text{t}}\right)}\right)$

Furthermore to make the algorithm more efficient, after the first CM-step, we replace the E-step with $\psi =({\psi}_{1}^{\left(t+1\right)}{}^{\text{'}},{\psi}_{2}^{\left(t\right)}{}^{\text{'}})\text{'}$ instead of $\psi =({\psi}_{1}^{\left(t\right)}{}^{\text{'}},{\psi}_{2}^{\left(t\right)}{}^{\text{'}})\text{'}$.

### Simulation study

To assess the proposed methodology, a small sample simulation study has been performed. This gives an idea whether or not the parameters are well estimated and most importantly, they provide information of false discovery rates.

The True FDR Performance of Controlled FDR in EB Models

True fraction of DE | Controlled FDR | |||||
---|---|---|---|---|---|---|

Nonparametric empirical Bayes | Parametric empirical Bayes | |||||

0.01 | 0.05 | 0.10 | 0.01 | 0.05 | 0.10 | |

0.01 | 0.004 | 0.029 | 0.067 | 0.005 | 0.042 | 0.090 |

0.05 | 0.006 | 0.041 | 0.079 | 0.006 | 0.045 | 0.094 |

0.10 | 0.007 | 0.043 | 0.087 | 0.008 | 0.047 | 0.097 |

It is evident from the above table that the nonparmateric empirical Bayes is much conservative compared to its parametric alternative. For parametric set up, the true FDR is very much close to the controlled one, whereas, for nonparametric empirical Bayes these values are not so close as the true fraction of DE transcripts increases.

### HLC data analysis

We applied the empirical Bayes model to analyze a sequencing data publicly available. In the current study, we have started with liver tissue data of 213 Caucasian samples from apreviously described human liver cohort (LHC) (Yang et al. [33]). To get the genotypes and gene expression profiles, DNA and RNA have been isolated. Illumina platform is used to get the expressions. After putting some filtration (MAF>5%, HWE<10^{-5},) we are left with 173 samples, 472,000 SNPs and 30,000 expressions.

## Conclusion

Number of eQTL pairs after crossing the threshold of FDR

Gene symbol | No. of SNPs (FDR<10%) | No. of cis-SNP | No. of cis-eSNP (FDR<10%) by Yang et al. (2010) |
---|---|---|---|

CYP3A5 | 263 | 62 | 56 |

CYP2D6 | 264 | 67 | 54 |

CYP4F12 | 392 | 55 | 46 |

CYP2E1 | 130 | 45 | 31 |

CYP2U1 | 549 | 45 | 26 |

CYP1B1 | 168 | 21 | 13 |

CYP2C18 | 90 | 13 | 9 |

CYP4F11 | 169 | 15 | 7 |

CYP4V2 | 159 | 25 | 3 |

CYP2F1 | 324 | 10 | 2 |

CYP39A1 | 448 | 17 | 2 |

CYP26C1 | 154 | 29 | 1 |

CYP2C19 | 356 | 7 | 1 |

CYP2C9 | 413 | 20 | 1 |

CYP2S1 | 319 | 10 | 1 |

CYP46A1 | 430 | 7 | 1 |

CYP4A11 | 461 | 4 | 1 |

CYP4X1 | 151 | 3 | 1 |

## Discussion

In contrast to previously available methods based on p-values, the empirical Bayes method uses local false discovery rate (lfdr) as the threshold. This method controls false positive rate. For a particular SNP, the lfdr is computed for the site-specific evidence whereas the FDR averages over other sites with stronger evidence. There are some limitations of using FDR which may result in misleading inferences in genome studies. In such a situation, it is better to use lfdr which is a bit difficult to estimate compared to FDR.However there is still one computational problem which needs much attention. Due to the high dimensionality in the data, sometimes existing algorithms fail. This necessitates the need to find some more efficient algorithms. The choice of threshold FDR value is an important deciding factor in such studies. It would be interesting to see, how number of cis-SNPs vary with the change in FDR threshold. In this way FDR criterion can be used to estimate number of SNPs that we may need to consider.

## Declarations

### Acknowledgements

This work is supported by the U.S. National Institutes of Health grants R01 GM74217 (Lang Li) and AHRQ Grant R01HS019818-01 (MalazBoustani)

**Declarations**

The publication costs were funded by the authors through P50 CA113001 (Huang, T.M.), R01 GM088076 (Skaar, T.), R01 HS019818 (Dexter).

This article has been published as part of *BMC Genomics* Volume 14 Supplement 8, 2013: Selected articles from the International Conference on Intelligent Biology and Medicine (ICIBM 2013): Genomics. The full contents of the supplement are available online at http://www.biomedcentral.com/bmcgenomics/supplements/14/S8.

## Authors’ Affiliations

## References

- Liu , Chunyu : Brain expression quantitative trait locus mapping informs genetic studies of psychiatric diseases. Neurosci Bull. 2011, 27 (2): 123-133. 10.1007/s12264-011-1203-5.PubMedPubMed CentralView Article
- Benjamini Y, Hochberg Y: Controlling the false discovery rate: a practical and powerful approach to multiple testing. Journal of the Royal Statistical Society. Series B (Methodological). 1995, 289-300.
- Efron B, Storey J, Tibshirani R: Microarrays, empirical Bayes methods, and false discovery rates. Stanford Technical Report. 2001
- Efron B, Tibshirani R, Storey JD, Tusher V: Empirical Bayes analysis of a microarray experiment. Journal of the American statistical association. 2001, 96 (456): 1151-1160. 10.1198/016214501753382129.View Article
- Efron B, Tibshirani R: Empirical Bayes methods and false discovery rates for microarrays. Genetic epidemiology. 2002, 23 (1): 70-86. 10.1002/gepi.1124.PubMedView Article
- Newton MA, Kendziorski CM, Richmond CS, Blattner FR, Tsui KW: On differential variability of expression ratios: improving statistical inference about gene expression changes from microarray data. Journal of Computational Biology. 2001, 8: 37-52. 10.1089/106652701300099074.PubMedView Article
- Lee MLT, Kuo FC, Whitmore GA, Sklar J: Importance of replication in microarray gene expression studies: statistical methods and evidence from repetitive cDNA hybridizations. Proceedings of the National Academy of Sciences. 2000, 97 (18): 9834-9839. 10.1073/pnas.97.18.9834.View Article
- Kendziorski CM, Zhang Y, Lan H, Attie A: The efficiency of MRNA pooling in microarray experiments. Biostatistics. 2003, 4: 465-477. 10.1093/biostatistics/4.3.465.PubMedView Article
- Kendziorski CM, Newton MA, Lan H, Gould MN: On parametric empirical Bayes methods for comparing multiple groups using replicated gene expression profiles. Stat Med. 2003, 22: 3899-33914. 10.1002/sim.1548.PubMedView Article
- Kendziroski CM, Chen M, Yuan M, Lan H, Attie AD: Statistical methods for expression quantitative trait loci (eQTL) mapping. Biometrics. 2006, 62 (1): 19-27. 10.1111/j.1541-0420.2005.00437.x.View Article
- Gelfond JAL, Ibrahim JG, Zou F: Proximity Model for Expression Quantitative Trait Loci (eQTL) Detection. Biometrics. 2007, 63: 1108-1116. 10.1111/j.1541-0420.2007.00778.x.PubMedView Article
- Lo K, Gottardo R: Flexible empirical Bayes models for differential gene expression. Bioinformatics. 2007, 23 (3): 328-335. 10.1093/bioinformatics/btl612.PubMedView Article
- Sánchez-Linares I, Pérez-Sánchez H, Cecilia JM, García JM: High-Throughput parallel blind Virtual Screening using BINDSURF. BMC Bioinformatics. 2012, 13 (Suppl 14): S13-10.1186/1471-2105-13-S14-S13.PubMedPubMed CentralView Article
- Bergemann TL, Wilson J: Proportion statistics to detect differentially expressed genes: a comparison with log-ratio statistics. BMC Bioinformatics. 2011, 12: 228-10.1186/1471-2105-12-228.PubMedPubMed CentralView Article
- Ruan L, Yuan M: An Empirical Bayes' Approach to Joint Analysis of Multiple Microarray Gene Expression Studies. Biometrics. 2011, 67 (4): 1617-1626. 10.1111/j.1541-0420.2011.01602.x.PubMedView Article
- Efron B, Morris C: Combining possibly related estimation problems (with discussion). Journal of the Royal Statistical Society, Series B. 1973, 35: 379-421.
- Efron B, Morris C: Stein's paradox in statistics. Scientific American. 1977, 236: 119-127. 10.1038/scientificamerican0577-119.View Article
- Bar H, Booth J, Schifano E, Wells MT: Laplace approximated EM microarray analysis: an empirical Bayes approach for comparative microarray experiments. Statistical Science. 2010, 25 (3): 388-407. 10.1214/10-STS339.View Article
- Wright GW, Simon RM: A random variance model for detection of differential gene expression in small microarray experiments. Bioinformatics. 2003, 19: 2448-2455. 10.1093/bioinformatics/btg345.PubMedView Article
- Cui X, Hwang JG, Qiu J, Blades NJ, Churchill GA: Improved statistical tests for differential gene expression by shrinking variance components estimates. Biostatistics. 2005, 6 (1): 59-75. 10.1093/biostatistics/kxh018.PubMedView Article
- Lönnstedt I, Grant S, Begley G, Speed TP: Microarray analysis of two interacting treatments: a linear model and trends in expression over time. 2001, Technical Report, Department of Mathematics, Uppsala University, Sweden
- Tai YC, Speed TP: A multivariate empirical Bayes statistic for replicated microarray time course data. The Annals of Statistics. 2006, 34 (5): 2387-2412. 10.1214/009053606000000759.View Article
- Lonnstedt I, Speed T: Replicated microarray data. StatisticaSinica. 2002, 12: 31-46.
- Newton MA, Kendziorski CM: Parametric empirical Bayes methods for microarrays. The analysis of gene expression data: methods and software. 2003, 254-271.View Article
- Liu C, Rubin DB: The ECME algorithm: a simple extension of EM and ECM with faster monotone convergence. Biometrika. 1994, 81 (4): 633-648. 10.1093/biomet/81.4.633.View Article
- Cui X, Churchill GA: Statistical tests for differential expression in cDNA microarray experiments. Genome Biol. 2003, 4 (4): 210-10.1186/gb-2003-4-4-210.PubMedPubMed CentralView Article
- Noma H, Matsui S: The optimal discovery procedure in multiple significance testing: an empirical Bayes approach. Statistics in Medicine. 2012, 31 (2): 165-176. 10.1002/sim.4375.PubMedView Article
- Efron B: Robbins, empirical Bayes and microarrays. The annals of Statistics. 2003, 31 (2): 366-378. 10.1214/aos/1051027871.View Article
- Lange KL, Little RJ, Taylor JM: Robust statistical modeling using the t distribution. Journal of the American Statistical Association. 1989, 84 (408): 881-896.
- Liu C, Rubin DB: The ECME algorithm: a simple extension of EM and ECM with faster monotone convergence. Biometrika. 1994, 81 (4): 633-648. 10.1093/biomet/81.4.633.View Article
- Meng XL, Rubin DB: Maximum likelihood estimation via the ECM algorithm: A general framework. Biometrika. 1993, 80 (2): 267-278. 10.1093/biomet/80.2.267.View Article
- McLachlan G, Krishnan T: The EM Algorithm and Extensions. Wiley Series in Probability and Statistics. 1997
- Yang X, Zhang B, Lum PY: Systematic genetic and genomic analysis of cytochrome P450 enzyme activities in human liver. Genome Research. 2010, 20 (8): 1020-1036. 10.1101/gr.103341.109.PubMedPubMed CentralView Article

## Copyright

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.