 Research article
 Open Access
 Published:
Comparison of similaritybased tests and pooling strategies for rare variants
BMC Genomics volume 14, Article number: 50 (2013)
Abstract
Background
As several rare genomic variants have been shown to affect common phenotypes, rare variants association analysis has received considerable attention. Several efficient association tests using genotype and phenotype similarity measures have been proposed in the literature. The major advantages of similaritybased tests are their ability to accommodate multiple types of DNA variations within one association test, and to account for the possible interaction within a region. However, not much work has been done to compare the performance of similaritybased tests on rare variants association scenarios, especially when applied with different rare variants pooling strategies.
Results
Based on the population genetics simulations and analysis of a publiclyavailable sequencing data set, we compared the performance of four similaritybased tests and two rare variants pooling strategies. We showed that weighting approach outperforms collapsing under the presence of strong effect from rare variants and under the presence of moderate effect from common variants, whereas collapsing of rare variants is preferable when common variants possess a strong effect. We also demonstrated that the difference in statistical power between the two pooling strategies may be substantial. The results also highlighted consistently high power of two similaritybased approaches when applied with an appropriate pooling strategy.
Conclusions
Population genetics simulations and sequencing data set analysis showed high power of two similaritybased tests and a substantial difference in power between the two pooling strategies.
Background
Although genomewide association studies (GWAS) have identified many common single nucleotide polymorphisms (SNPs) associated with common diseases (http://www.genome.gov/gwastudies/), these common variants explain only a small fraction of the phenotypic variance attributable to genetic factors[1, 2]. Recently, the scientific community has devoted a lot of attention to the analysis of rare variants, with the hope of finding the missing heritability. Indeed, there is growing evidence that rare variants are associated with some complex traits[3–6]. Therefore, research in the area of rare variants has a high potential to discover unknown associations of genomic regions with complex phenotypes. Numerous methodologies have been developed to test association of multiple rare variants within a region with a phenotype[7–11].
Measures of genotype similarity have been the basis of many proposed statistical tests. The idea of similaritybased tests is to consider the relationship between genotypic and phenotypic similarities (similarity here roughly refers to a measure of closeness of two genotypes or phenotypes). Similaritybased tests are motivated by the fact that haplotypes carrying the same causal mutation are more related compared with those without causal mutations; so, case haplotypes are expected to share longer stretches of DNA identical by descent[12]. One of the major advantages of similaritybased tests is the ability to accommodate multiple types of DNA variations (SNPs, insertions and deletions, CNV) observed within a region, given flexibility in the choice of similarity measures between two sequences[13]. Another issue that similaritybased tests address is the possible interaction of different variants within a region, which is potentially accounted for by considering multisite similarity measures[14]. For unrelated individuals, similarity measures have been incorporated within a framework of single SNP analysis of variance[15], multiple regression[16], Ustatistic[17] and distancebased regression[14]. Methods based on genotype similarity include the following: sequence kernel association test (SKAT)[11]; kernelbased association test (KBAT)[18], multivariate distance matrix regression test (MDMR)[19]; and aggregate Utest[20]. However, so far, no attempts have been made to evaluate the performance of similaritybased tests on rare variants association scenarios when common variants are included into or excluded from the analysis. Even though many noncausal common SNPs are removed by considering only rare variants, it is unclear if consideration of fewer variants would be sufficient to compensate for the loss of association signal from common SNPs. Also, when both rare and common variants are included into the analysis, it is of interest to evaluate the change in the performance of the tests when rare variants have lower effect sizes than common SNPs. Additionally, statistical tests may utilize different pooling strategies for rare variants, e.g. weighting or collapsing. Given the choice, it is unclear which pooling strategy is the best to be applied with similaritybased tests.
In this article, we compared the performance of the four similaritybased tests (SKAT, KBAT, MDMR and a modified Utest proposed by Schaid et al.[17]) applied with two popular rare variants pooling strategies (weighting and collapsing). The comparison was performed based on populationgenetics simulations under four different disease models and the GAW17 sequencing data set. The results highlighted that, under the presence of strong rare variants association signal and moderate association of common variants, weighting may be a much better strategy than collapsing, whereas collapsing tends to outperform weighting when common variants possess a strong effect. Moreover, we discovered that the magnitude of the difference in power among similaritybased methods, when applied with weighting and collapsing strategies, may be very high, sometimes over 50%. Under the strong effect size of rare variants when common variants were excluded from the analysis, we observed better performance of collapsing strategy and lower power of weighting pooling strategy. Also, when the appropriate pooling strategy is applied, both SKAT and KBAT showed consistently high power among all the four similaritybased tests compared here.
Results
Population genetic simulations
For each test, 1000 permutations were performed to assess the significance of association. To make sure the empirical type1 error is controlled, we ran the analysis of simulated data under the null model. As can be seen from Additional file1: Table S1, the type1 error was well controlled by using the permutation procedure to estimate the significance level. It is noticeable that for “Risk Rare” scenario when weighting pooling strategy is applied and for “Risk Common” scenario the estimates of type1 error are below 0.05. This suggests that in these cases the methods show slightly conservative behavior. The doublesided 99% confidence interval for the type1 error estimate is approximately 0.033–0.67. This can be derived from the normal approximation, given that the estimate of type1 error rate is distributed as an observed probability of success for a binomial random variable with a success probability of 0.05 under no inflation of type1 error and the sample size of 1000, which is the number of data replicates. As can be seen, the empirical type1 error estimates for population genetics simulations were within the 99% confidence interval.
Figure 1 shows the power of the four tests with collapsing and weighting pooling strategies under different association scenarios. As can be seen from Panel 1 (“Risk Rare” scenario), the power of the tests was in the following order: for collapsing MDMR performed no worse than SKAT but no better than Utest, which in turn had lower power compared to KBAT; for weighting, MDMR performed worse than KBAT, and KBAT was no more powerful than SKAT, whereas Utest was the most powerful among all the four tests considered. Also, weighting increased the power of all the tests, except for MDMR. The same situation was observed when a weak association signal from common variants was introduced, together with weaker signal from rare variants (“Risk Both” scenario in Panel 2 of Figure 1). The performance of the tests when rare variants had lower effect compared with common variants (“Risk Common” scenario) is presented in Panel 3 of Figure 1. As can be seen, the pattern is different from those observed for the previous two scenarios. For all the tests, the collapsing strategy performed better than weighting. These results suggest that weighting outperforms collapsing when strong rare variants association is present; however, when common variants explain a significant portion of phenotype variability, collapsing is more advantageous since the weighting scheme undermines the signal from common variants.
Finally, we investigated the performance of the tests in the “Mixed Rare” scenario which incorporated both risk and protective variants within a region (Figure 1, Panel 4). As expected, collapsing underperformed weighting pooling strategy because collapsing risk and protective variants annihilates the association signal. Overall, the simulation results highlighted the consistently high power of KBAT and SKAT when the appropriate rare variants pooling strategy was applied (namely, collapsing for “Risk Common” scenario, and weighting for other scenarios). Although these two tests had slightly lower power compared to the Utest for “Risk Rare” and “Risk Both” scenarios, they had much higher power for the other two scenarios. Additionally, we calculated the maximum absolute power difference over the type1 error rate for each test and phenotype scenario. As can be seen from Table 1, the maximum absolute power difference was substantial, and ranged from as low as 10% to as high as 55%. The average maximum absolute power difference for the considered tests across the phenotype models were 39.8%, 43.9%, 25.8% and 31.8% for MDMR, SKAT, KBAT and Utest respectively. This result shows the extreme importance of choosing the right rare variants pooling strategy for different disease models. As in our simulations no adjustment for population stratification was made, we analyzed the data using another popular similarity measure: identitybystate[14]. The results were similar to those obtained for exponential similarity (Additional file2).
We also analyzed the simulated data after excluding all common variants defined as those with MAF > 1% (Figure 2). Since all common variants were excluded, association tests under collapsing were performed only on a collapsed superlocus. In contrast to the previous results, for “Risk Rare” and “Risk Both” scenarios, collapsing performed better and weighting performed worse. For the collapsing strategy, the reduction in the number of SNPs was beneficial despite the loss of association signal from the excluded common SNPs. However, for the weighting pooling strategy, the loss of some of the causal variants with MAF above 1% lowered the statistical power of the tests. Hence, the results suggest that under strong rare variants effect size in one direction, one should prefer collapsing to weighting when common variants are excluded from an association test. For the “Risk Common” scenario, the power of all the tests and all pooling strategies was lower, as the strong association signal from common variants had been removed. For the “Mixed Rare” scenario, we observed that the results were similar to those depicted in Figure 1. Also, it is notable that across the four scenarios, the performances of the four tests were very similar under the collapsing strategy. This suggests that for a single SNP analysis, the power of the four tests is very similar to one another.
GAW17 data set
The GAW17 data set is a large scale exome sequencing data set with genotypes from the 1000 Genomes Project (http://www.1000genomes.org). The dataset consists of 697 unrelated individuals from six populations (Centre d'Etude du Polymorphisme Humain (CEPH) samples, Tuscan, Chinese, Japanese, Yoruba and Luhya). The complex phenotype model incorporates environmental covariates (age, sex and smoking status) and both common and rare causal SNPs from genes in particular pathways. Totally 200 replicates of several quantitative traits and case–control status were simulated under the phenotype model. A more detailed description of the simulations can be found in Almasy et al.[21].
We performed an association analysis of causal genes that affect two quantitative traits, Q_{1} and Q_{2}, and a dichotomous trait, D. Adjustment for covariates was done in a similar way as in Jiang et al.[22]. Let G be the genotype matrix, Q_{ j, }j = 1, 2 are vectors of two quantitative traits, E_{ i }i = 1, 2, 3, are vectors of covariates (age, sex and smoking status, respectively), and R is the matrix of ten principal components of genotype matrix obtained using the software Eigenstat[23]. The corrected genotype, phenotypes and covariates are\stackrel{\u2323}{\mathit{G}}=GR{R}^{T}D,\tilde{Q}j={Q}_{j}R{R}^{T}{Q}_{j},\phantom{\rule{0.5em}{0ex}}j=1,2,\tilde{\mathit{D}}=DR{R}^{T}D and ˜E_{ i } = E_{ i }RR^{T}E_{ i }, i = 1,2,3. Next, covariates are regressed out of adjusted phenotypes using the regression models:
The residuals from the regression models (1) were dichotomized (upper 30% of the observed distribution were declared cases, while the others were controls) and tested for association with adjusted genotype Ğ of the causal genes. The type1 error was set at 0.05, and 1000 permutations were performed for each of the 200 phenotype replicates to assess the power. To assess the empirical type1 error rate for all the statistical tests, we ran the analysis with randomly permuted adjusted phenotypes obtained from the regressions (1). The resulting type1 error rates are presented in Additional files3 and4. The doublesided 99% confidence interval for the type1 error estimate is approximately 0.01–0.09. This can be derived from the normal approximation, given that the estimate of type1 error rate is distributed as an observed probability of success for a binomial random variable with a success probability of 0.05 under no inflation of type1 error and the sample size of 200, which is the number of phenotype replicates. As can be seen, the empirical type1 error for GAW17 data was within the 99% confidence interval.
Figure 3 depicts the results of the analysis of the causal genes with the respective phenotypes (ARNTVEGFC with Q1, and BCHEVWF with Q2). For the majority of genes with rare causal variants, the weighting strategy, on average, performed better than collapsing (except for MDMR). For example, the weighing strategy resulted in substantial power improvement for the genes ARNT, SIRT1, VNN3 and VWF. All of these genes contained multiple causal rare variants with a moderate or high effect size. However, collapsing yielded a much higher power for ELAVL4 and VNN1 genes. Closer examination revealed that the two most common SNPs in the VNN1 gene were causal, whereas association with the ELAVL4 gene could be explained by association of the only two common SNPs that were noncausal. To show this, we analyzed these two common SNPs with the four similaritybased tests and found that the power to identify an association with a phenotype was as follows: MDMR – 0.6, SKAT – 0.585, KBAT – 0.135, Utest – 0.095. The results of the dichotomous phenotype analysis are presented in the Additional files5 and6. Among genes with maximum achieved power of greater than 40% for at least one of the tests, weighting was advantageous for the ARNT gene, whereas collapsing yielded higher power for FLT1 and PRKCA, which both contained common causal SNPs. So, the results of the GAW17 data set support the conclusion derived from population genetics simulations concerning pooling strategies. We also considered the maximum absolute difference in power between weighting and collapsing for each statistical test and each GAW17 phenotype (Q1, Q2 and dichotomous trait) over the respective causal genes. As can be seen from Table 2, the maximum absolute power difference ranged from 14.5% (Utest) to 84% (MDMR). The average maximum power differences across phenotypes were 73.8%, 45.6%, 35.6% and 40.5% for MDMR, SKAT, KBAT and Utest, respectively. This observation confirms the results obtained from our population genetics simulations and highlights the importance of the right choice of rare variants pooling strategy in sequencing association studies.
Discussion
In this article, we compared the performance of the four similaritybased tests together with two rare variants pooling strategies using population genetics simulations and the GAW17 real data set. The results suggest that weighting may be a much better strategy than collapsing under the assumption of strong effect from rare variants, and moderate or low effect from common variants. Collapsing, in turn, showed much better performance when common variants possessed a strong effect. The absolute power difference of a statistical test when applied with collapsing and weighting pooling strategies may be substantial. From our study, it follows that if researchers are inclined to believe in the association of rare variants within a region, weighted pooling should be applied with similaritybased tests, whereas collapsing is more appropriate if common variants are suspected to be associated with phenotype. Additionally, under strong rare variants effect size in one direction when common variants were excluded from the analysis, collapsing performed equally good or better than weighting. Finally, both SKAT and KBAT had consistently high power compared with other considered similaritybased tests when applied with the appropriate pooling strategy.
Recently, Basu and Pan[24] compared the performance of multiple statistical tests to identify an association with rare variants. The authors included SKAT with unweighted linear and quadratic kernels as one of the testing strategies. Based on the results, Basu and Pan[24] concluded that SKAT was powerful compared with other methods when only rare variants were considered. However, the authors found that the method lost its high power when neutral common variants were added. Our results suggest that using weighted kernels in SKAT may preserve high power to identify an association with rare variants even if multiple neutral common variants are included into the analysis. However, since we compared the performance of similaritybased tests, additional investigation is required to compare weighted similaritybased tests with other statistical strategies, including those considered in Basu and Pan[24].
From our results, the MDMR test does not seem to perform well when applied with weighting pooling strategy. To have a more detailed picture, we applied weighted MDMR test to the “Risk Rare” data sets with modified weights w_{ l }^{p}, l = 1, … L, where the power value p varied from 0 to 1. So, p = 1 corresponded to the beta weights applied in our study, whereas p = 0 corresponded to the analysis without weights. Additional file7 shows the power surface as a function of significance level and a value of p. It is clear that for all significance levels, the power of MDMR monotonically decreased with higher values of p, which corresponded to higher relative weights for rare variants. In the Additional file1, we proved that when the number of cases equals the number of controls (like in our simulations), SKAT and MDMR test statistics are equivalent to the sum of, and the sum of squares of dissimilarities for all case–control pairs respectively. When weighting pooling strategy is applied, dissimilarity tends to be relatively large for pairs of individuals whose genotypes differ in multiple rare minor alleles. Squaring dissimilarity measure puts much more emphasis on pairs with a larger dissimilarity. Thus, the magnitude of the MDMR test statistic may be completely defined by the number of case–control pairs whose genotypes differ by at least two rare minor alleles. We suppose that pairs with a difference of one rare allele may not have sufficient dissimilarity to significantly influence the MDMR test statistic, which leads to a loss of power. To illustrate our reasoning, let us have two rare variants with only eight observed minor alleles each across 500 cases and 500 controls. To simplify the description, assume that individuals have either zero or one copy of a minor allele across the two variants. Also, we will use the equivalence of the MDMR test statistic to the sum of squared case–control dissimilarities. Consider the following cases under the null and alternative hypotheses, respectively: cases and controls have four minor alleles for each variant, and cases have all minor alleles. Under the alternative hypothesis, we have zero case–control pairs with a difference of two alleles across genotype, whereas under the null hypothesis, we have 32. However, under the alternative hypothesis, there are 16 × 500 case–control pairs with a difference of one minor allele, whereas under the null hypothesis, there are only 16 × (500–8). Now it becomes clear that if the dissimilarity of pairs of individuals with a difference of two alleles is large enough relative to the dissimilarity of pairs of individuals with a difference of only one allele, the MDMR test statistic may become lower compared to the null test statistic. The consideration above explains the low performance of MDMR with weighted similarity and the fact that for the “Risk Rare” scenario, the power of MDMR test was below type1 error rate.
One limitation of the current study is that the minimum significance level in population genetics simulations was 0.001. For genomewide significance, the number of permutations needed to reliably estimate the significance is very large. This makes the comparison of the similaritybased tests at the genomewide level prohibitive. In real GWAS studies, only few highlysignificant genes will require a very large number of permutations to estimate pvalues, as many genes with low or no association signal can be dropped out after a few thousand permutations. For highly significant genes, permutation procedure can be split into several parts and performed in parallel on a cluster.
Conclusions
The performance of similaritybased tests applied with two rare variants pooling strategies was investigated. Population genetics simulations and sequencing data set analysis showed consistently high power of two similaritybased tests and a substantial difference in performance of the two rare variants pooling strategies.
Methods
Similaritybased tests
Assume that an association study involves N individuals (N^{A} cases and N^{U} controls), and within a genomic region L SNPs (both common and rare) were called. Let us denote the genotype matrix G = {g_{ nl }, n = 1,…,N l = 1,…,L} coded as minor allele counts, and the phenotype vector Y = {y_{ n }, n = 1,…,N} with the elements valued 1 for cases and −1 for controls (except when otherwise specified). The N × N similarity matrix is defined as K = {s(g_{ n }, g_{ m })}_{n,m = 1}^{N}, where g_{ n } is a multisite vector of genotype {g_{1n},…,g_{Ln}} for n th individual, and s (x,y) is a similarity function. There is a variety of examples of similarity functions published in statistical genetics literature (for examples, see Wu et al.[11], Wessel and Shork[14], and Mukhopadhyay et al.[25]). However, it is desirable for the similarity matrix K to be symmetric positive semidefinite as this is “the key to its use in many statistical analyses”[26]. Thus, we consider only those similarity measures that result in a positive definite similarity matrix. Examples of such similarity measures are the weighted linear kernel s(g_{ n }, g_{ m }) = ∑ _{l = 1}^{L}w_{ l }g_{ nl }g_{ ml } for some fixed weights w_{ l },l = 1,…,L the weighted quadratic kernel s(g_{ n }, g_{ m }) = (1 + ∑ _{ l }^{L}w_{ l }g_{ nl }g_{ ml })^{2}, and the weighted IBS kernel s(g_{ n }, g_{ m }) = ∑ _{l = 1}^{L}w_{ l }(2 − g_{ nl } − g_{ ml }). For our analysis, a popular exponential similarity measure[27] was used:
The choice of similarity was motivated by the need to analyze quantitative genotype obtained as a result of population stratification adjustment (see Results section). As the exponential similarity is a function of the Euclidean distance between two multisite genotypes, we consider this similarity to be more appropriate compared with, for example, another popular similarity measure, identitybystate[17], which was designed to be applied to genotype codes.
Weighting and collapsing
Here we consider the two major ways of rare variants pooling: weighting and collapsing. The SNP weights will be denoted as w = {w_{ l }, l = 1,…,L}. In general, they may be derived from observed minor allele frequency (MAF) or prior information. Here, we adopted the weights proposed by Wu et al.[11]: w_{ l } = Beta(maf_{ l }; 1, 25)^{2}, where maf_{ l } is MAF of l th SNP, Beta (a; b, c) is the beta density distribution function with parameters b and c evaluated at point a. The weight function monotonically increases as MAF decreases, while, as noted by the authors, “putting decent nonzero weights for variants with MAF 1%–5%”. As noted by Wu et al.[11], setting 0 ≤ b ≤ 1 and c ≥ 1 allows for an increase in the weight of rare variants and a decrease in the weight of common variants. Thus, any values of parameters and from the specified range are acceptable. For the three tests (SKAT, MDMR and Utest), the weights are incorporated via the calculation of similarity matrix. Specifically, the weights incorporating similarity function s_{w} for the similarity matrix K_{ w } is as follows:
For the KBAT test statistic, the weights were incorporated differently (for details, see the description below) as the test does not use the multisite genotype similarity.
The collapsing of rare variants was performed as described in Thalamuthu et al.[18], namely, by defining a superlocus g_{ n(L+1) },n = 1,…,N as follows:
In general, this type of collapsing preserves more information than an indicator of at least one rare variant being present, as suggested by Li and Leal[28]. The collapsed genotype is treated as a new SNP (superlocus) g_{ n(L+1) },n = 1,…,N, and a similarity matrix is constructed using common variants and the superlocus.
Multivariate distance matrix regression (MDMR)
Let us denote N x N identity matrix 1_{ N } and a vector of 1 of size N as 1_{ N }. Following Wessel and Schork[14], the test statistic is calculated according to the algorithm:

1.
Phenotype projection matrix H = Y(Y ^{T} Y) ^{1} Y ^{T}, where upper T denotes transposition.

2.
Dissimilarity matrix D = {d _{ ij }}_{i,j = 1} ^{N} = 1_{ N }1_{ N } ^{T} − K, where K is a similarity matrix defined above.

3.
Gover’s centered matrix G = (1_{ N } − 1_{ N }1_{ N } ^{T}/N)A(I _{ N } − 1_{ N }1_{ N } ^{T}/N), where A={\left\{\frac{{\text{d}}_{\mathrm{ij}}^{2}}{2}\right\}}_{\text{i},\text{j}=1}^{\text{N}}.

4.
The test statistic MDMR = tr(HGH)/tr((I _{ N } − H)G(I _{ N } − H)), where tr is matrix trace.
Large values of the test statistic indicate a deviation from the null hypothesis of no association of a genotype with a phenotype.
Sequence kernel association test (SKAT)
For this test, the phenotype vector Y = {y_{n},n = 1,…,N} is coded as 1 for cases and 0 for controls. The mean phenotype vector is defined as\overline{Y}={N}^{A}{1}_{N}/N. Following Wu et al.[11], the test statistic is\mathit{T}={\left(Y\overline{Y}\right)}^{T}K\left(Y\overline{Y}\right)/2. The SKAT test statistic under the null hypothesis is asymptotically distributed as the weighted sum of chisquared random variables with one degree of freedom. Thus, the significance level can be assessed theoretically. Permutations can also be used to estimate the pvalue empirically.
Utest
The average similarity score between pairs of cases U_{ 1 } and controls U_{ 0 } is defined as follows:
where K_{ nm }, n, m = 1,…,N are the elements of the K similarity matrix (K = {K_{ nm }}_{n,m = 1}^{N}). The Utest statistic is defined as U = (U_{1} − U_{0})^{2}. Note that Shaid et al.[17] considered the weighted sum of the single SNP Utest statistics, where weights were derived from the asymptotic variancecovariance matrix of the U statistics vector. However, for the purpose of comparison of weighting and collapsing rare variants pooling methods, the statistic was modified as described above. The test statistic U is similar to the single SNP Utest statistic proposed by Shaid et al.[17], but it incorporates the similarity information across multiple variants within a region. Permutations need to be applied to assess the pvalue.
Kernelbased association test (KBAT)
Let us denote K_{ l } = {(K_{ l })_{ nm }}_{n,m = 1}^{N} as a single SNPs similarity matrix for l th variant. Similar to the notations of the Utest subsection, Ul_{ 1 } and Ul_{ 0 } are the average similarity scores for pairs of cases and controls, respectively, calculated from K_{ l }, and let U_{ l } = (U_{l 1} + U_{l 0})/2. Following Mukhopadhyay et al.[15], consider the withingroup and betweengroup sum of squares:
where the two groups are casecase and controlcontrol pairs. The test statistic is KBAT = ∑ _{l = 1}^{L}BSS_{ l }/∑_{l = 1}^{L}WSS_{ l }. Since the test does not utilize the multisite similarity matrix, but only single SNP matrices K_{ l }, the weighted test statistic KBAT_{ W } = ∑ _{l = 1}^{L}w_{ l }BSS_{ l }/∑_{l = 1}^{L}w_{ l }WSS_{ l } is used here. A large value of the KBAT statistic indicates a deviation from the null hypothesis. Permutations are used to assess the significance.
Population genetics simulations
Population genetics simulations were performed based on the code provided by King et al.[29] with demographic parameters from Boyko et al.[30]. A total of 1000 data replicates were generated for each of the four phenotype models: “Risk Rare”, “Risk Both”, “Risk Common” and “Mixed Rare”. For a detailed description of the simulations, see Additional file1.
References
Hirschhorn JN, Gajdos ZKZ: Genomewide association studies: results from the first Few years and potential implications for clinical medicine. Annu Rev Med. 2011, 62 (1): 1124. 10.1146/annurev.med.091708.162036.
Maher B: Personal genomes: the case of the missing heritability. Nature. 2008, 456: 1821.
Green EK, Grozeva D, Sims R, Raybould R, Forty L, GordonSmith K, Russell E, St Clair D, Young AH, Ferrier IN: DISC1 exon 11 rare variants found more commonly in schizoaffective spectrum cases than controls. Am J Med Genet B Neuropsychiatr Genet. 2011, 156 (4): 490492. 10.1002/ajmg.b.31187.
Norton N, Li D, Rieder Mark J, Siegfried Jill D, Rampersaud E, Züchner S, Mangos S, GonzalezQuintana J, Wang L, McGee S: Genomewide studies of copy number variation and exome sequencing identify rare variants in BAG3 as a cause of dilated cardiomyopathy. Am J Hum Genet. 2011, 88 (3): 273282. 10.1016/j.ajhg.2011.01.016.
Ramagopalan SV, Dyment DA, Cader MZ, Morrison KM, Disanto G, Morahan JM, BerlangaTaylor AJ, Handel A, De Luca GC, Sadovnick AD: Rare variants in the CYP27B1 gene are associated with multiple sclerosis. Ann Neurol. 2011, 70 (6): 881886. 10.1002/ana.22678.
Xie P, Kranzler HR, Krauthammer M, Cosgrove KP, Oslin D, Anton RF, Farrer LA, Picciotto MR, Krystal JH, Zhao H: Rare nonsynonymous variants in alpha4 nicotinic acetylcholine receptor gene protect against nicotine dependence. Biol Psychiatry. 2011, 70 (6): 528536. 10.1016/j.biopsych.2011.04.017.
Bansal V, Libiger O, Torkamani A, Shork JN: Statistical analysis strategies for association studies involving rare variants. Nat Rev Genet. 2011, 11: 773785.
Li Y, Byrnes AE, Li M: To identify associations with rare variants, just WHaIT: weighted haplotype and imputationbased tests. Am J Hum Genet. 2010, 87 (5): 728735. 10.1016/j.ajhg.2010.10.014.
Madsen BE, Browning SR: A groupwise association test for rare mutations using a weighted Sum statistic. PLoS Genet. 2009, 5 (2): e100038410.1371/journal.pgen.1000384.
Neale BM, Rivas MA, Voight BF, Altshuler D, Devlin B, OrhoMelander M, Kathiresan S, Purcell SM, Roeder K, Daly MJ: Testing for an unusual distribution of rare variants. PLoS Genet. 2011, 7 (3): e100132210.1371/journal.pgen.1001322.
Wu Michael C, Lee S, Cai T, Li Y, Boehnke M, Lin X: Rarevariant association testing for sequencing data with the sequence kernel association test. Am J Hum Genet. 2011, 89 (1): 8293. 10.1016/j.ajhg.2011.05.029.
Beckmann L, Thomas DC, Fischer C, ChangClaude J: Haplotype sharing analysis using mantel statistics. Hum Hered. 2005, 59 (2): 6778. 10.1159/000085221.
Schork NJ, Wessel J, Malo N: DNA Sequence‐Based Phenotypic Association Analysis. Advances in Genetics. Edited by: Rao DC, Gu CC. 2008, Volume 60: Academic Press, 195217.
Wessel J, Schork NJ: Generalized genomic distance based regression methodology for multilocus association analysis. Am J Hum Genet. 2006, 79 (5): 792806. 10.1086/508346.
Mukhopadhyay I, Feingold E, Weeks DE, Thalamuthu A: Association tests using kernelbased measures of multilocus genotype similarity between individuals. Genet Epidemiol. 2010, 34 (3): 213221.
Kwee LC, Liu D, Lin X, Ghosh D, Epstein MP: A powerful and flexible multilocus association test for quantitative traits. Am J Hum Genet. 2008, 82 (2): 386397. 10.1016/j.ajhg.2007.10.010.
Schaid DJ, McDonnell SK, Hebbring SJ, Cunningham JM, Thibodeau SN: Nonparametric tests of association of multiple genes with human disease. Am J Hum Genet. 2005, 76 (5): 780793. 10.1086/429838.
Thalamuthu A, Zhao J, Keong G, Kondragunta V, Mukhopadhyay I: Association tests for rare and common variants based on genotypic and phenotypic measures of similarity between individuals. BMC Proc. 2011, 5 (Suppl 9): S8910.1186/175365615S9S89.
Chung D, Zhang Q, Kraja A, Borecki I, Province M: Distancebased phenotypic association analysis of DNA sequence data. BMC Proc. 2011, 5 (Suppl 9): S5410.1186/175365615S9S54.
Li M, Fu W, Lu Q: An aggregating UTest for a genetic association study of quantitative traits. BMC Proc. 2011, 5 (Suppl 9): S2310.1186/175365615S9S23.
Almasy L, Dyer T, Peralta J, Kent J, Charlesworth J, Curran J, Blangero J: Genetic analysis workshop 17 miniexome simulation. BMC Proc. 2011, 5 (Suppl 9): S210.1186/175365615S9S2.
Jiang R, Dong J: Detecting rare functional variants using a waveletbased test on quantitative and qualitative traits. BMC Proc. 2011, 5 (Suppl 9): S7010.1186/175365615S9S70.
Price AL, Patterson NJ, Plenge RM, Weinblatt ME, Shadick NA, Reich D: Principal components analysis corrects for stratification in genomewide association studies. Nat Genet. 2006, 38 (8): 904909. 10.1038/ng1847.
Basu S, Pan W: Comparison of statistical tests for disease association with rare variants. Genet Epidemiol. 2011, 35 (7): 606619. 10.1002/gepi.20609.
Mukhopadhyay I, Feingold E, Weeks DE, Thalamuthu A: Association tests using kernelbased measures of multilocus genotype similarity between individuals. Genet Epidemiol. 2009, 34 (3): 213221.
Schaid DJ: Genomic similarity and kernel methods I: advancements by building on mathematical and statistical foundations. Hum Hered. 2010, 70 (2): 109131. 10.1159/000312641.
Wu MC, Kraft P, Epstein MP, Taylor DM, Chanock SJ, Hunter DJ, Lin X: Powerful SNPSet analysis for case–control genomewide association studies. Am J Hum Genet. 2010, 86 (6): 929942. 10.1016/j.ajhg.2010.05.002.
Li B, Leal SM: Methods for detecting associations with rare variants for common diseases: application to analysis of sequence data. Am J Hum Genet. 2008, 83 (3): 311321. 10.1016/j.ajhg.2008.06.024.
King CR, Rathouz PJ, Nicolae DL: An evolutionary framework for association testing in resequencing studies. PLoS Genet. 2010, 6 (11): e100120210.1371/journal.pgen.1001202.
Boyko AR, Williamson SH, Indap AR, Degenhardt JD, Hernandez RD, Lohmueller KE, Adams MD, Schmidt S, Sninsky JJ, Sunyaev SR: Assessing the evolutionary impact of amino acid mutations in the human genome. PLoS Genet. 2008, 4 (5): e100008310.1371/journal.pgen.1000083.
Acknowledgements
We would like to thank the workshop organizers of GAW17 for their permission to use their data in our research. The preparation of the Genetic Analysis Workshop 17 Simulated Exome Data Set was supported by a GAW grant, R01 GM031575, and in part by NIH R01 MH059490, and used sequencing data from the 1000 Genomes Project (http://www.1000genomes.org).
Funding: This work was supported by the Agency for Science, Technology and Research (A*STAR; Singapore). The first author is a recipient of the Singapore International Graduate Award.
Author information
Authors and Affiliations
Corresponding authors
Additional information
Competing interests
The authors declare that they have no competing interests.
Authors’ contributions
SZ, AS and AT conceived the study. SZ and AT designed the experiments. SZ conducted the experiments and performed the analysis. SZ wrote the manuscript. SZ, AS and AT approved the manuscript.
Electronic supplementary material
12864_2012_4807_MOESM1_ESM.doc
Additional file 1:Empirical type1 error estimate for population genetics simulations (Table S1), detailed description of population genetics simulations, and considerations for possible reasons for MDMR power loss when applied with weighting pooling strategy.(DOC 842 KB)
12864_2012_4807_MOESM2_ESM.pdf
Additional file 2:Power as a function of significance level for the four similaritybased tests with IBS kernels and two rare variants pooling strategies. Panel 1: “Risk Rare” Scenario; Panel 2: “Risk Both” Scenario; Panel 3: “Risk Common” Scenario; Panel 4: “Mixed Rare” Scenario. (PDF 490 KB)
12864_2012_4807_MOESM3_ESM.pdf
Additional file 3:Empirical type1 error rates for dichotomized adjusted quantitative phenotype in GAW17 data set at the theoretical level of 0.05 (ARNTVEGFC with Q1, and BCHEVWF with Q2).(PDF 592 KB)
12864_2012_4807_MOESM4_ESM.pdf
Additional file 4:Empirical type1 error rates for dichotomized adjusted case–control status in GAW17 data set at the theoretical level of 0.05.(PDF 467 KB)
12864_2012_4807_MOESM5_ESM.pdf
Additional file 5:Power to identify an association with dichotomized adjusted case–control status in GAW17 data set for some of the causal genes.(PDF 325 KB)
12864_2012_4807_MOESM6_ESM.pdf
Additional file 6:Power to identify an association with dichotomized adjusted case–control status in GAW17 data set for some of the causal genes.(PDF 308 KB)
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
Rights and permissions
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
About this article
Cite this article
Zakharov, S., Salim, A. & Thalamuthu, A. Comparison of similaritybased tests and pooling strategies for rare variants. BMC Genomics 14, 50 (2013). https://doi.org/10.1186/147121641450
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/147121641450
Keywords
 Genetics
 Similarity
 Power
 Multilocus
 Association analysis
 Rare variants
 Collapsing
 Weighting