Estimating DNA polymorphism from next generation sequencing data with high error rate by dual sequencing applications
© He et al.; licensee BioMed Central Ltd. 2013
Received: 18 January 2013
Accepted: 3 August 2013
Published: 7 August 2013
As the error rate is high and the distribution of errors across sites is non-uniform in next generation sequencing (NGS) data, it has been a challenge to estimate DNA polymorphism (θ) accurately from NGS data.
By computer simulations, we compare the two methods of data acquisition - sequencing each diploid individual separately and sequencing the pooled sample. Under the current NGS error rate, sequencing each individual separately offers little advantage unless the coverage per individual is high (>20X). We hence propose a new method for estimating θ from pooled samples that have been subjected to two separate rounds of DNA sequencing. Since errors from the two sequencing applications are usually non-overlapping, it is possible to separate low frequency polymorphisms from sequencing errors. Simulation results show that the dual applications method is reliable even when the error rate is high and θ is low.
In studies of natural populations where the sequencing coverage is usually modest (~2X per individual), the dual applications method on pooled samples should be a reasonable choice.
KeywordsNext generation sequencing DNA polymorphism Sequencing error Pooled sample Dual sequencing applications
The next generation sequencing (NGS) technologies have dramatically increased the throughput. The new technologies, including those being developed currently, improve on many aspects of DNA sequencing but a higher accuracy than the traditional Sanger sequencing does not appear to be one of them. The nature of the technology would result in specific types of sequencing errors inherent in each process. In general, the new sequencing methods have an error rate between 0.1% and 1.0% . Due to the non-random distribution of errors across sites where some sites can be 10 times more error prone than the average, single nucleotide polymorphism (SNP) calling can often be difficult [2–4].
In this study, we are concerned with estimating a fundamental parameter of natural populations, namely, Watterson's θ of DNA polymorphism . Briefly, θ is the number of nucleotide differences between two sequences of the same locus, randomly chosen from the population. It is a good measure of genetic diversity and a basic parameter for doing population genetic analysis (e.g. tests of positive selection, [6–8]). As polymorphism in natural populations is dominated by low frequency variants , which are often indistinguishable from sequencing errors, using the new sequencing technologies to estimate polymorphism will remain a challenge in the near future. A number of methods have been proposed to separate errors from rare polymorphisms [10–14]. Among them, Nielsen et al.'s approach  is most direct by filtering out errors from the raw read data. However, since error signals may vary from operation to operation, its general applicability will need to be evaluated.
There are two ways to prepare samples for sequencing and polymorphism estimation. First, sequencing is done on individual samples, or at least on pooled samples with each sample individually barcoded . We call this type of data “single-line data”. Second, DNA samples from multiple individuals are pooled in equal quantity for sequencing without individual identification . It is referred to as “Pooled-line data”. We should note that sequencing each diploid sample individually is in fact a pooled-line approach as two haploid genomes are sequenced together. In order to call SNP accurately for both haploids, the diploid has to be sequenced to a sufficient depth (e.g. 20X) . Since individual samples are generally not sequenced to such a depth (e.g. the 1000 Human Genome Project ), most methods cited above examine the aggregate properties of these individual sequences. In other words, although individuals may be sequenced separately, the data are pooled in the analysis. Hence, for many population genetic questions, little information would be lost by sequencing pooled samples and the efficiency would be greatly improved when the sample number is large. It would then be possible to sequence each pool with greater exactitude in order to filter out errors from the data.
We now propose a method which minimizes the confounding effects of sequencing errors by combining two different sequencing applications. Dual sequencing applications have previously been carried out on the Illumina GA and SOLiD platforms for the same samples [16, 18, 19]. It has been shown that the two technologies have nearly non-overlapping error distributions . Dual platform is in fact a standard method as NGS sequencing, on whichever platform, needs to be backed up by another method, usually by Sanger sequencing or other genotyping tools [4, 20, 21]. Dual applications on two NGS platforms is simply a more systematic and large-scale method of error correction. Such dual applications can also be expected on newer and very different technologies such as HiSeq , Ion Protons , PacBio  and MspA nanopore . When dual platform sequencing is not feasible, dual applications of the same platform on the same DNA sample, independently prepared for sequencing, may serve the same purpose. The correlation of error distribution between two applications on the same platform is slightly higher than those on different platforms but is often adequate for error corrections.
In this study, we first investigated a simple single-line method by extracting haploid information from individual diploids. We then propose dual sequencing applications to improve the pooled-line method for analyzing pooled samples of diploids.
If the effort of data collection is not a limiting factor, the best method is to sequence each diploid individual to a sufficient depth such that true polymorphisms, with the variant frequency at 0.5, can be unambiguously separated from errors.
To ensure false positive error rate being less than 10%, it need more than 20X depth for most next generation sequencing platforms . With a lower coverage, there would be many sites where the distinction between errors and polymorphisms is not possible. Therefore, when data are obtained with low coverage of diploid individuals (say, 2X), we suggest taking data from only one haploid genome per diploid individual. In this scheme, an average depth of 2X would ensure that 86% of individuals could be covered at each site, provided that the distribution of sequencing depth at each site follows a Poisson distribution, p(depth > 0) = 1-e-2. Since we are interested in comparing various methods of estimating genetic diversity, all of them are applied to data with an average depth of 2X per diploid individual.
where . In this formula, z = 1 when singletons are removed and z = 2 when both singletons and doubletons are removed.
Estimating θ with constant sequencing error rate
θ = 0.1 / kb
θ = 1 / kb
When the error rate is set to 0, the estimates of θ using S>0 are very close to the true values. When the error rate is 0.001 to 0.01, the estimates of θ using S>0 become extremely unreliable, as expected, and the removal of singletons and doubletons becomes necessary. With an error rate of 0.001, the estimate of θ using S>2 is 0.101, very close to the true value of 0.1. If the error rate is as high as 0.01, estimation by the single line method becomes unreliable even the singletons and doubletons are removed.
Estimating θ with Beta distributed sequencing error rate
Parameter α of Beta distribution
θ = 0.1 / kb
θ = 1 / kb
Pooled-lines data from single platform
From the section above, it appears that the most efficient strategy for accurately estimating genetic diversity would not be single-line sequencing. Given the low coverage for each individual, variant frequencies, rather than the genotypes of individuals, are the quantities of interest. Pooling samples for bulk sequencing may be equally informative but at a lower cost and effort . When pooled samples are sequenced, each haploid genome would not present equally in the final data and the coverage would vary from site to site. The statistics to correct for these fluctuations are given below. In this and the next sections, the pooled samples are sequenced by one single application or by dual applications. The ability to separate errors from true polymorphisms differs greatly between the two approaches.
Ewens showed that is the probability that a mutant presents b times in n samples .
where ϵ denotes the sequencing error at this site. Since the average raw error rate ranges from 0.1% to 1.0% , the sequencing error can cause severe problems when estimating polymorphism.
S>z denotes the number of segregating sites at which two different alleles are both detected by more than z reads. All segregating sites detected by reads are counted when z = 0. Hence, S>0 is equal to S T .
The procedure to estimate θ using pooled-lines data from single platform is as follows. For each site, we (1) treat the data as missing if the number of reads is less than rmin in this platform; (2) retain alleles having more than z reads. If there is only one allele in this platform, we treat this site as a nonsegregating site; if two, as a segregating site; if more than two, we treat the data as missing; (3) use equation (11) to calculate θ for the single platform. rmin should not be no lower than (2z + 2). In the following simulations, we set rmin = 6.
We used the simulated data to test this method. The results are referred to as “single platform” in Table 1. When singletons (the minor depth allele is covered by only one read, z = 1) or both singletons and doubletons (the minor depth allele is covered by two reads, z = 2) are discarded (the row “S>1” and “S>2”), the standard deviation becomes larger if there is no sequencing error. In reality, sequencing error cannot be ignored.
We assume that the error rate is constant across sites. Different error rates (0.001, 0.005 and 0.01) are used in the estimation. The simulation results are displayed in Table 1. For example, when S>0 is used with an error rate of 0.001, sequencing errors lead to very poor estimates of θ. The mean estimate of θ is 22.054 per kb if all segregating sites are used, which is many times higher than the true value of 0.1 per kb. The estimation becomes more accurate when S>1 or S>2 is used. Thus, when the error rate is low (e.g. 0.001), this method can be used to estimate θ with both singletons and doubletons discarded. However, when the error rate is high (e.g. 0.005 or 0.01), even excluding singletons and doubletons (the row “S>2” in Table 1) does not lead to acceptable estimates. For simulations with the assumption that the error rate is Beta distributed and its mean is 0.005, the estimates are also unacceptable (shown in Table 2).
Pooled-lines data from dual sequencing applications
It is customary to validate calls of variants by another method. For example, variant calls on the Illumina platform are often validated by Sanger sequencing or by fast SNP genotyping methods, e.g. Sequenom genotyping [4, 20]. Because validation is often laborious and incomplete, it may be more efficient and informative to deploy two sequencing methods fully and independently. If the two applications have distinctive error-distribution patterns, the errors could be identified and excluded by reciprocally correcting each other’s errors. Indeed, several widely used sequencing methods (as well as the latest methods that are in development) are based on very different chemistry and protocols. As shown below, we analyzed the sequencing results obtained by Illumina based data and SOLiD, and as expected, we observed the two datasets showed non-overlapping errors.
Data on error correlation between sequencing applications
Single platform - For analyzing the correlation of two samples sequenced on the same platform, we use our own unpublished data from the Illumina HiSeq platform. A sample of 35 individuals from a mangrove species, Avicennia marina, was taken from each of two nearby populations in Thailand. Equal amount of DNAs from 35 individuals (or 70 haploid genomes) were pooled. 93 genes were amplified for both of the two pooled samples and sequenced on an Illumina HiSeq platform. For sites with more than 2000X depth in both samples, we called SNPs at the sites whose minor allele frequency (MAF) is lower than 0.01 in both samples. In total, 55,602 sites were retained and were plotted in Figure 1b. Almost all of these variants are sequencing errors as explained in Methods. Figure 1b shows the observed error rates on these sites. Pearson's correlation coefficient of the error rate distributions between these two samples is only 0.142, a little higher than that between platforms of Figure 1a. Therefore, for samples prepared and sequenced twice on one platform, sequencing errors also overlap only rarely.
where r1j is the number of reads covering site j in the first dataset, while r2j is the number of reads covering site j in the second dataset.
Here S>z denotes the number of segregating sites in which two different alleles are both detected by more than z reads on both applications.
The procedure to estimate θ using data from dual sequencing applications is as follows. For each site, we (1) treat the data as missing if the number of reads is less than rmin on either applications; (2) retain alleles having more than z reads on both applications. If there is only one allele on either application, we treat this site as a non-segregating site. A site is considered segregating only when reads from both applications report segregation; (3) use equation (15) to calculate θ for the combined dataset. We set rmin = 6 in the following simulations.
While NGS has increased the power of DNA sequencing by orders of magnitude in the recent years, its accuracy per read is the one aspect that has not been improved. For example, 454 Pyrosequencing is susceptible to homopolymer indels . The Illumina GA and SOLiD platforms are both PCR based systems and are prone to base substitution errors. The first glimpses of newer technologies do not offer promises for improving per read accuracy either. Nevertheless, the nature of the substitution errors may differ among platforms since major sources of errors, from library construction to base-pair determination, depend on different physical and chemical principles among these technologies. The method described herein takes advantage of the non-overlapping distributions to minimize error rates.
The error rate across all sites is platform-dependent and not constant (e.g. Beta distribution) . When doing the simulation, we assume that a nucleotide has an equal probability of being read incorrectly as one of the three other nucleotides. However, the patterns of error rates for the real data are much more complex. The frequencies of base substitution error could vary by 10 to 11 fold, with A to C transversions being among the most frequent substitution errors and C to G transversions among the least frequent ones . Therefore, if a non-segregating site (e.g. A) has two reads with sequencing errors, a doubleton error is more likely (e.g. two A to C errors) rather than two singleton errors (e.g. one from A to C and another from A to T). In other words, the unevenly distributed errors can cause severe problems in estimating polymorphism. In this situation, we strongly suggest using dual sequencing applications to avoid this kind of errors.
Our model can estimate θ accurately by combining data from two different sequencing applications. The method is robust even when the error rate is extremely high and variable across sites. We also evaluated the relative merits of pooled-lines versus single-line data. If the coverage per line is low, dual sequencing application on pooled lines yields the best results. However, the inherent high error rates in the NGS technologies impose constraints on the estimation of polymorphisms. Even under the best of conditions with sequencing done on two platforms, singletons and doubletons still have to be removed. If the estimation requires accuracy in the low frequency portion of the variant spectrum, it will be necessary to carry out sequencing on each line individually with a high coverage of >20X. For many scientific questions, our strategy of dual sequencing applications on pooled samples with modest coverage can yield the most information for the same level of effort.
Sample preparing and sequencing
We sampled two Avicennia marina populations (Bangkunsha and Thongnian) in Thailand. Equal amount of DNAs from 35 individuals (diploids) in each population were pooled, respectively. 93 genes were respectively amplified for both of the two pooled samples and then sequenced on an Illumina HiSeq platform.
Reads alignment and SNPs calling
We use MAQ to align reads to the known references. Nucleotides with base quality low than 20 are discussed. For sites with more than 2000X depth in both samples, we called candidate polymorphic sites whose minor allele frequency is lower than 0.01 in both samples. In total, 55,602 sites were retained and were plotted in Figure 1b.
In re-analyzing sequencing data of Sonneratia alba, Singletons are discarded and only the mutant alleles with at least one read aligned in forward strands and one read aligned in backward strands are retained for the following analyses. 2382 candidate sites were plotted in Figure 1a.
Searching sites with errors
Consider a singleton site with MAF being 1/70, if the sequencing depth of this site is 2000X, we can infer the probability of observing its MAF < 0.01 to be 0.0375, using the distribution function of a Binomial distribution. For a singleton with the same MAF being observed in both samples, the probability is 0.0014 (the square of 0.0375). If the site has more than two mutant alleles or the depth is more than 2000X, the probability will decrease. The total number of SNPs of these two populations is estimated no more than 500 for these 93 genes. Therefore, there should be no more than 0.7 (0.0014*500) true polymorphic sites in Figure 1b. Near all candidate polymorphic sites in Figure 1b are introduced by errors.
We simulated sequencing progress with a Poisson distributed depth. Errors were added randomly for each site with the given error rate. We wrote Perl scripts to evaluate θ for single/dual applications method described in the main text. The means and the standard deviations of θ for each combination of parameters in Table 1 and Table 2 are estimated from 1000 replicates.
For single-line data, we simulated a 100 kb region for 25 diploid individuals with an average depth of 2X; hence, Max(n j ) = 25 as only one read is used per individual. We set θ to be 0.1 or 1 per kb and error rate to be 0, 0.001, 0.005 or 0.01 per site.
For pooled-lines data, a 100 kb region is simulated for 25 diploids (50 haploid genomes) using a single platform or dual platforms. We set different θ values (0.1 / 1 per kb) and used S>0, S>1 and S>2 in the estimate. The average depth is 2X per haploid genome in single platform method and 1X per haploid genome in each application in dual applications method.
Next generation sequencing
Single nucleotide polymorphism
Minor allele frequency.
We thank Ziheng Yang, Tianqi Zhu, Weiwei Zhai and Suo Qiu for their helpful comments and suggestions. SS is supported by the grants from the National Natural Science Foundation of China (41130208) and Science Foundation of State Key Laboratory of Biocontrol (SKLB201224, SKLBC12K04, SKLBC2011K01). CIW is supported by the grants from the National Natural Science Foundation of China (31130069). ZH is supported by scholarship award for excellent doctoral student granted by ministry of education and Yat-sen innovation project of Sun Yat-sen University.
- Shendure J, Ji H: Next-generation DNA sequencing. Nat Biotechnol. 2008, 26: 1135-1145. 10.1038/nbt1486.View ArticlePubMedGoogle Scholar
- Druley TE, Vallania FLM, Wegner DJ, Varley KE, Knowles OL, Bonds JA, Robison SW, Doniger SW, Hamvas A, Cole FS, Fay JC, Mitra RD: Quantification of rare allelic variants from pooled genomic DNA. Nat Methods. 2009, 6: 263-265. 10.1038/nmeth.1307.PubMed CentralView ArticlePubMedGoogle Scholar
- Harismendy O, Ng PC, Strausberg RL, Wang X, Stockwell TB, Beeson KY, Schork NJ, Murray SS, Topol EJ, Levy S, Frazer KA: Evaluation of next generation sequencing platforms for population targeted sequencing studies. Genome Biol. 2009, 10: R32-10.1186/gb-2009-10-3-r32.PubMed CentralView ArticlePubMedGoogle Scholar
- Zhou R, Ling S, Zhao W, Osada N, Chen S, Zhang M, He Z, Bao H, Zhong C, Zhang B, Lu X, Turissini D, Duke NC, Lu J, Shi S, Wu CI: Population genetics in non-model organisms: II. Natural selection in marginal habitats revealed by deep sequencing on dual platforms. Mol Biol Evol. 2011, 28: 2833-2842. 10.1093/molbev/msr102.View ArticlePubMedGoogle Scholar
- Watterson GA: On the number of segregating sites in genetical models without recombination. Theol Popul Biol. 1975, 7: 256-276. 10.1016/0040-5809(75)90020-9.View ArticleGoogle Scholar
- Tajima F: Statistical method for testing the neutral mutation hypothesis by DNA polymorphism. Genetics. 1989, 123: 585-595.PubMed CentralPubMedGoogle Scholar
- Fu YX: Statistical properties of segregating sites. Theor Popul Biol. 1995, 48: 172-197. 10.1006/tpbi.1995.1025.View ArticlePubMedGoogle Scholar
- Zeng K, Shi S, Wu CI: Compound tests for the detection of hitchhiking under positive selection. Mol Biol Evol. 2007, 24: 1898-1908. 10.1093/molbev/msm119.View ArticlePubMedGoogle Scholar
- Ewens WJ: Mathematical population genetics. 1979, Berlin: Springer-VerlagGoogle Scholar
- Jiang R, Tavare S, Marjoram P: Population genetic inference from resequencing data. Genetics. 2009, 181: 187-197.PubMed CentralView ArticlePubMedGoogle Scholar
- Liu X, Maxwell TJ, Boerwinkle E, Fu YX: Inferring population mutation rate and sequencing error rate using the SNP frequency spectrum in a sample of DNA sequences. Mol Biol Evol. 2009, 26: 1479-1490. 10.1093/molbev/msp059.PubMed CentralView ArticlePubMedGoogle Scholar
- Li H: A statistical framework for SNP calling, mutation discovery, association mapping and population genetical parameter estimation from sequencing data. Bioinformatics. 2011, 27: 2987-2993. 10.1093/bioinformatics/btr509.PubMed CentralView ArticlePubMedGoogle Scholar
- Le SQ, Durbin R: SNP detection and genotyping from low-coverage sequencing data on multiple diploid samples. Genome Res. 2011, 21: 952-960. 10.1101/gr.113084.110.PubMed CentralView ArticlePubMedGoogle Scholar
- Nielsen R, Korneliussen T, Albrechtsen A, Li Y, Wang J: SNP calling, genotype calling, and sample allele frequency estimation from new-generation sequencing data. PLoS ONE. 2012, 7: e37558-10.1371/journal.pone.0037558.PubMed CentralView ArticlePubMedGoogle Scholar
- Cook DE, Lee TG, Guo X, Melito S, Wang K, Bayless AM, Wang J, Hughes TJ, Willis DK, Clemente TE, Diers BW, Jiang J, Hudson ME, Bent AF: Copy number variation of multiple genes at Rhg1 mediates nematode resistance in soybean. Science. 2012, 338: 1206-1209. 10.1126/science.1228746.View ArticlePubMedGoogle Scholar
- He Z, Zhai W, Wen H, Tang T, Wang Y, Lu X, Greenberg AJ, Hudson RR, Wu CI, Shi S: Two Evolutionary Histories in the Genome of Rice: the Roles of Domestication Genes. PLoS Genet. 2011, 7: e1002100-10.1371/journal.pgen.1002100.PubMed CentralView ArticlePubMedGoogle Scholar
- The 1000 Genomes Project Consortium:A map of human genome variation from population-scale sequencing. Nature. Nature. 2010, 467: 1061-1073. 10.1038/nature09534.PubMed CentralView ArticleGoogle Scholar
- Picardi E, Horner DS, Chiara M, Schiavon R, Valle G, Pesole G: Large-scale detection and analysis of RNA editing in grape mtDNA by RNA deep-sequencing. Nucleic Acids Res. 2010, 38: 4755-4767. 10.1093/nar/gkq202.PubMed CentralView ArticlePubMedGoogle Scholar
- Graveley BR, Brooks AN, Carlson JW, Duff MO, Landolin JM, Yang L, Artieri CG, van Baren MJ, Boley N, Booth BW, Brown JB, Cherbas L, Davis CA, Dobin A, Li R, Lin W, Malone JH, Mattiuzzo NR, Miller D, Sturgill D, Tuch BB, Zaleski C, Zhang D, Blanchette M, Dudoit S, Eads B, Green RE, Hammonds A, Jiang L, Kapranov P: The developmental transcriptome of Drosophila melanogaster. Nature. 2011, 471: 473-479. 10.1038/nature09715.PubMed CentralView ArticlePubMedGoogle Scholar
- Calvo SE, Tucker EJ, Compton AG, Kirby DM, Crawford G, Burtt NP, Rivas M, Guiducci C, Bruno DL, Goldberger OA, Redman MC, Wiltshire E, Wilson CJ, Altshuler D, Gabriel SB, Daly MJ, Thorburn DR, Mootha VK: High-throughput, pooled sequencing identifies mutations in NUBPL and FOXRED1 in human complex I deficiency. Nat Genet. 2010, 42: 851-858. 10.1038/ng.659.PubMed CentralView ArticlePubMedGoogle Scholar
- MacArthur DG, Balasubramanian S, Frankish A, Huang N, Morris J, Walter K, Jostins L, Habegger L, Pickrell JK, Montgomery SB, Albers CA, Zhang ZD, Conrad DF, Lunter G, Zheng H, Ayub Q, DePristo MA, Banks E, Hu M, Handsaker RE, Rosenfeld JA, Fromer M, Jin M, Mu XJ, Khurana E, Ye K, Kay M, Saunders GI, Suner MM, Hunt T: A systematic survey of loss-of-function variants in human protein-coding genes. Science. 2012, 335: 823-828. 10.1126/science.1215040.PubMed CentralView ArticlePubMedGoogle Scholar
- Minoche AE, Dohm JC, Himmelbauer H: Evaluation of genomic high-throughput sequencing data generated on Illumina HiSeq and genome analyzer systems. Genome Biol. 2011, 12: R112-10.1186/gb-2011-12-11-r112.PubMed CentralView ArticlePubMedGoogle Scholar
- Rothberg JM, Hinz W, Rearick TM, Schultz J, Mileski W, Davey M, Leamon JH, Johnson K, Milgrew MJ, Edwards M, Hoon J, Simons JF, Marran D, Myers JW, Davidson JF, Branting A, Nobile JR, Puc BP, Light D, Clark TA, Huber M, Branciforte JT, Stoner IB, Cawley SE, Lyons M, Fu Y, Homer N, Sedova M, Miao X, Reed B: An integrated semiconductor device enabling non-optical genome sequencing. Nature. 2011, 475: 348-352. 10.1038/nature10242.View ArticlePubMedGoogle Scholar
- Coupland P, Chandra T, Quail M, Reik W, Swerdlow H: Direct sequencing of small genomes on the Pacific Biosciences RS without library preparation. Biotechniques. 2012, 53: 365-372.View ArticlePubMedGoogle Scholar
- Manrao EA, Derrington IM, Laszlo AH, Langford KW, Hopper MK, Gillgren N, Pavlenok M, Niederweis M, Gundlach JH: Reading DNA at single-nucleotide resolution with a mutant MspA nanopore and phi29 DNA polymerase. Nat Biotechnol. 2012, 30: 439-353.View ArticleGoogle Scholar
- Watterson GA: Heterosis or neutrality. Genetics. 1977, 85: 789-814.PubMed CentralPubMedGoogle Scholar
- Dohm JC, Lottaz C, Borodina T, Himmelbauer H: Substantial biases in ultra-short read data sets from high-throughput DNA sequencing. Nucleic Acids Res. 2008, 36: e105-10.1093/nar/gkn425.PubMed CentralView ArticlePubMedGoogle Scholar
- Li H, Ruan J, Durbin R: Mapping short DNA sequencing reads and calling variants using mapping quality scores. Genome Res. 2008, 18: 1851-1858. 10.1101/gr.078212.108.PubMed CentralView ArticlePubMedGoogle Scholar