A histone arginine methylation localizes to nucleosomes in satellite II and III DNA sequences in the human genome
© Capurso et al.; licensee BioMed Central Ltd. 2012
Received: 25 May 2012
Accepted: 9 November 2012
Published: 15 November 2012
Applying supervised learning/classification techniques to epigenomic data may reveal properties that differentiate histone modifications. Previous analyses sought to classify nucleosomes containing histone H2A/H4 arginine 3 symmetric dimethylation (H2A/H4R3me2s) or H2A.Z using human CD4+ T-cell chromatin immunoprecipitation sequencing (ChIP-Seq) data. However, these efforts only achieved modest accuracy with limited biological interpretation. Here, we investigate the impact of using appropriate data pre-processing —deduplication, normalization, and position- (peak-) finding to identify stable nucleosome positions — in conjunction with advanced classification algorithms, notably discriminatory motif feature selection and random forests. Performance assessments are based on accuracy and interpretative yield.
We achieved dramatically improved accuracy using histone modification features (99.0%; previous attempts, 68.3%) and DNA sequence features (94.1%; previous attempts, <60%). Furthermore, the algorithms elicited interpretable features that withstand permutation testing, including: the histone modifications H4K20me3 and H3K9me3, which are components of heterochromatin; and the motif TCCATT, which is part of the consensus sequence of satellite II and III DNA. Downstream analysis demonstrates that satellite II and III DNA in the human genome is occupied by stable nucleosomes containing H2A/H4R3me2s, H4K20me3, and/or H3K9me3, but not 18 other histone methylations. These results are consistent with the recent biochemical finding that H4R3me2s provides a binding site for the DNA methyltransferase (Dnmt3a) that methylates satellite II and III DNA.
Classification algorithms applied to appropriately pre-processed ChIP-Seq data can accurately discriminate between histone modifications. Algorithms that facilitate interpretation, such as discriminatory motif feature selection, have the added potential to impart information about underlying biological mechanism.
KeywordsEpigenomics Histone modifications ChIP-Seq Data pre-processing Classification
Chromatin compaction is one of the critical factors regulating gene expression. The basic unit of chromatin, the nucleosome, consists of 147 base pairs (bp) of DNA wrapped around an octamer of histone proteins (H2A, H2B, H3, H4). Many histone post-translational modifications contribute to establishing compacted, transcriptionally repressed hetero chromatin (e.g., histone H3 lysine 9 trimethylation (H3K9me3)) or open, transcriptionally poised eu chromatin (e.g., H3K4me3) [1, 2]. However, it is currently unknown why so many modifications — on at least 60 histone residues  — are necessary [3, 4]. One possibility is that individual modifications have specialized properties, such as “indexing” classes of genomic elements . Nevertheless, such discriminating properties remain largely unknown, as redundancy and enzyme promiscuity for non-histone targets have limited the amenability of histone modifications to genetic experimentation .
A potential solution to this problem is to apply supervised learning/classification techniques to high-throughput epigenomic data, such as chromatin immunoprecipitation sequencing (ChIP-Seq) data, for histone modificatons. Encouragingly, these approaches have had success in the related task of predicting the nucleosome occupancy of DNA sequences: they have elicited predictive features with biological (e.g., Rap1 transcription factor binding sites [7, 8]) and biophysical (e.g., GC content, DNA propeller twist [7, 9, 10]) interpretations. Nevertheless, attempts to apply classification techniques to histone modifications have been less forthcoming. This is, in part, because such analyses require less readily available datasets, which correspond to many ChIP-Seq experiments in the same cell type. As notable exceptions, Barski et al.  have generated a ChIP-Seq dataset for 20 histone methylations and the histone variant H2A.Z in human CD4+ T cells, and Wang et al. , of the same research group, have generated a similar dataset for 18 histone acetylations. A recent study by Gervais and Gaudreau  applied classification techniques to histone modifications using these datasets.
In particular, Gervais and Gaudreau  attempted to predict whether a nucleosome contains histone H2A.Z or H2A/H4 arginine 3 symmetric dimethylation (H2A/H4R3me2s; the authors refer to this as just “H2A”, though it is a methylated form ). Importantly, these two classes are likely mutually exclusive: H2A.Z lacks the R3 methylation site and localizes near active transcription start sites , while H2A/H4R3me2s localizes with repressed heterochromatin . The authors  first performed classification with histone modification features (co-localization with 37 other modifications from ChIP-Seq) and, then, with DNA sequence features (frequency of 6-mers in 147 bp nucleosome-bound DNA sequences). However, these analyses only achieved modest prediction accuracies of 68.3% and <60%, respectively (here, a trivial classifier would have an accuracy of 50%) . Furthermore, there was limited biological interpretation for histone modification features and no interpretation for DNA sequence features .
A partial explanation for this modest performance may be insufficient data pre-processing. Gervais and Gaudreau  used raw, aligned (25 bp) ChIP-Seq reads, and simply extended these to 147 bp to generate what they consider to be nucleosome-bound DNA sequences. However, this approach is problematic. Because ChIP-Seq is only a slight enrichment (not a purification) for sequences bound to the protein of interest , it is notoriously noisy. The majority (estimates upward of 90% ) of ChIP-Seq reads are instead from the background. Therefore, we, and others [15, 17, 18], advocate using position- (peak-) finding algorithms, such as N ucleosome P ositioning from S equencing (NPS)  (see Methods), that identify stable nucleosome positions with statistically significant enrichment over background, prior to analysis. Here, stable nucleosomes can be defined as those that are located at roughly the same chromosomal position across a population of cells and can therefore generate a signal peak when ChIP-Seq reads are aligned. Such nucleosomes are also referred to as being relatively well positioned or phased, and there is evidence for their regulatory importance [1, 16]. While using stable nucleosome positions might limit the analysis to a subset of nucleosomes (and thus influence interpretation), we still believe this approach is preferable to using raw, aligned reads — of which only a small minority were likely even bound to the nucleosomes of interest. This approach of using stable nucleosomes was also utilized in a recent study .
Aside from the handling of signal and background, the approach of Gervais and Gaudreau  might not adequately control for systematic biases present in ChIP-Seq data. First, because of PCR amplification bias it may be advisable to collapse duplicate reads prior to analysis [15, 18]. This is especially the case for datasets such as Barski et al.  and Wang et al.  where sequencing depth is relatively low, such that there is a lower likelihood of sequencing independently-precipitated fragments with the same start site (as future datasets begin to have much higher sequencing depth, more refined alternatives to read deduplication will be valuable). Indeed, even for stable nucleosomes, the positioning is often blurry, with nucleosomes not having precisely the same start site across cells . In addition, because coverage and the ability to detect peaks vary with sequencing depth, ChIP-Seq experiments need to be normalized for the number of reads . Refined normalization approaches are emerging  for ChIP-Seq datasets that contain a mock immunoprecipitation (IP) sample; however, for otherwise rich ChIP-Seq datasets that lack such a mock IP, including  and , we believe data should still be normalized for the number of reads, in the absence of a more delicate approach for this type of data (see Discussion).
Here, we employ appropriate ChIP-Seq data pre-processing and sequence-customized, or otherwise advanced, algorithms to investigate their impact on the accuracy and interpretability of classifying nucleosomes containing H2A/H4R3me2s or H2A.Z. For data pre-processing, we perform deduplication, normalization, and position-finding. Further, for DNA sequence-based classification, we utilize the recently developed D iscriminatory M otif F eature S election (DMFS) , which, in addition to achieving impressive accuracy, emphasizes interpretability, unlike so-called “black-box” classifiers. Specifically, DMFS elicits a small set of a priori discriminatory features (motifs) on a subsequently withheld data partition. This eliminates many noise features, which can comprise prediction and interpretation , and loosens restrictive feature length prescriptions (e.g., 6-mers in ), which could otherwise fail to generate key, longer features. For classification based on histone modification features, we utilize an ensemble method, random forests , which has been widely demonstrated to improve on individual classification trees [24, 25], as were deployed by Gervais and Gaudreau . Finally, we perform extensive downstream analysis. Importantly, in addition to achieving dramatically improved accuracies, our classification algorithms elicit predictive, interpretable features that are consistent with recent biochemical findings .
We pre-processed the Barski et al.  ChIP-Seq dataset for 20 histone methylations and H2A.Z to reduce bias. The percentage of duplicate reads in each experiment ranged from 2.1% to 25.1% (median = 5.6%), suggesting the potential for substantial PCR bias in some of the samples. We therefore collapsed duplicate reads into single reads. Additionally, the number of unique reads in the experiments varied by more than 3-fold, indicating the potential for considerable sequencing depth variation (and thus coverage bias) across the raw samples. We therefore normalized experiments for sequencing depth by down-sampling to the lowest number of unique reads observed (see Methods).
Using this filtered data, we identified stable nucleosome positions as signal peaks with statistically significant enrichment over the background by applying NPS  (see Methods). This yielded 1845 and 46235 stable nucleosomes containing H2A/H4R3me2s and H2A.Z, respectively (Additional file 1: Table S1). Next, we down-sampled H2A.Z nucleosomes to match the number of H2A/H4R3me2s nucleosomes for two reasons. First, this creates a balanced dataset for classification (i.e., where a trivial classifier has an accuracy of 50%) and thus yields accuracies directly comparable to those of  (who performed analogous down-sampling). Indeed, using “class-imbalanced” data can result in a classifier that is biased toward the larger class ; in the case of high-dimensional data, down-sampling the larger class is preferable to over-sampling the smaller class . Second, down-sampling emphasizes features associated with H2A/H4R3me2s, which is relatively under-studied compared to H2A.Z. An added benefit of this approach is its reduction of the computational burden. All reported performance results are the mean of (cross-validated or out-of-bag) performance summaries over 10 different random down-samplings of H2A.Z nucleosomes, to ensure our balanced approach did not bias the results.
Classification using histone modification features
The presence of one type of histone modification in a nucleosome can increase or decrease the likelihood of a second type . Therefore, to identify such potential interactions, we attempted to discriminate between stable nucleosomes containing H2A/H4R3me2s or H2A.Z by using the co-localization with 19 other histone methylations and 18 histone acetylations (Additional file 1: Table S2) as features for classification. For each stable nucleosome, we generated an array of length 37 (for 37 feature modifications), where each entry is the number of deduplicated sequence reads for a feature modification that map within the nucleosome boundaries in a strand-specific manner (see Methods). The motivation for using deduplicated sequence read counts for scoring overlap with feature modifications is that it results in a richer (i.e., less sparse) matrix than scoring binary overlap with stable nucleosomes for the feature modifications. We still use stable nucleosomes, however, for the outcome modifications (H2A/H4R3me2s, H2A.Z) and in downstream analyses.
To further explore how these features relate to H2A/H4R3me2s, we built a single classification tree (Figure 1c) , which, compared to the random forests ensemble of trees, may more readily reveal interpretable rules, albeit at the cost of decreased classification accuracy. Consistent with the random forests feature importance ranking, the feature that best separated the data in the single tree is H4K20me3 (Figure 1c). Indeed, 1737 out of 1854 stable nucleosomes containing H2A/H4R3me2s were classified at the first split, based on overlapping with greater than two deduplicated, H4K20me3 sequence reads (with a misclassification rate of only 1.67%). Three of the four remaining splits were also based on features that were had significant random forests feature importances (H3K18ac, H3K27ac, and H3R2me2a; H2BK5me1 did not have a significant random forests feature importance, yet was the basis for the second split). H3K9me3, which had the second highest random forests feature importance, was not the basis for a split in the single tree; however, this may occur if, for example, the stable H2A/H4R3me2s nucleosomes that overlap with H3K9me3 are a subset of those that overlap with H4K20me3 (and so they are already classified at the first split).
Encouragingly, the top two modifications by random forests feature importance, H4K20me3 and H3K9me3, are more frequent in stable nucleosomes containing H2A/H4R3me2s than those containing H2A.Z (Figure 1b). Because H4K20me3 and H3K9me3 have been shown to contribute to the formation of heterochromatin [1, 2] – which is where H2A/H4R3me2s localizes — this initial finding supports the biological relevance of our classifier.
Classification using DNA sequence features
DNA sequence likely influences the genome-wide distribution of histone modifications, as sequence-specific transcription factors and microRNAs can bind and recruit histone-modifying enzymes . Thus, we used DNA sequence motifs as features for classifying H2A/H4R3me2s and H2A.Z nucleosomes for two reasons: first, to identify such potential targeting sequences, and second, to identify classes of genomic elements that the histone modification potentially regulates. Using DMFS , we identified <300 a priori discriminatory motifs with lengths between 5 and 10 bp from a subsequently withheld partition of the data (see Methods).
For thoroughness, however, we first performed a combined classification that utilized histone modification features and DNA sequence features. This resulted in a classification accuracy of 98.6% ± 0.1% (auROC = 0.999 ± 0.0002). Feature importance analysis by MDG yielded many of the same top features as in the separate classifications, namely: H4K20me3, H3K9me3, H3R2me2a, H3K36me3, and sequences containing the motif TCCATT.
Downstream feature analysis
Satellite II and III DNA consensus sequences
satellite II DNA
[(atTCCATTcg)2 + (atg)1–2]n
satellite III DNA
[(ATTCC)7–13 + (ATTcgggttg)1]n
Finally, we explored further the relationship between satellite II and III DNA and various histone modifications. For each histone modification, we calculated occupancy over aligned satellite II (or III) DNA sequences, where occupancy is defined as the fraction of sequences at a position that are bound to a stable nucleosome containing that histone modification (see Methods). We found that H2A/H4R3me2s and H4K20me3 had the highest occupancy over satellite II DNA sequences (0.266 and 0.289, respectively) and satellite III DNA sequences (0.159 and 0.142, respectively). H3K9me3 followed closely with occupancies of 0.140 and 0.045 over satellite II and III DNA, respectively. On the other hand, H2A.Z and 18 other histone methylations in the Barski et al.  datatset had no or almost no occupancy over these satellites (1 methylation, H3R2me2a, had low occupancy). These findings are depicted in Figure 3b.
Thus, downstream analysis functionally relates the elicited features to H2A/H4R3me2s and to each other: H2A/H4R3me2s, H4K20me3, and H3K9me3 all occur on stable nucleosomes in satellite II and III DNA sequences, from which the motif TCCATT is derived. These interactions are consistent with recent biochemical experimental results, a point we return to in the Discussion.
Emerging, high-throughput epigenomic data, including ChIP-Seq data, may provide insight into mechanisms of chromatin structure and gene regulation. However, realizing the full potential of this data requires a computational framework that reduces bias, maximizes algorithm accuracy, and elicits predictive and biologically interpretable features. To this end, we classified nucleosomes containing H2A/H4R3me2s or H2A.Z, as in , but instead employed appropriate data pre-processing and advanced classification algorithms, resulting in greatly improved accuracy and interpretative yield.
Indeed, interpretation of ChIP-Seq is challenging because of the magnitude and complexity of the data (issues of quality and pre-processing, aside). This is particularly true when comparing multiple histone modifications (or transcription factors). Encouragingly, approaches aiming to improve ChIP-Seq interpretation, albeit not directly applicable to our analyses, appear in the recent literature. For example, Fernandez et al.  use a genetic algorithm to identify the optimal number of histone modification profiles to combine to identify transcriptional enhancers, while Beck et al.  aim to improve ChIP-Seq interpretation by incorporating information about peak shape via linear predictive coding.
In light of these challenges, and given the problems with enumerative feature approaches (e.g., all 6-mers; discussed in detail below), we decided to employ a recently devised pipeline for sequence-based classification, DMFS , that focuses on feature interpretation. DMFS elicits a small set of a priori discriminatory features (motifs) using a subsequently withheld data partition. Using DMFS, we evaluated a feature length range between 5 and 10 bp by eliciting < 300 a priori discriminatory motifs. In contrast, evaluating this length range with enumerative approaches would require a burdensome, if not prohibitive, Σ 4k = 1397760 features. Thus, feature length often needs to be highly restricted for enumerative approaches, which can then fail to elicit longer, potentially important (interpretable) features. Even with feature length prescriptions, enumerative approaches still employ multitudes of noise features, which can degrade performance  and complicate determination of feature importance and interpretation. Thus, using DMFS to eliminate univariately unimportant features at the outset has advantages; however, it can miss features whose effects are strict (second or higher order) interactions.
Some attempts have been made to improve interpretation of enumerative feature classification. Most existing enumerative techniques rely heavily on support vector machine (SVM) classifiers that employ sophisticated, problem-specific kernels, notably the spectrum kernel  and variants thereof [37, 38], such as the so-called “blended spectrum” kernel used previously  to analyze the data considered here. Determining feature importance for such approaches is arguably very challenging (it is challenging, in general, for SVMs), given inherent feature dependencies (overlaps at neighboring positions) and kernel complexity. Some inventive methods have been developed to address these issues [39, 40]. Nevertheless, these methods are necessarily constrained: input sequences need to be the same length and only select SVM kernels are supported. Thus, another advantage of the DMFS approach is that it provides a modular, all-purpose, pipeline applicable to any (binary) classification problem with any sequence inputs.
In the current study, we employed DMFS for sequence-based classification using pre-processed data. For the sake of comparability, we also tried applying DMFS to raw, aligned, extended ChIP-Seq reads as used in , which resulted in a classification accuracy similar to that of Gervais and Gaudreau . Thus, while DMFS provided the benefits of ready interpretation, modularity, and computational efficiency, the improvements in performance that we achieved are largely attributable to data pre-processing. Indeed, several authors [15, 18] have advocated ChIP-Seq data pre-processing based on observations of bias and extensive background reads. Peak-finding methods have also been specifically designed for histone modification ChIP-Seq data: SICER  identifies broad chromatin domains enriched for a histone modification, while NPS  identifies individual, stable nucleosomes that contain a histone modification. Our study is valuable in that it demonstrates empirically the gains in classification performance that result from ChIP-Seq data pre-processing, thus substantiating the advocacy thereof.
Another valuable aspect of our study is that the identified features are consistent with recent biochemical experimental results. Our classification approaches identified the motif TCCATT (derived from satellite II and III DNA sequences) and the histone modifications H4K20me3 and H3K9me3 as predictive of H2A/H4R3me2s nucleosomes. Consistent with this, Zhao et al.  recently demonstrated that H4R3me2s provides a direct binding site for the DNA methyltransferase (Dnmt3A) that methylates satellite II and III DNA [42–44]. The enzyme that mediates H3K9me3 also interacts directly with Dnmt3A . Furthermore, the proper occurrence of H4K20me3 and H3K9me3 has been shown to be partially dependent on Prmt5, the enzyme that mediates H2A/H4R3me2s . Interestingly, the aberrant expression of satellite II and III DNA, which is observed in senescent cells  and cancers [44, 48], may promote genomic instability via chromosomal rearrangements . Thus, our finding that H2A/H4R3me2s, H4K20me3, and H3K9me3 occur in stable nucleosomes in satellite II and III DNA sequences genome-wide may be consequential in terms of understanding how these genomic elements are normally repressed in healthy, differentiated tissue.
In future work, we will extend our analyses to classifying the 19 other histone modifications in the Barski et al.  dataset. This could be realized using an iterative one-against-all approach, which would be more high-throughput (albeit at the potential cost of diluting discriminatory signals), or using a targeted, biologically motivated approach. With respect to the latter, of particular interest would be discriminating between histone modifications that localize with facultative (e.g., H3K27me3) and constitutive (e.g., H3K9me3) heterochromatin. Indeed, DNA elements capable of recruiting the facultative heterochromatin machinery have not been identified in the human genome so far, though they have been in the Drosophila genome (i.e., Polycomb Response Elements ). Additionally, we will explore the impact of alternative ChIP-Seq normalization approaches, including some more refined, emerging methods . However, because such methods often rely on a mock immunoprecipitation (IP) sample, which many otherwise rich ChIP-Seq datasets lack (including Barski et al. ), it would be worthwhile to pursue developing a method for identifying the background in datasets with multiple experimental IPs but no mock IP. Similarly, it would be a great advance to develop an algorithm that could identify and remove read buildups that correspond to PCR amplification bias without collapsing “biological” duplicate reads – especially as the latter will be common in newer datasets with very high sequencing depth. Finally, we could pursue, though more ambitious, developing an algorithm for multi-class classification with a similarly discriminatory framework .
Our study demonstrates that applying advanced classification algorithms to appropriately pre-processed ChIP-Seq data results in greatly improved prediction accuracy and feature interpretative yield in genome-wide discrimination between histone modifications. The discriminatory motif feature selection approach that we employed has the added potential to facilitate interpretation of the biological mechanism underlying the classifier performance. Finally, and perhaps most importantly, the findings presented here demonstrate that statistical/machine learning analyses of epigenomic data can identify interpretable, biologically meaningful properties of histone modifications, which have been difficult to study by traditional genetic experimentation.
ChIP-Seq data pre-processing
The Barski et al.  ChIP-Seq dataset for 20 histone methylations and H2A.Z in human CD4+ T cells was downloaded as BED files of mapped ChIP-Seq reads from: <http://dir.nhlbi.nih.gov/papers/lmi/epigenomes/hgtcell.aspx>. In each sample, duplicate reads were collapsed into single reads to eliminate PCR amplification bias [15, 18]. Samples were normalized for unique read number via down-sampling, in order to eliminate bias from sequencing depth variation . Stable nucleosomes with statistically significant enrichment over the background were identified, using NPS , for each of the 20 histone methylations and H2A.Z.
NPS extends reads in the 3' direction to 150 bp, corresponding to the length of the MNase-digested mononucleosomal DNA [11, 17]. NPS then employs signal sampling and wavelet denoising to improve signal resolution and reduce background, and Laplacian of Gaussian methods to detect peak edges . We only accepted peaks that pass quality control filtering and statistical significance testing, as in , to reduce false positives. Specifically, peaks must have had a width 80 bp ≤ w ≤ 250 bp, a strand ratio s ≤ 3, and a significant number of reads (Poisson p ≤ 1e-05). For each such nucleosome peak, we extended the midpoint to 147 bp for use in classification.
H2A.Z nucleosomes were down-sampled to match the number of H2A/H4R3me2s nucleosomes to create a balanced classification scheme . All performance evaluations are based on the mean of ten random samples of H2A.Z nucleosomes to ensure sampling did not impact the results. Classification was performed using random forests , an algorithm that averages over an ensemble of classification trees. Briefly, each tree is constructed from a bootstrap sample of the data. Unlike conventional trees, where each node is split using the overall most predictive feature, each node in random forest trees is split using the most predictive feature from a subset of features randomly sampled at that node. This additional injection of randomness serves to de-correlate trees in the ensemble, so that subsequent averaging over the ensemble more effectively decreases prediction variance and thereby improves prediction performance . An unbiased estimate of the prediction error rate is obtained as follows: first, for each tree in the ensemble, classify the data points not included in the bootstrap sample for that tree (so-called out-of-bag (OOB) data); then, average the predictions across all trees where a given data point was OOB [24, 25, 50].
Random forests have two primary parameters: for the number of trees, we used n tree = 500; and for the subset of features sampled at each node, we used the default classification value m try = sqrt(p), where p is the number of features. Compared to other classifiers, random forests have the advantage of being relatively resistant to overfitting and relatively insensitive to parameter tuning, as long as n tree is sufficiently large [24, 50]. All reported area under the Receiver Operating Characteristic curve (auROC) values are for random forests, though, for thoroughness, classifications were repeated using support vector machines (SVMs); comparable results were obtained. Fitting of both random forests and SVMs made recourse to the corresponding R packages [50, 51] and to the ROCR package .
Classification was performed using two distinct feature types: histone modification features and DNA sequence features. For histone modification features, we used the 19 histone methylations remaining in the Barski et al.  dataset, as well as 18 histone acetylations from the Wang et al.  dataset, which was generated by the same research group and in the same cell type. The latter dataset was downloaded from: <http://dir.nhlbi.nih.gov/papers/lmi/epigenomes/hgtcellacetylation.aspx>. To create the overlap matrix, an array of length 37 (for 37 histone modification features) was created for each stable H2A/H4R3me2s or H2A.Z nucleosome. Each entry in the array indicates the number of de-duplicated sequence reads for the given feature modification that co-localize with the stable nucleosome boundaries in a strand-specific manner. Specifically, to be scored: ‘+’ strand feature reads must map within ± 50 bp of the 5' stable nucleosome boundary, and ‘-’ strand feature reads must map within ± 50 bp of the 3' stable nucleosome boundary.
To generate DNA sequence features, we used DMFS: <https://bitbucket.org/haoxiong/dmfs-code/> . DMFS elicits a small set of a priori informative motifs that discriminate between positive (here, H2A/H4R3me2s) and negative (here, H2A.Z) classes. Unlike enumerative (e.g., all 6-mers) approaches, DMFS avoids the generation of abundant noise features, which can compromise prediction and interpretation . Additionally, it allows longer, potentially informative features to be evaluated. To avoid data reusage, DMFS requires an additional level of data partitioning, utilizing a discovery set for initial discriminatory motif finding and a classification set for subsequent random forest (or SVM) analysis. For the fraction of nucleosomal sequences allocated to the discovery set, we used the recommended value f = 0.2 ; we ultimately evaluated five instances of the data being randomly partitioned as such, to ensure partitioning did not impact the results. A key component of the DMFS pipeline is the tool employed for eliciting discriminatory motifs. We used the default tool – Wordspy [53, 54] – selected in view of its impressive performance in benchmarking studies . Remaining DMFS parameter settings were: minimum motif length l = 5, maximum motif length m = 10 (with both DNA strands being searched); and at most M = 2 mismatches, when aligning elicited motifs to classification set sequences.
Feature importance and downstream analysis
To identify the most individually predictive features, random forest feature importance was assessed using the mean decrease in Gini index (MDG). Briefly, the Gini index is a measure of statistical impurity. Every time a node is split in a tree, the daughter nodes become more homogenous and, thus, have a lower Gini index than the parent node. A robust measurement of feature importance can obtained as follows: for each feature, average across all random forest trees the decrease in Gini index that results from splitting a node on that feature . Permutation testing was performed to estimate the statistical significance of variable importance: MDG scores were compared to the distribution of scores from 100,000 classifications using data with permuted class labels.
Downstream analysis was performed for a motif found in many of the elicited sequence features. The genomic coordinates of repetitive DNA sequences were downloaded from the RepeatMasker track of the Table Browser  of the UCSC Genome Browser (build hg18). Based on Repbase Update  annotations, satellite II DNA (repName = HSATII) and satellite III DNA (repName = (CATTC)n, (GAATG)n) coordinates were extracted. For each histone modification, we calculated the percentage of its total stable nucleosome-bound DNA sequence that consists of satellite II or III DNA. Additionally, for each histone modification, we calculated its occupancy along satellite II DNA, or satellite III DNA, sequences aligned by start site — where occupancy is defined as the fraction of sequences bound to a stable nucleosome, in this context, with the histone modification.
chromatin immunoprecipitation sequencing
H2B, H3, and H4: histone proteins H2A, H2B, H3, and H4
histone variant protein H2A.Z
area under the Receiver Operating Characteristic curve
mean decrease in Gini index
support vector machines
Discriminatory Motif Feature Selection
Nucleosome Positioning from Sequencing.
Some computations were performed using the UCSF Biostatistics High Performance Computing System. DC was supported in part by NIH Training Grant T32 GM007175. We thank Alain Gervais, Dustin Schones, and Keji Zhao for clarifying details of previous analyses through correspondence. We thank Richard Tabor for assisting with the data storage of Sequence Read Archive files.
- Bell O, Tiwari VK, Thomä NH, Schübeler D: Determinants and dynamics of genome accessibility. Nat Rev Genet. 2011, 12: 554-564. 10.1038/nrg3017.View ArticlePubMed
- Kouzarides T, Berger S: Chromatin modifications and their mechanism of action. Epigenetics. Edited by: Allis C, Jenuwein T, Reinberg D. 2007, Cold Spring Harbor Laboratory Press, Cold Spring Harbor, NY, 191-209. 1
- Xu X, Hoang S, Mayo MW, Bekiranov S: Application of machine learning methods to histone methylation ChIP-Seq data reveals H4R3me2 globally represses gene expression. BMC Bioinforma. 2010, 11: 396-
- Rando OJ: Global patterns of histone modifications. Curr Opin Genet Dev. 2007, 17: 94-99. 10.1016/j.gde.2007.02.006.View ArticlePubMed
- Allis C, Jenuwein T, Reinberg D, In Epigenetics. 1st edition: Overview and concepts. 2007, edited by Allis C, Jenuwein T, Reinberg D, Cold Spring Harbor, NY: Cold Spring Harbor Laboratory Press, 23-61.
- Henikoff S, Shilatifard A: Histone modification: cause or cog?. Trends Genet. 2011, 27: 389-396. 10.1016/j.tig.2011.06.006.View ArticlePubMed
- Lee W, Tillo D, Bray N, Morse RH, Davis RW, Hughes TR, Nislow C: A high-resolution atlas of nucleosome occupancy in yeast. Nat Genet. 2007, 39: 1235-1244. 10.1038/ng2117.View ArticlePubMed
- Segal MR: Re-cracking the nucleosome positioning code. Stat Appl Genet Mol Biol. 2008, 7: 14-
- Miele V, Vaillant C, D’Aubenton-Carafa Y, Thermes C, Grange T: DNA physical properties determine nucleosome occupancy from yeast to fly. Nucleic Acids Res. 2008, 36: 3746-3756. 10.1093/nar/gkn262.PubMed CentralView ArticlePubMed
- Tillo D, Hughes TR: G+C content dominates intrinsic nucleosome occupancy. BMC Bioinforma. 2009, 10: 442-10.1186/1471-2105-10-442.View Article
- Barski A, Cuddapah S, Cui K, Roh T-Y, Schones DE, Wang Z, Wei G, Chepelev I, Zhao K: High-resolution profiling of histone methylations in the human genome. Cell. 2007, 129: 823-837. 10.1016/j.cell.2007.05.009.View ArticlePubMed
- Wang Z, Zang C, Rosenfeld JA, Schones DE, Barski A, Cuddapah S, Cui K, Roh T-Y, Peng W, Zhang MQ, Zhao K: Combinatorial patterns of histone acetylations and methylations in the human genome. Nat Genet. 2008, 40: 897-903. 10.1038/ng.154.PubMed CentralView ArticlePubMed
- Gervais AL, Gaudreau L: Discriminating nucleosomes containing histone H2A.Z or H2A based on genetic and epigenetic information. BMC Mol Biol. 2009, 10: 18-10.1186/1471-2199-10-18.PubMed CentralView ArticlePubMed
- Ancelin K, Lange UC, Hajkova P, Schneider R, Bannister AJ, Kouzarides T, Surani MA: Blimp1 associates with Prmt5 and directs histone arginine methylation in mouse germ cells. Nat Cell Biol. 2006, 8: 623-630. 10.1038/ncb1413.View ArticlePubMed
- Pepke S, Wold B, Mortazavi A: Computation for ChIP-seq and RNA-seq studies. Nat Methods. 2009, 6: S22-S32. 10.1038/nmeth.1371.PubMed CentralView ArticlePubMed
- Song J, Fisher D, In Epigenomics: from chromatin biology to therapeutics. 1st edition: Nucleosome positioning in promoters: significance and open questions. 2012, edited by Appasani K Cambridge, Cambridge University PressView Article
- Zhang Y, Shin H, Song JS, Lei Y, Liu XS: Identifying positioned nucleosomes with epigenetic marks in human from ChIP-Seq. BMC Genomics. 2008, 9: 537-10.1186/1471-2164-9-537.PubMed CentralView ArticlePubMed
- Leleu M, Lefebvre G, Rougemont J: Processing and analyzing ChIP-seq data: from short reads to regulatory interactions. Briefings in Functional Genomics and Proteomics. 2011, 9: 466-476.View Article
- Tolstorukov MY, Volfovsky N, Stephens RM, Park PJ: Impact of chromatin structure on sequence variability in the human genome. Nat Struct Mol Biol. 2011, 18: 510-515. 10.1038/nsmb.2012.PubMed CentralView ArticlePubMed
- Jiang C, Pugh BF: Nucleosome positioning and gene regulation: advances through genomics. Nat Rev Genet. 2009, 10: 161-172.View ArticlePubMed
- Liang K, Keles S: Normalization of ChIP-Seq data with control. Submitted. 2012
- Xiong H, Capurso D, Sen Ś, Segal MR: Sequence-based classification using discriminatory motif feature selection. PLoS One. 2011, 6: e27382-10.1371/journal.pone.0027382.PubMed CentralView ArticlePubMed
- Magnan CN, Randall A, Baldi P: SOLpro: accurate sequence-based prediction of protein solubility. Bioinformatics. 2009, 25: 2200-2207. 10.1093/bioinformatics/btp386.View ArticlePubMed
- Breiman L: Random forests. Mach Learn. 2001, 45: 5-32. 10.1023/A:1010933404324.View Article
- Hastie T, Tibshirani R, Friedman J: The Elements of Statistical Learning. 2009, New York, NY: Springer, 2View Article
- Zhao Q, Rank G, Tan YT, Li H, Moritz RL, Simpson RJ, Cerruti L, Curtis DJ, Patel DJ, Allis CD, Cunningham JM, Jane SM: PRMT5-mediated methylation of histone H4R3 recruits DNMT3A, coupling histone and DNA methylation in gene silencing. Nat Struct Mol Biol. 2009, 16: 304-311. 10.1038/nsmb.1568.View ArticlePubMed
- Blagus R, Lusa L: Class prediction for high-dimensional class-imbalanced data. BMC Bioinforma. 2010, 11: 523-10.1186/1471-2105-11-523.View Article
- Breiman L, Friedman J, Stone CJ, Olshen RA: Classification and regression trees. 1984, Boca Raton, FL: CRC
- Bonasio R, Tu S, Reinberg D: Molecular signals of epigenetic states. Science. 2010, 330: 612-616. 10.1126/science.1191078.PubMed CentralView ArticlePubMed
- Eymery A, Callanan M, Vourc’h C: The secret message of heterochromatin: new insights into the mechanisms and function of centromeric and pericentric repeat sequence transcription. Int J Dev Biol. 2009, 53: 259-268. 10.1387/ijdb.082673ae.View ArticlePubMed
- Prosser J, Frommer M, Paul C, Vincent PC: Sequence relationships of three human satellite DNAs. J Mol Biol. 1986, 187: 145-155. 10.1016/0022-2836(86)90224-X.View ArticlePubMed
- Kaplan N, Hughes TR, Lieb JD, Widom J, Segal E: Contribution of histone sequence preferences to nucleosome organization: proposed definitions and methodology. Genome Biol. 2010, 11: 140-10.1186/gb-2010-11-11-140.PubMed CentralView ArticlePubMed
- Fernández M, Miranda-Saavedra D: Genome-wide enhancer prediction from epigenetic signatures using genetic algorithm-optimized support vector machines [published online ahead of print 10 Feb 2012]. Nucleic Acids Res. 2012, -
- Beck D, Brandl MB, Boelen L, Unnikrishnan A, Pimanda JE, Wong JWH: Signal analysis for genome wide maps of histone modifications measured by ChIP-seq [published online ahead of print 27 Feb 2012]. Bioinformatics. 2012, -
- Ringrose L, Paro R: Polycomb/Trithorax response elements and epigenetic memory of cell identity. Development. 2007, 134: 223-232. 10.1242/dev.02723.View ArticlePubMed
- Leslie C, Eskin E, Noble WS: The spectrum kernel: a string kernel for SVM protein classification. Pac Symp Biocomput. 2002, 564-575.
- Leslie C, Kuang R: Fast string kernels using inexact matching for protein sequences. 2004, 5: 1435-1455.
- Ratsch G, Sonnenburg S, Scholkopf B: RASE: recognition of alternatively spliced exons in C. elegans. Bioinformatics. 2005, 21 (1): 369-377. 10.1093/bioinformatics/bti1053.View Article
- Sonnenburg S, Zien A, Philips P, Rätsch G: POIMs: positional oligomer importance matrices–understanding support vector machine-based signal detectors. Bioinformatics. 2008, 24: i6-i14. 10.1093/bioinformatics/btn170.PubMed CentralView ArticlePubMed
- Schultheiss SJ, Busch W, Lohmann JU, Kohlbacher O, Rätsch G: KIRMES: kernel-based identification of regulatory modules in euchromatic sequences. BMC Bioinforma. 2009, 10: O1-View Article
- Zang C, Schones DE, Zeng C, Cui K, Zhao K, Peng W: A clustering approach for identification of enriched domains from histone modification ChIP-Seq data. Bioinformatics. 2009, 25: 1952-1958. 10.1093/bioinformatics/btp340.PubMed CentralView ArticlePubMed
- Chen T, Tsujimoto N, Li E: The PWWP Domain of Dnmt3a and Dnmt3b Is Required for Directing DNA Methylation to the Major Satellite Repeats at Pericentric Heterochromatin. Mol Cell Biol. 2004, 24: 9048-9058. 10.1128/MCB.24.20.9048-9058.2004.PubMed CentralView ArticlePubMed
- Oka M, Rodić N, Graddy J, Chang L-J, Terada N: CpG sites preferentially methylated by Dnmt3a in vivo. J Biol Chem. 2006, 281: 9901-9908. 10.1074/jbc.M511100200.View ArticlePubMed
- Fanelli M, Caprodossi S, Ricci-Vitiani L, Porcellini A, Tomassoni-Ardori F, Amatori S, Andreoni F, Magnani M, De Maria R, Santoni A, Minucci S, Pelicci PG: Loss of pericentromeric DNA methylation pattern in human glioblastoma is associated with altered DNA methyltransferases expression and involves the stem cell compartment. Oncogene. 2008, 27: 358-365. 10.1038/sj.onc.1210642.View ArticlePubMed
- Jurkowska RZ, Jurkowski TP, Jeltsch A: Structure and function of mammalian DNA methyltransferases. ChemBioChem. 2011, 12: 206-222. 10.1002/cbic.201000195.View ArticlePubMed
- Rank G, Cerruti L, Simpson RJ, Moritz RL, Jane SM, Zhao Q: Identification of a PRMT5-dependent repressor complex linked to silencing of human fetal globin gene expression. Blood. 2010, 116: 1585-1592. 10.1182/blood-2009-10-251116.PubMed CentralView ArticlePubMed
- Enukashvily NI, Donev R, Waisertreiger ISR, Podgornaya OI: Human chromosome 1 satellite 3 DNA is decondensed, demethylated and transcribed in senescent cells and in A431 epithelial carcinoma cells. Cytogenet. Genome Res. 2007, 118: 42-54. 10.1159/000106440.View ArticlePubMed
- Ting DT, Lipson D, Paul S, Brannigan BW, Akhavanfard S, Coffman EJ, Contino G, Deshpande V, Iafrate AJ, Letovsky S, Rivera MN, Bardeesy N, Maheswaran S, Haber DA: Aberrant overexpression of satellite repeats in pancreatic and other epithelial cancers. Science. 2011, 331: 593-596. 10.1126/science.1200801.PubMed CentralView ArticlePubMed
- Tsuda H, Takarabe T, Kanai Y, Fukutomi T, Hirohashi S: Correlation of DNA hypomethylation at pericentromeric heterochromatin regions of chromosomes 16 and 1 with histological features and chromosomal abnormalities of human breast carcinomas. Am J Pathol. 2002, 161: 859-866. 10.1016/S0002-9440(10)64246-0.PubMed CentralView ArticlePubMed
- Liaw A, Wiener M: Classification and regression by randomForest. R news. 2002, 2: 18-22.
- Dimitriadou E, Hornik K, Leisch F, Meyer D, Weingessel A: e1071: Misc Functions of the Department of Statistics (e1071), TU Wien. R package version. 2011, 1: 6-
- Sing T, Sander O, Beerenwinkel N, Lengauer T: ROCR: Visualizing the performance of scoring classifiers. R package version. 2009, 1: 4-
- Wang G, Yu T, Zhang W: WordSpy: identifying transcription factor binding motifs by building a dictionary and learning a grammar. Nucleic Acids Res. 2005, 33: W412-W416. 10.1093/nar/gki492.PubMed CentralView ArticlePubMed
- Wang G, Zhang W: A steganalysis-based approach to comprehensive identification and characterization of functional regulatory elements. Genome Biol. 2006, 7: R49-10.1186/gb-2006-7-6-r49.PubMed CentralView ArticlePubMed
- Karolchik D, Hinrichs AS, Furey TS, Roskin KM, Sugnet CW, Haussler D, Kent WJ: The UCSC Table Browser data retrieval tool. Nucleic Acids Res. 2004, 32: D493-D496. 10.1093/nar/gkh103.PubMed CentralView ArticlePubMed
- Jurka J, Kapitonov VV, Pavlicek A, Klonowski P, Kohany O, Walichiewicz J: Repbase Update, a database of eukaryotic repetitive elements. Cytogenet Genome Res. 2005, 110: 462-467. 10.1159/000084979.View ArticlePubMed
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.