Erroneous attribution of relevant transcription factor binding sites despite successful prediction of cis-regulatory modules
© Halfon et al; licensee BioMed Central Ltd. 2011
Received: 1 September 2011
Accepted: 25 November 2011
Published: 25 November 2011
Cis-regulatory modules are bound by transcription factors to regulate gene expression. Characterizing these DNA sequences is central to understanding gene regulatory networks and gaining insight into mechanisms of transcriptional regulation, but genome-scale regulatory module discovery remains a challenge. One popular approach is to scan the genome for clusters of transcription factor binding sites, especially those conserved in related species. When such approaches are successful, it is typically assumed that the activity of the modules is mediated by the identified binding sites and their cognate transcription factors. However, the validity of this assumption is often not assessed.
We successfully predicted five new cis-regulatory modules by combining binding site identification with sequence conservation and compared these to unsuccessful predictions from a related approach not utilizing sequence conservation. Despite greatly improved predictive success, the positive set had similar degrees of sequence and binding site conservation as the negative set. We explored the reasons for this by mutagenizing putative binding sites in three cis-regulatory modules. A large proportion of the tested sites had little or no demonstrable role in mediating regulatory element activity. Examination of loss-of-function mutants also showed that some transcription factors supposedly binding to the modules are not required for their function.
Our results raise important questions about interpreting regulatory module predictions obtained by finding clusters of conserved binding sites. Attribution of function to these sites and their cognate transcription factors may be incorrect even when modules are successfully identified. Our study underscores the importance of empirical validation of computational results even when these results are in line with expectation.
Developmental control of gene expression depends on the activity of transcriptional enhancers, or "cis-regulatory modules" (CRMs) [reviewed by [1, 2]]. These regulatory sequences coordinate the binding of sequence-specific transcription factors and can stimulate transcription of their target genes irrespective of distance, location (5' or 3'), and orientation relative to the transcription start site. A CRM typically contains one or more binding sites for several different transcription factors (TFs), both activators and repressors. Efficient discovery of CRMs in the genome has proven challenging, although significant progress has been made recently with respect to both experimental and bioinformatics approaches . As with many genomic techniques, however, in silico results have accumulated much faster than those from in vivo validation, and many assumptions about both empirically and computationally identified enhancers--including about their functions and the functions of their component binding sites--remain to be rigorously assessed.
Methods for computational enhancer discovery have commonly first attempted to identify the constituent transcription factor binding sites (TFBSs) based on the logic "find the binding sites, find the enhancer" [see reviews by [3–5]]. A serious complicating factor, however, is the fact that TFBS identification carries an unsuitably high false-positive rate in terms of predicting functional binding sites. Noting that this rate can be as high as 1000-fold, Wasserman and Sandelin  have coined the "futility theorem--that essentially all predicted TFBSs will have no functional role." As a result, attempting to identify CRMs solely based on prediction of TFBSs for a single factor tends to be unsuccessful, save for relatively rare exceptions in which the TFBSs are numerous and tightly clustered [e.g. [7, 8]]. Two basic strategies have been used to overcome this problem. One is to assess the conservation of TFBSs across species, on the theory that important sites will be well conserved. The second is to search simultaneously for a cluster of several different TFBSs that comprise the "transcriptional code" for a given pattern of gene expression. This is based on the simple idea that the probability of finding a specific combination of TFBSs within a small sequence window is much smaller (and therefore more significant) than that of finding a single site. While details and implementations differ among methods, on the whole, approaches based on either of these strategies have been able to achieve moderate-to-good success, with the best results tending to occur when the two approaches are combined [e.g. [9–14]]. Nevertheless, where sufficient in vivo validation has been performed, false-positive prediction rates are seen to remain substantial even for some of the best-performing motif-based methods. Despite this, the reasons underlying both successful and false predictions have not been extensively explored.
That false-positive rates remain a problem is perhaps not surprising, given the many factors that could contribute to both real and apparent incorrect predictions. For example, poor prediction of the component TFBSs would lead to a false-positive result, while limitations of the reporter gene assay--incompatible promoters or failure to detect weak activity, for instance--would cause a true prediction to appear as a false-positive upon in vivo validation. True-positive results, on the other hand, are almost invariably assumed to be true as a result of having the correct underlying model, i.e., that the TFBS motifs used as input to the computational search reflect relevant binding sites essential for the activity of the discovered CRM. It is also generally accepted that these TFBSs are bound by the presumed cognate TF. However, in most cases these assumptions are not in fact tested (for example, by mutagenesis of individual TFBSs). We previously showed that another common assumption--that if a predicted CRM maps adjacent to a gene with the expected expression pattern, it must be a valid prediction--does not hold up well to empirical testing . Here, we test the assumption that successful CRM prediction implies prior accurate identification of component TFs and TFBSs by undertaking extensive TFBS mutagenesis on three different CRMs discovered using two different computational approaches. For all three CRMs studied, we show that one or both of the following holds: (1) the majority of TFBSs used to construct the search model make little or no necessary contribution to activity of the CRM, or (2) the transcription factors assumed to be acting at the constituent TFBSs are not in fact involved in regulating activity of the CRM. These results raise questions about the effectiveness and accuracy of using defined sets of conserved TFBSs for CRM discovery and highlight the importance of empirical validation even when results are consistent with initial assumptions.
We previously conducted a computational search for CRMs directing gene expression in the Drosophila embryo by searching for local co-occurrence of specific TFBSs . Specifically, we took as a model a CRM of the gene even skipped (eve) for which we had defined five positively-acting transcription factors (dTcf, Mad, Pnt, Tin, and Twi) that direct eve expression to the embryonic dorsal mesoderm (the Eve MHE)  and searched the genome for regions in which binding sites for all five factors occurred within 500 bp of one another. We then filtered the 647 found regions to select those for which there were at least two instances of the TFBS for each factor (with the exception of dTcf, for which we allowed one or more instances); this "selected subset" comprised 33 putative new CRMs. Of seven sequences tested in vivo for CRM activity in the embryo, we found that one (the Hbr DME) was able to drive gene expression in a pattern closely resembling that of the model Eve MHE enhancer, but the other six failed to function as CRMs completely. Despite the low overall success rate for our computational search (1/7 or 14%), these results demonstrated that the TFBS co-occurrence model we had defined was capable of enabling discovery of similar-acting CRMs .
CRM predictions tested in this study
putative target gene
primary expression pattern
ventral nerve cord, amnioserosa
ventral nerve cord (midline*), amnioserosa
pupal wing, eye, leg and other tissues
somatic and visceral muscle from stage 12 onward
segmentally repeated stripes, mostly ectodermal with limited mesoderm expression in dorsal regions and in the anal ring
Contrary to expectation from our search for dorsal mesoderm regulators, none of these five new CRMs drive a gene expression pattern similar to that of the Eve MHE and Hbr DME and only two (jhamt_cooc102, notum_cooc310) of the new sequences direct any gene expression in the mesoderm at all. We also note that cooc110 would have been scored as "negative" for CRM activity in our previous study, as the pupal tissues where this CRM functions were not assayed in our original validation experiments. Nevertheless, these results represent a significant improvement over the prior round of CRM prediction, which used the same search results but without consideration of sequence conservation.
CRM activity and conservation
p value (Wilcoxon one-sided)
with DME25 switched
The modest apparent contributions of both CRM-wide and TFBS-specific conservation were surprising, given the dramatic increase in prediction success we attained when using conservation as a guide in selecting sequences to validate (83% with CRM activity vs. the previous 14% with CRM activity). We reasoned that there might be several explanations for this result. One, we recognized that the small overall sample size makes these statistics very sensitive to the effects of individual sequences such that a single misclassified predicted element could have a dramatic outcome. For instance, were the element DME25 to be moved from the negative to the positive set, several of our measures of conservation would then show a significant difference (Table 2, row "DME25 switched"). This is an important concern, as we have already seen how such an error could have occurred with respect to cooc110, which regulates gene expression in a tissue not assayed in the 2002 study. Thorough testing of a significantly larger number of predictions would be necessary to rule out this possibility. Two, we may not have identified the appropriate method for scoring conservation. For instance, the peakPhastCons method with a 500 bp window size shows better performance than the other measures, although it would still have led to many incorrect predictions. Other, superior methods may still be found. Three, our measures of TFBS conservation might be inaccurate, given our incomplete knowledge of each TF's binding motif and the limitations of methods for identifying binding sites. That is, we may be incorrectly considering a pair of sites to be non-conserved due to sequence differences that in reality allow equally effective binding, or conversely, attributing conservation to similar sites that do not, in fact, both mediate binding of the correct TF. Finally, we may be erring in which TFBSs to consider. Because our CRM search was predicated on the co-occurrence of five individual TFBSs, our assessment of conservation considered all five motifs. However, we note that none of the new CRMs chosen based on sequence conservation regulate gene expression in the precise dorsal mesoderm pattern seen for the Eve MHE and Hbr DME. Therefore, these CRMs may not have the requirement for binding all five TFs stipulated by our model. In that case, considering the conservation of all five sets of TFBSs would be detrimental, adding the noise of potentially non-conserved non-important sites to the signal of conserved, necessary sites. This interpretation is consistent with the findings of Philippakis et al. , who in an independent search using the same five TFBSs found that not all sites contributed equally to the set of predicted CRMs and that jointly considering all five TFBSs led to a worse result than considering subsets of the TFBSs.
Despite the fact that our search led to successful discovery of new CRMs, the above results suggest that most of the TFBSs on which the search was based have little or no requirement with respect to activity of the identified CRMs. Although the details vary, the basic strategy used in our search--identification of clusters of specific binding sites filtered by evolutionary sequence conservation--has been one of the main approaches taken to computational CRM discovery [3, 4]. We therefore wondered if it might also be the case for other instances of successful CRM discovery that the TFBSs used as input to the search would not turn out to be major functional components of the identified CRMs. To test this, we examined the role of Pnt binding sites in the mib2 mesodermal enhancer (REDfly: mib2_FCenhancer) discovered in the computational search of Philippakis et al. . This search used a sophisticated computational algorithm, ModuleFinder, based on TFBS motifs and sequence conservation, to identify sequences containing binding sites for Pnt, Twi, and Tin (a subset of the sites used in our own original search). Subsequent filtering based on microarray-derived gene expression profiles, based on a model in which these three TFs serve as activators of gene expression, was used to choose candidates for in vivo testing. Importantly, the Philippakis et al. model was explicitly optimized for relevant binding sites (those contributing signal, not noise, to the search). In addition, not only did the mib2 CRM score high in this search, but mib2 was among a subset of genes determined to be highly upregulated in pnt gain-of-function microarray experiments . Contrary to expectation, mutation of the five putative Pnt binding sites identified by the ModuleFinder search, plus two additional sites that were also potential matches to the Pnt binding motif (Additional File 1, Fig. S1), caused an expansion, rather than a reduction, in reporter gene expression (Figure 2H). Expression of the wild-type mib2 CRM reporter in the visceral mesoderm is restricted to the muscle founder cell population, but with the mutated CRM it expands throughout the visceral mesoderm. This expansion is not seen in pnt null mutant embryos (using either the wild type reporter construct or direct detection of mib2 expression by in situ hybridization; data not shown). Neither is it seen in embryos mutant for the repressor Yan (FlyBase: aop), which is known to bind the same sequences as Pnt (data not shown). Similar to what we observed for jhamt_cooc102, therefore, it is possible that when constructing our Pnt-site mutations we inadvertently disrupted sites for a different TF. We did observe a gain of reporter gene activity in a subset of cells in the ventral midline, at least part of which appears to result from loss of repression mediated by Yan (Figure 2I, J). These results show that there is in fact a functional role for what were described as Pnt binding sites in the mib2 CRM. However, this role appears to be a minor one relative to the presumed primary activating role implicit in the model used to construct the computational search. Thus for a CRM found by the ModuleFinder algorithm , just as for the CRMs identified through our own TFBS co-occurrence based search, TFBSs that formed the basis of a successful prediction may not play a large role in mediating activity of the discovered CRM. Furthermore, the TF believed to be acting via those TFBSs was incorrectly attributed.
Clustering of TFBSs, singly or in combination, has frequently been used as a method for computational CRM discovery. While false-positive prediction rates remain high for many studies, when CRMs are positively identified by these methods, it is assumed that the TFBSs that were used as input to the prediction algorithm are important functional regulators of the CRM's activity, as are the transcription factors that bind to these sites. Although in some cases this has been shown to be the case [e.g. ], more often than not the assumption is allowed to rest unchallenged. Here, we show through extensive empirical testing in vivo that many of these specific TFBSs, and/or their assumed cognate transcription factors, appear to be relatively or completely unimportant for CRM activity. This leads to the somewhat paradoxical result that although consideration of the putative TFBSs led to successful CRM discovery, the sites in many cases do not appear to be functional CRM constituents. What explains this finding?
One relatively trivial answer would be if most randomly selected sequences could act as CRMs in a reporter gene assay. However, we discount this possibility based on our own initial search results in which only one out of seven tested sequences showed regulatory activity ; on similar results by others (see e.g. Table S8 in , and ref. ); and on considerable amounts of anecdotal data suggesting that despite the relative compactness of the D. melanogaster genome, many if not most sequences will test negative. A further possible explanation would be if most conserved sequences acted as CRMs. Again, however, it is hard to credit this scenario given the close similarities in extent of conservation seen with true- versus false-positive predictions by both ourselves and others (e.g., Table 2 and ).
It could also be that the input TFBSs are indeed functional, and that our assay failed to confirm this. For instance, there may be subtle quantitative effects. Or, we may have failed to identify additional binding sites, in which case the sites we mutated may be functional but not essential, due to the presence of other, redundant sites for the same TFs. Ruling out such possibilities will require extensive testing of each individual CRM and TFBS. We do note that chromatin immunoprecipitation experiments have failed to find evidence of Tin or Twi binding to either the notum_cooc310 or the jhamt_cooc102 loci [25, 26], consistent with the lack of phenotype we observed upon TFBS mutation. We also point out that we only chose to mutate the sites identified in our original CRM-prediction search, using motif definitions and methods available at that time. Although searching using updated motif data and/or different search algorithms and parameters does suggest potential additional sites for some of the TFs (data not shown), mutagenizing these sites would prohibit the key assessment we make here: given successful CRM prediction using a specific set of identified TFBSs, are those specific sites and/or their cognate TFs necessary for CRM function? In effect, taking into consideration TFBSs not part of the original CRM prediction would be little different from a situation in which we would take the discovered CRM and run a post-hoc analysis that finds a previously unrecognized site for a TF not part of the search model. While we could later show such a TFBS to be functional, we could not claim it as a basis for discovering the CRM in the first place.
We favor the view that identification of conserved TFBSs can aid in CRM discovery, but suggest that great care must be taken in imputing functional roles to these sites in light of the high false positive rates inherent in TFBS prediction. The ability of confirmed in vivo TF binding to enable CRM discovery has been clearly demonstrated by ChIP-based studies [e.g. [25–28] (although even in vivo binding does not necessarily connote function , and computational predictions can sometimes outperform ChIP-based ones ). However, in general computational methods are poor at distinguishing functional from non-functional TFBSs. The explanation best supported by our data is that it is necessary to identify functional rather than just putative TFBSs. Many of the putative TFBSs we tested turned out to be nonfunctional, and we suggest that these added enough noise to our search results that we could not reliably demonstrate the utility of the functional conserved sites in driving success of the search. In two of our three tested CRMs, we did observe that some of the considered TFBSs were functional. Although their roles were relatively minor with respect to the complete expression patterns regulated by the CRMs, we posit that, as bona fide TFBSs, they were sufficient to aid in CRM discovery. On the other hand, the TFBS with the most essential role, the Pnt binding site in jhamt_cooc102, was not strongly conserved and therefore not likely to have contributed significantly to the improvement in search success rates achieved by considering TFBS conservation.
Simultaneous searching for TFBSs for several TFs has often been proposed as one means to reduce false-positive rates for purposes of CRM discovery, and a number of studies, including the present one, support its basic effectiveness. However, our results raise important questions about interpreting successful predictions using such an approach: many of the different sites we identified, even when co-clustered, appear to be non-functional. This is true even though the combinations of sites that served as input into the searches were selected as part of the "transcriptional code" for the genes being sought. For example, although jhamt_cooc102 drives gene expression in the mesoderm, both our results and ChIP data from the Furlong lab [25, 26] suggest that this expression is mediated by neither Tin nor Twi, two well-known mesoderm-specific TFs (although jhamt_cooc102 does appear to be bound by Mef2, another mesoderm-specific TF ). Similarly, while the search for mib2_FCenhancer was focused on joint occurrence of Tin + Twi + Pnt, not only does mutagenesis of the putative Pnt sites have a de-repressive rather than negative effect on the CRM, but the CRM is fully functional even in the complete absence of the pnt gene. Thus our ability to understand so-called transcriptional codes and make use of them in a prospective manner may be less than we believe. Considering the combinatorics of TF binding, rather than being important in order to increase the probability of zeroing in on the right assortment of binding sites, may simply increase the probability of finding some functional sites by virtue of increasing the total number of sites being predicted.
Recent studies in yeast raise similar concerns about assuming functional roles for TFs based on the presence and conservation of putative TFBS sequences . Despite the simpler S. cerivisiae gene structure in which most regulatory interactions take place within the roughly one-half kilobase of sequence upstream of the transcription start site, many conserved predicted TFBSs were shown to be non-functional, and many functional sites not well conserved. These data, taken together with the results presented here, underscore the importance of conducting thorough empirical validation of computational predictions even when results seem to be in line with expectation.
Prediction of new CRMs
CRM predictions are described in . Alignments of the 647 elements identified in that search to D. pseudoobscura, based on the AVID alignment software , were obtained from the Berkeley Drosophila Genome Project (pipeline version 8 July 2003, http://pipeline.lbl.gov/pseudo/). Elements that ranked high in both overall and TFBS conservation were chosen for in vivo testing. Sequences and additional information for the tested CRMs are provided in Table 1 and are available via the REDfly database (http://redfly.ccr.buffalo.edu; ).
AVID alignments were obtained as described above. The value reported in Table 2 is the percentage of conserved nucleotides within the sequence of the in vivo tested CRM. The aligned regions were then extended 700 bp in each direction from the ends of the D. melanogaster CRM sequences, and the resulting D. melanogaster and D. pseudoobscura sequences were realigned using DIALIGN . Ends of the aligned regions were defined as the borders of the first and last conserved ungapped blocks, respectively, that contained one of the TFBSs defined for the CRM, and the overall percentage of aligned nucleotides contained within conserved blocks reported. PhastCons scores  were obtained from the UCSC Genome Browser  based on the tested CRM sequences. The "peakPhastCons" method was performed as described by  with window sizes of 100, 200, and 500 bp and a cutoff of 0.13, except that only the sequences of the tested CRMs were analyzed (i.e., the first scored window began at the first basepair of the CRM and the last window ended at the final basepair of the CRM).
Reporter constructs, transgenesis, and mutagenesis
Reporter constructs, site-directed mutagenesis, fly transgenesis, and analysis were all as previously described  except that for some constructs, GFP was used as the reporter instead of lacZ. Mutagenized sites are shown in Fig. S1. Ability of the specified basepair changes to abrogate binding of the relevant TFs has been shown previously . DIC microscopy was performed using a Zeiss Axioskop 2 microscope with a Retiga-EXi camera (Qimaging) and Openlab software (PerkinElmer). Fluorescent images were acquired using a Leica SP2 confocal microscope. All images were color corrected and contrast adjusted in Adobe photoshop.
We thank Kathy Gibbs, Jack Leatherbarrow, and Qiyun Zhu for providing assistance in making constructs and with fly genetics, and Alan Michelson for providing mib2-lacZ flies. Some of this work was started in the Michelson laboratory. Yonatan Grad contributed some early sequence alignments. We thank Saurabh Sinha and Michael Buck for helpful comments on the manuscript. This work was funded by NIH grants K22 HG002489 and R01 GM85233.
- Maston GA, Evans SK, Green MR: Transcriptional regulatory elements in the human genome. Annu Rev Genomics Hum Genet. 2006, 7: 29-59. 10.1146/annurev.genom.7.080505.115623.View ArticlePubMedGoogle Scholar
- Noonan JP, McCallion AS: Genomics of long-range regulatory elements. Annu Rev Genomics Hum Genet. 2010, 11: 1-23. 10.1146/annurev-genom-082509-141651.View ArticlePubMedGoogle Scholar
- Haeussler M, Joly JS: When needles look like hay: how to find tissue-specific enhancers in model organism genomes. Dev Biol. 2011, 350 (2): 239-254. 10.1016/j.ydbio.2010.11.026.View ArticlePubMedGoogle Scholar
- Van Loo P, Marynen P: Computational methods for the detection of cis-regulatory modules. Brief Bioinform. 2009, 10 (5): 509-524. 10.1093/bib/bbp025.View ArticlePubMedGoogle Scholar
- Vavouri T, Elgar G: Prediction of cis-regulatory elements using binding site matrices -- the successes, the failures and the reasons for both. Current Opinion in Genetics & Development. 2005, 15 (4): 395-402. 10.1016/j.gde.2005.05.002.View ArticleGoogle Scholar
- Wasserman WW, Sandelin A: Applied bioinformatics for the identification of regulatory elements. Nat Rev Genet. 2004, 5 (4): 276-287. 10.1038/nrg1315.View ArticlePubMedGoogle Scholar
- Markstein M, Markstein P, Markstein V, Levine MS: Genome-wide analysis of clustered Dorsal binding sites identifies putative target genes in the Drosophila embryo. Proc Natl Acad Sci USA. 2002, 99 (2): 763-768. 10.1073/pnas.012591199.View ArticlePubMedGoogle Scholar
- Ochoa-Espinosa A, Yucel G, Kaplan L, Pare A, Pura N, Oberstein A, Papatsenko D, Small S: The role of binding site cluster strength in Bicoid-dependent patterning in Drosophila. PNAS. 2005, 0500373102-Google Scholar
- Berman BP, Pfeiffer BD, Laverty TR, Salzberg SL, Rubin GM, Eisen MB, Celniker SE: Computational identification of developmental enhancers: conservation and function of transcription factor binding-site clusters in Drosophila melanogaster and Drosophila pseudoobscura. Genome Biol. 2004, 5 (9): R61-10.1186/gb-2004-5-9-r61.View ArticlePubMedPubMed CentralGoogle Scholar
- Grad YH, Roth FP, Halfon MS, Church GM: Prediction of similarly acting cis-regulatory modules by subsequence profiling and comparative genomics in Drosophila melanogaster and D.pseudoobscura. Bioinformatics. 2004, 20 (16): 2738-2750. 10.1093/bioinformatics/bth320.View ArticlePubMedGoogle Scholar
- Halfon MS, Grad Y, Church GM, Michelson AM: Computation-based discovery of related transcriptional regulatory modules and motifs using an experimentally validated combinatorial model. Genome Res. 2002, 12 (7): 1019-1028.PubMedPubMed CentralGoogle Scholar
- Krivan W, Wasserman WW: A predictive model for regulatory sequences directing liver-specific transcription. Genome Res. 2001, 11 (9): 1559-1566. 10.1101/gr.180601.View ArticlePubMedPubMed CentralGoogle Scholar
- Philippakis AA, Busser BW, Gisselbrecht SS, He FS, Estrada B, Michelson AM, Bulyk ML: Expression-Guided In Silico Evaluation of Candidate Cis Regulatory Codes for Drosophila Muscle Founder Cells. PLoS Computational Biology. 2006, 2 (5): e53-10.1371/journal.pcbi.0020053.View ArticlePubMedPubMed CentralGoogle Scholar
- Schroeder MD, Pearce M, Fak J, Fan H, Unnerstall U, Emberly E, Rajewsky N, Siggia ED, Gaul U: Transcriptional Control in the Segmentation Gene Network of Drosophila. PLoS Biology. 2004, 2 (9): e271-10.1371/journal.pbio.0020271.View ArticlePubMedPubMed CentralGoogle Scholar
- Halfon MS, Carmena A, Gisselbrecht S, Sackerson CM, Jimenez F, Baylies MK, Michelson AM: Ras pathway specificity is determined by the integration of multiple signal-activated and tissue-restricted transcription factors. Cell. 2000, 103 (1): 63-74. 10.1016/S0092-8674(00)00105-7.View ArticlePubMedGoogle Scholar
- Negre N, Brown CD, Shah PK, Kheradpour P, Morrison CA, Henikoff JG, Feng X, Ahmad K, Russell S, White RA, Stein L, Henikoff S, Kellis M, White KP: A comprehensive map of insulator elements for the Drosophila genome. PLoS Genet. 2010, 6 (1): e1000814-10.1371/journal.pgen.1000814.View ArticlePubMedPubMed CentralGoogle Scholar
- Niwa R, Niimi T, Honda N, Yoshiyama M, Itoyama K, Kataoka H, Shinoda T: Juvenile hormone acid O-methyltransferase in Drosophila melanogaster. Insect biochemistry and molecular biology. 2008, 38 (7): 714-720. 10.1016/j.ibmb.2008.04.003.View ArticlePubMedGoogle Scholar
- Morgenstern B: DIALIGN 2: improvement of the segment-to-segment approach to multiple sequence alignment. Bioinformatics. 1999, 15 (3): 211-218. 10.1093/bioinformatics/15.3.211.View ArticlePubMedGoogle Scholar
- Siepel A, Bejerano G, Pedersen JS, Hinrichs AS, Hou M, Rosenbloom K, Clawson H, Spieth J, Hillier LW, Richards S, Weinstock GM, Wilson RK, Gibbs RA, Kent WJ, Miller W, Haussler D: Evolutionarily conserved elements in vertebrate, insect, worm, and yeast genomes. Genome Res. 2005, 15 (8): 1034-1050. 10.1101/gr.3715005.View ArticlePubMedPubMed CentralGoogle Scholar
- Kent WJ, Sugnet CW, Furey TS, Roskin KM, Pringle TH, Zahler AM, Haussler D: The human genome browser at UCSC. Genome Res. 2002, 12 (6): 996-1006.View ArticlePubMedPubMed CentralGoogle Scholar
- Su J, Teichmann SA, Down TA: Assessing computational methods of cis-regulatory module prediction. PLoS Comput Biol. 2010, 6 (12): e1001020-10.1371/journal.pcbi.1001020.View ArticlePubMedPubMed CentralGoogle Scholar
- Li L, Zhu Q, He X, Sinha S, Halfon M: Large-scale analysis of transcriptional cis-regulatory modules reveals both common features and distinct subclasses. Genome Biology. 2007, 8 (6): R101-10.1186/gb-2007-8-6-r101.View ArticlePubMedPubMed CentralGoogle Scholar
- Estrada B, Choe SE, Gisselbrecht SS, Michaud S, Raj L, Busser BW, Halfon MS, Church GM, Michelson AM: An Integrated Strategy for Analyzing the Unique Developmental Programs of Different Myoblast Subtypes. PLoS Genetics. 2006, 2 (2): e16-10.1371/journal.pgen.0020016.View ArticlePubMedPubMed CentralGoogle Scholar
- Kantorovitz MR, Kazemian M, Kinston S, Miranda-Saavedra D, Zhu Q, Robinson GE, Gottgens B, Halfon MS, Sinha S: Motif-blind, genome-wide discovery of cis-regulatory modules in Drosophila and mouse. Dev Cell. 2009, 17 (4): 568-579. 10.1016/j.devcel.2009.09.002.View ArticlePubMedPubMed CentralGoogle Scholar
- Liu YH, Jakobsen JS, Valentin G, Amarantos I, Gilmour DT, Furlong EE: A systematic analysis of Tinman function reveals Eya and JAK-STAT signaling as essential regulators of muscle development. Dev Cell. 2009, 16 (2): 280-291. 10.1016/j.devcel.2009.01.006.View ArticlePubMedGoogle Scholar
- Sandmann T, Girardot C, Brehme M, Tongprasit W, Stolc V, Furlong EEM: A core transcriptional network for early mesoderm development in Drosophila melanogaster. Genes Dev. 2007, 21 (4): 436-449. 10.1101/gad.1509007.View ArticlePubMedPubMed CentralGoogle Scholar
- Visel A, Blow MJ, Li Z, Zhang T, Akiyama JA, Holt A, Plajzer-Frick I, Shoukry M, Wright C, Chen F, Afzal V, Ren B, Rubin EM, Pennacchio LA: ChIP-seq accurately predicts tissue-specific activity of enhancers. Nature. 2009, 457 (7231): 854-858. 10.1038/nature07730.View ArticlePubMedPubMed CentralGoogle Scholar
- Zeitlinger J, Zinzen RP, Stark A, Kellis M, Zhang H, Young RA, Levine M: Whole-genome ChIP-chip analysis of Dorsal, Twist, and Snail suggests integration of diverse patterning processes in the Drosophila embryo. Genes Dev. 2007, 21 (4): 385-390. 10.1101/gad.1509607.View ArticlePubMedPubMed CentralGoogle Scholar
- Li XY, MacArthur S, Bourgon R, Nix D, Pollard DA, Iyer VN, Hechmer A, Simirenko L, Stapleton M, Luengo Hendriks CL, Chu HC, Ogawa N, Inwood W, Sementchenko V, Beaton A, Weiszmann R, Celniker SE, Knowles DW, Gingeras T, Speed TP, Eisen MB, Biggin MD: Transcription factors bind thousands of active and inactive regions in the Drosophila blastoderm. PLoS Biol. 2008, 6 (2): e27-10.1371/journal.pbio.0060027.View ArticlePubMedPubMed CentralGoogle Scholar
- Kazemian M, Blatti C, Richards A, McCutchan M, Wakabayashi-Ito N, Hammonds AS, Celniker SE, Kumar S, Wolfe SA, Brodsky MH, Sinha S: Quantitative analysis of the Drosophila segmentation regulatory network using pattern generating potentials. PLoS Biol. 2010, 8 (8):Google Scholar
- Sandmann T, Jensen LJ, Jakobsen JS, Karzynski MM, Eichenlaub MP, Bork P, Furlong EE: A temporal map of transcription factor activity: mef2 directly regulates target genes at all stages of muscle development. Dev Cell. 2006, 10 (6): 797-807. 10.1016/j.devcel.2006.04.009.View ArticlePubMedGoogle Scholar
- Kahana S, Pnueli L, Kainth P, Sassi HE, Andrews B, Kassir Y: Functional dissection of IME1 transcription using quantitative promoter-reporter screening. Genetics. 2010, 186 (3): 829-841. 10.1534/genetics.110.122200.View ArticlePubMedPubMed CentralGoogle Scholar
- Bray N, Dubchak I, Pachter L: AVID: A global alignment program. Genome Res. 2003, 13 (1): 97-102. 10.1101/gr.789803.View ArticlePubMedPubMed CentralGoogle Scholar
- Gallo SM, Gerrard DT, Miner D, Simich M, Des Soye B, Bergman CM, Halfon MS: REDfly v3.0: toward a comprehensive database of transcriptional regulatory elements in Drosophila. Nucleic Acids Res. 2011, D118-123. 39 DatabaseGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.