- Open Access
Inferring gene regulatory networks by thermodynamic modeling
BMC Genomicsvolume 9, Article number: S19 (2008)
To date, the reconstruction of gene regulatory networks from gene expression data has primarily relied on the correlation between the expression of transcription regulators and that of target genes.
We developed a network reconstruction method based on quantities that are closely related to the biophysical properties of TF-TF interaction, TF-DNA binding and transcriptional activation and repression. The Network-Identifier method utilized a thermodynamic model for gene regulation to infer regulatory relationships from multiple time course gene expression datasets. Applied to five datasets of differentiating embryonic stem cells, Network-Identifier identified a gene regulatory network among 87 transcription regulator genes. This network suggests that Oct4, Sox2 and Klf4 indirectly repress lineage specific differentiation genes by activating transcriptional repressors of Ctbp2, Rest and Mtf2.
Transcriptional control is a key regulatory mechanism for cells to direct their destinies. A large number of transcription factors (TFs) could simultaneously bind to a regulatory sequence. With the constellation of TFs bound, the expression level of a target gene is usually determined by the combinatorial control of a number of TFs. The interactions among regulatory proteins and their regulatory sequences collectively form a regulatory network. A major challenge in the study of gene regulation is to identify the interaction relationships within a regulatory network.
A number of analytical methods have been proposed to reconstruct gene regulatory networks from gene expression and protein-DNA binding data. Association rule mining , Boolean Network , temporal models [3, 4], ARACNE  and Bayesian networks [6–8] are among the most popular routes. For example, the Module Networks approach built a probabilistic model for the gene expression correlations between regulators and target genes and iteratively searched for the most compatible partition of targets genes to their respective regulators . The correlation of gene expression patterns of regulators and the target genes is often the essential piece of information utilized by the current procedures. It is widely recognized that the statistical correlation of the regulators and the targets is often an inaccurate representation of the regulator-target relationship [10, 11]. This is because the quantity of a TF's mRNA does not necessarily correlate to its active protein concentration, and even the active protein concentration does not necessarily correlate to its transcriptional efficiency on every target gene. Using correlation, or some transformed version of correlation measure as the basis for reconstructing regulatory networks is an approximation made for convenience of modeling and analysis, with a sacrifice of making spurious findings (see examples in ). A network reconstruction method based on quantities that closely represent the biophysical properties of TF-DNA binding, transcription activation and repression is still missing.
Thermodynamic models of TF-DNA and TF-RNA polymerase (RNAP) interactions were pioneered by Buchler et al.  in prokaryotes. These models brought the stochastic interactions of TFs, regulatory sequences and RNAP into a statistical mechanics framework, and enabled a quantitative model for the transcription rate. Recently, Segal et al.  and our team  attempted to employ thermodynamic models in the study of eukaryotic gene regulation. Under a fix time point in drosophila development, Segal et al. demonstrated a thermodynamic model could predict the spatial expression patterns of segmentation genes in Drosophila . In differentiating embryonic stem cells (ESCs), we showed that the interaction types of the TFs could be predicted from the temporal response of the target gene . These successes made it tempting to experiment novel methods for reconstructing regulatory networks based on more biophysically appropriate metrics than correlation.
We describe here a computational framework, called Network-Identifier, for inferring regulatory networks from time course gene expression data. The gene expression values at each time point are supposed to be at an equilibrium state, which is a general setting for most of time course data available. Applying to the analysis of five datasets of differentiation of murine ESCs, we identified a transcription network composed of 34 TF-TF interactions and 185 TF-target relationships. Data from RNAi  and chromatin immunoprecipitation coupled with microarray (ChIP-chip) data [16, 17] independently validated a statistically highly significant fraction of these regulatory relationships.
Gene regulatory network in mouse ESCs
ESCs are derived from early mammalian embryos. ESCs possess two important characteristics that distinguish their importance in scientific and medical fields. First, they are capable of self-renewal through apparently unlimited, undifferentiated proliferation in cultured cell lines [18–20]; second, they have remarkable pluripotency potentials  to give rise to many different cell types in the body, which may contribute to the study of body development and regenerative medicine.
We employed five time series microarray datasets of mouse ESCs in this study, including a dataset for retinoid acid induced differentiation  and four datasets for spontaneous differentiation of four ESC lines (three lines from ; one unpublished, S.Z. and W.H.W, manuscript in preparation). We restricted the analysis to the regulatory relationships among 747 genes that are annotated by Gene Ontology term Transcription Regulator Activity, and are present on the Affymetrix U72av2 array. We designated six known TFs, Oct4, Sox2, Nanog, Klf4, Esrrb and Tcl1 as regulators of this system, due to their previously characterized role in ESCs. Interaction-Identifier  was applied to each time course microarray dataset. A list of common TF Interaction forms across datasets was then generated by Evidence merger. Genes were then grouped by their predicted regulators as well as their roles of regulation, i.e. activator and repressor. Twelve gene groups were formed. ChIP-chip data are available for Oct4, Sox2, Nanog and Klf4. Five out of eight regulatory-target relationships involving these four regulators were significantly enriched with ChIP-chip verified relationships (Table 1). RNA knock-out experiments were performed for all the six regulators [15, 17]. Nine out of twelve target gene groups involving these six regulators were enriched with RNAi verified regulatory relationships (Table 2). Note that when using RNAi data for testing the predicted regulatory role of a TF, we only counted the target genes whose changes of expression were in the consistent direction to the predicted role of its TF, but not counting all targets genes with any changes to both directions. These tests demonstrated that the predicted regulatory relationships were in general consistent to those derived from independent experiments.
Finally, Network-Identifier identified the regulatory relationships that were predicted by expression data and had consistent evidence from either RNAi or ChIP-chip data. We used Cytoscape  to display the final reported regulatory relationships (Figure 1).
87 regulators and target genes were reported in the ESC transcription network (Figure 1). In particular, the mutual regulation of Klf2 and Klf4 were recently shown to be an important module for maintaining the undifferentiated state of ESCs . Utf1 and Myc are known to be key ESC transcription factors. The result that they are under the control of Oct4 and Klf4 underscores the importance of Klf4 in promoting self-renewal. Mtf2 has only recently been implied to inhibit differentiation by recruiting the polycomb group of transcription repressors . This analysis indicates that Klf4 and Sox2 could synergistically activate Mtf2 in ESCs. The regulatory relationships for a number of genes involved in lineage specific differentiation were also identified. These include Gata6, Gata3, Sox17 and FoxA2. Inhibiting these lineage specific differentiation genes in ESCs is critical to maintain an undifferentiated state. Among the predicted network, there were a number of transcription repressors, including Ctpb2 and Rest. Ctpb2 was predicted to be activated by Oct4. Rest was predicted to be jointly regulated by Oct4 and Sox2. These results suggest that Oct4 and Sox2 could indirectly inhibit differentiation genes by activating transcription repressors such as Ctpb2 and Rest.
Network-Identifier is proposed to reconstruct transcription network based on biophysical models of transcription regulation. Multiple temporal gene expression datasets are used as inputs to Network-Identifier. ChIP-chip and RNAi data can also be utilized by Network-Identifier as independent validation datasets to further improve the predicted networks. Moreover, Network-Identifier has great flexibility in incorporating independent datasets other than ChIP-chip or RNAi data to reinforce the strength of validation.
It should be recognized that there are still a number of simplifications made in the modeling of the biophysical properties of gene regulation. A number of molecular events are not included in the model. These include: 1) the interactions of more than two TFs, 2) long range interaction of enhancer binding TFs and RNAP, 3) DNA methylation and 4) chromatin structure and state. Future work that takes these molecular features and events into account will potentially improve the accuracy of network reconstruction.
Revisiting the Interaction-Identifier method
We previously described the Interaction-Identifier method for identification of the candidate form of interaction among TFs and RNAP on the promoter of a target gene . Interaction-Identifier models how a given TF interaction form affects the transcript concentrations of a target gene at steady states. Searching the space of TF interaction forms, it identifies the form that minimizes the difference between model-derived target concentrations and the observed expression data. The method is composed of three components: (1) a thermodynamic model for translating a TF interaction form and TF concentrations into the equilibrium probability of RNAP binding to the promoter of the target gene; (2) a kinetic model for derivation of steady state transcript concentrations of the target gene; and (3) matching gene expression data to model-derived steady state concentrations and identifying the underlining TF interaction form (Figure 2).
Thermodynamic models for RNAP binding
Thermodynamic models are based on the assumption that the level of gene expression is proportional to the equilibrium probability that RNAP binds to the promoter of interest; and these probabilities can be computed in a statistical mechanics framework. The Interaction-Identifier method follows recent efforts [12, 25, 26] to translate TF concentrations into the equilibrium probability of RNAP binding using thermodynamic models.
Considering the transcription of the target gene is regulated by only one TF on its promoter, a promoter can then take one of the four possible states: (1) both the TF and the RNAP bind with the promoter; (2) Only the RNAP binds to the promoter; (3) Only the TF binds to the promoter; (4) neither the TF nor the RNAP binds with the promoter, where let the weight of promoter with no RNAP or TF be 1 and the weights q p , q TF and w TFp q p q TF denote the ratios between the probabilities of states 2, 3, 4, respectively. The probability of the promoter of the target gene being bound with an RNAP is:
A TF can serve as either an activator or a repressor, or simply it does not interact with the RNAP, represented by different w TFp . These effects can be simulated by choosing appropriate w TFp . If w is set to 1, it represents that RNAP and the TF independently bind to the promoter. If w is set to 10~100, it represents that the TF helps to recruit RNAP to the promoter. The larger w is the higher the synergism is. If w is set to 0 or close to 0, it represents that the TF blocks the RNAP binding, and thus the TF is a repressor.
Under the statistical mechanics framework, similar expressions can be derived for genes with two regulatory TFs capable of binding to a promoter together with RNAP. By adjusting the interaction factors w, we can obtain an analytical form for the probability of RNAP binding under different forms of interactions among RNAP and the two TFs.
A kinetic model for equilibrium transcript concentration
The equilibrium concentration of the transcripts of a target gene is governed by its synthesis and degradation rates. Empirical data show that mRNA synthesis rate is proportional to the equilibrium probability of RNAP binding to promoters [12, 25, 26]. Interaction-Identifier further assumes that mRNA degradation rate is proportional to its concentration, which seems to be a reasonable assumption based on recent studies [27, 28]. However the authors can always relax this assumption into more general forms at the model evaluation and model improvement stages. Empirical data on eukaryotic mRNA synthesis and degradation are available to estimate these rates [27–29]. Ordinary equations are used to implement this kinetic model.
Inferring gene regulatory network
A computational framework for inferring gene regulatory networks (Network-Identifier) was developed based on thermodynamic modeling of transcription regulation. Network-Identifier requires more than one time course microarray experiments for the same biological process as input datasets. The method has three components: 1) Interaction-Identifier , 2) Evidence merger and 3) Verification component (Figure 3). For each time course dataset, Network-Identifier enumerates all possible regulatory forms on each target gene. These interaction forms include the activation or repression by a single TF, and the five interaction forms between any two TFs. Network-Identifier evaluates the fitness of each interaction form with Interaction-Identifier and ranks them according to their fitness. The 10 most likely interaction forms of TFs on a target gene are recorded as the Top-10 List. A built-in cutoff (default = 0.8) for Interaction-Identifier eliminates any interaction that is not well supported by data. It is therefore possible for a target gene to have less than 10 candidate TF interaction forms in its Top-10 List. The Top-10 Lists from every dataset are passed onto Evidence merger, which searches for the most frequently appeared interaction form in the Top-10 Lists of a target gene. This most frequently identified interaction form is passed onto the verification component. The verification component groups target genes according to their TF interaction forms. For each regulator-target relationship, for example TF-1 represses gene a, the target genes grouped into this relationship are subject to statistical tests. Chi-square tests are used to test whether the identified TF-target relationships are enriched with regulatory relationships identified from independent experimental data, such as ChIP-chip and RNAi data. Finally, if the tests are all insignificant, Network-Identifier will fail to report any regulatory network. If some of these tests are significant, suggesting there is consistency between the expression-derived regulatory relationships and those found by independent methods, Network-Identifier will invoke a compromise algorithm to report the regulatory relationships that are confirmed by at least two independent data sources. Currently the implemented compromise algorithm is to require the regulatory relationship identified by expression data to be reproduced in at least one of the two other experiments: ChIP-chip and RNAi. It is easy to substitute this algorithm with more sophisticated algorithms  or when some of the independent data are not available.
Creighton C, Hanash S: Mining gene expression databases for association rules. Bioinformatics. 2003, 19 (1): 79-86. 10.1093/bioinformatics/19.1.79.
Davidich MI, Bornholdt S: Boolean network model predicts cell cycle sequence of fission yeast. PLoS ONE. 2008, 3 (2): e1672-10.1371/journal.pone.0001672.
Chen CT, Wang JC, Cohen BA: The strength of selection on ultraconserved elements in the human genome. Am J Hum Genet. 2007, 80 (4): 692-704. 10.1086/513149.
Wu FX: Stability analysis of genetic regulatory networks with multiple time delays. Conf Proc IEEE Eng Med Biol Soc. 2007, 2007: 1387-90.
Margolin AA: Reverse engineering cellular networks. Nat Protoc. 2006, 1 (2): 662-71. 10.1038/nprot.2006.106.
Hughes TR: Functional discovery via a compendium of expression profiles. Cell. 2000, 102 (1): 109-26. 10.1016/S0092-8674(00)00015-5.
Husmeier D: Sensitivity and specificity of inferring genetic regulatory interactions from microarray experiments with dynamic Bayesian networks. Bioinformatics. 2003, 19 (17): 2271-82. 10.1093/bioinformatics/btg313.
Kim S, Imoto S, Miyano S: Inferring gene networks from time series microarray data using dynamic Bayesian networks. Briefings in Bioinformatics. 2003, 4: 228-235. 10.1093/bib/4.3.228.
Segal E: Module networks: identifying regulatory modules and their condition-specific regulators from gene expression data. Nat Genet. 2003, 34 (2): 166-76. 10.1038/ng1165.
Cho KH: Inferring biomolecular regulatory networks from phase portraits of time-series expression profiles. FEBS Lett. 2006, 580 (14): 3511-8. 10.1016/j.febslet.2006.05.035.
Stuart JM: A gene-coexpression network for global discovery of conserved genetic modules. Science. 2003, 302 (5643): 249-55. 10.1126/science.1087447.
Buchler NE, Gerland U, Hwa T: On schemes of combinatorial transcription logic. Proc Natl Acad Sci USA. 2003, 100 (9): 5136-41. 10.1073/pnas.0930314100.
Segal E: Predicting expression patterns from regulatory sequence in Drosophila segmentation. Nature. 2008, 451 (7178): 535-40. 10.1038/nature06496.
Chen C, Zhu X, Zhong S: Selection of thermodynamic models for combinatorial control of multiple transcription factors in early differentiation of embryonic stem cells. BMC Genomics. 2008, 9 (Suppl 1): S18-10.1186/1471-2164-9-S1-S18.
Ivanova N: Dissecting self-renewal in stem cells with RNA interference. Nature. 2006, 442 (7102): 533-8. 10.1038/nature04915.
Boyer LA: Core transcriptional regulatory circuitry in human embryonic stem cells. Cell. 2005, 122 (6): 947-56. 10.1016/j.cell.2005.08.020.
Jiang J: A core Klf circuitry regulates self-renewal of embryonic stem cells. Nat Cell Biol. 2008, 10 (3): 353-60. 10.1038/ncb1698.
Evans MJ, Kaufman MH: Establishment in culture of pluripotential cells from mouse embryos. Nature. 1981, 292 (5819): 154-6. 10.1038/292154a0.
Dehal P: The draft genome of Ciona intestinalis: insights into chordate and vertebrate origins. Science. 2002, 298 (5601): 2157-67. 10.1126/science.1080049.
Thomson JA: Embryonic stem cell lines derived from human blastocysts. Science. 1998, 282 (5391): 1145-7. 10.1126/science.282.5391.1145.
Pease S: Isolation of embryonic stem (ES) cells in media supplemented with recombinant leukemia inhibitory factor (LIF). Dev Biol. 1990, 141 (2): 344-52. 10.1016/0012-1606(90)90390-5.
Hailesellasse Sene K: Gene function in early mouse embryonic stem cell differentiation. BMC Genomics. 2007, 8: 85-10.1186/1471-2164-8-85.
Shannon P: Cytoscape: a software environment for integrated models of biomolecular interaction networks. Genome Res. 2003, 13 (11): 2498-504. 10.1101/gr.1239303.
Zhou Q: A gene regulatory network in mouse embryonic stem cells. Proc Natl Acad Sci USA. 2007, 104 (42): 16438-43. 10.1073/pnas.0701014104.
Bintu L: Transcriptional regulation by the numbers: applications. Curr Opin Genet Dev. 2005, 15 (2): 125-35. 10.1016/j.gde.2005.02.006.
Bintu L: Transcriptional regulation by the numbers: models. Curr Opin Genet Dev. 2005, 15 (2): 116-24. 10.1016/j.gde.2005.02.007.
Brandman O: Interlinked fast and slow positive feedback loops drive reliable cell decisions. Science. 2005, 310 (5747): 496-8. 10.1126/science.1113834.
Lewis J: Autoinhibition with transcriptional delay: a simple mechanism for the zebrafish somitogenesis oscillator. Curr Biol. 2003, 13 (16): 1398-408. 10.1016/S0960-9822(03)00534-7.
Iyer V, Struhl K: Absolute mRNA levels and transcriptional initiation rates in Saccharomyces cerevisiae. Proc Natl Acad Sci USA. 1996, 93 (11): 5208-12. 10.1073/pnas.93.11.5208.
Yeang CH, Ideker T, Jaakkola T: Physical network models. J Comput Biol. 2004, 11 (2–3): 243-62. 10.1089/1066527041410382.
This work is supported by National Center for Supercomputing Applications (SZ).
This article has been published as part of BMC Genomics Volume 9 Supplement 2, 2008: IEEE 7th International Conference on Bioinformatics and Bioengineering at Harvard Medical School. The full contents of the supplement are available online at http://www.biomedcentral.com/1471-2164/9?issue=S2
The authors declare that they have no competing interests.
CCC implemented the algorithm and performed data analysis. SZ initiated and supervised the project. CCC and SZ wrote the manuscript.