- Open Access
Discovering pathway cross-talks based on functional relations between pathways
BMC Genomics volume 13, Article number: S25 (2012)
In biological systems, pathways coordinate or interact with one another to achieve a complex biological process. Studying how they influence each other is essential for understanding the intricacies of a biological system. However, current methods rely on statistical tests to determine pathway relations, and may lose numerous biologically significant relations.
This study proposes a method that identifies the pathway relations by measuring the functional relations between pathways based on the Gene Ontology (GO) annotations. This approach identified 4,661 pathway relations among 166 pathways from Pathway Interaction Database (PID). Using 143 pathway interactions from PID as testing data, the function-based approach (FBA) is able to identify 93% of pathway interactions, better than the existing methods based on the shared components and protein-protein interactions. Many well-known pathway cross-talks are only identified by FBA. In addition, the false positive rate of FBA is significantly lower than others via pathway co-expression analysis.
This function-based approach appears to be more sensitive and able to infer more biologically significant and explainable pathway relations.
Pathway analysis is the currently best method for understanding the biological meanings of a set of genes derived from high-throughput experiments, such as gene expression microarray [1, 2]. In biological systems, a pathway is a sequence of reactions or interactions among a subset of expressed genes related to a phenomenon or a biological process. Many methods, such as over-representation analysis  and gene set enrichment analysis (GSEA) , have been developed to identify the effective pathways for a given gene list. However, these methods may find numerous pathways that are independently represented. What is challenging is interpreting the significance of these pathways.
Pathways are not isolated entities in a cell, but may have cross-talks. In biology, the term "cross-talk" refers to the phenomenon that signal components in signal transduction can be shared between different signaling pathways . Pathways coordinate or interact with one another in response to external stimuli, often having synergistic effects on certain biological processes. These interactions include sharing components, protein-protein interactions, and transcriptional regulations [5, 6]. Perturbations on a pathway might affect the interacting pathways and comprehensively alter the phenotypes of a cell. Therefore, examining the interactions among pathways is essential for understanding the regulatory mechanisms of a given phenomenon.
Several computational approaches have been developed to identify pathway cross-talks. An intuitive method involves considering shared components between pathways [5, 7, 8]. Because pathway boundaries are arbitrary, related pathways may not share any components. Protein-protein interactions (PPIs) might mediate pathway interactions. Lu et al.  assessed pathway overlaps after extending a pathway with interacting proteins of pathway components. Li et al.  constructed a pathway cross-talk network (PCN) based on PPIs which connected between two pathways' components. The assumption is that if two pathways interact with each other, more PPIs are observed between these two pathways than expected. These methods, however, do not take into account that some genes in specific pathways may be not involved under particular condition. To address this, Huang and Li  and Liu et al.  incorporated gene expression profiles and PPIs to select active PPIs, and constructed phenotype-specific pathway cross-talk networks for angiogenesis and Alzheimer's disease, respectively.
Though these computational methods could determine the pathway cross-talks by p-values from different statistic methods, non-statistical significance may be biologically significant. In other words, cross-talking pathways may share only a few components or be connected by a few PPIs. For instance, the BMP and canonical WNT pathways in the Pathway Interaction Database (PID)  only share one component: GSK3B. In fact, these two pathways have been reported to possess biologically meaningful cross-talk . Therefore, developing new approaches is required to detect cross-talk among pathways.
Two pathways interact with each other in order to participate or regulate a particular process for a specific condition. For instance, the cross-talk between the glucocorticoid receptor (GR) and T-cell antigen receptor (TCR) signaling pathways results in apoptosis during the development of thymocytes . Additionally, activation of the GR triggers apoptosis in T cells, but activation of the TCR blocks GR-induced apoptosis . It also implies that there is a functional cross-talk between these two distinct signaling systems. For another example, BMP and WNT signaling pathways are able to function independently from each other in numerous biological processes, such as stem cell differentiation, specification of cell fates, organogenesis, and carcinogenesis. However, in some conditions, they have to cross-talk to each other to cause effects, which cannot be achieved by either pathway individually . Thus, if two pathways are implicated in many identical biological events, they may have high possibility to cross-talk in some conditions. In other words, we may be able to discover cross-talks in functionally related pathways.
In this study, we presented a function-based approach (FBA) to identify pathway cross-talks, measuring the functional similarity between pathways via the Gene Ontology (GO) annotations of pathway components. In our previous study this method has successfully been used to understand the functional relationship between RAS-regulated pathways . Here, we extended this idea of pathway functional relations on discovering the pathway cross-talks.
Results and discussion
Analyzing pathways from single data source
There are many pathway databases available in public domains, such as KEGG , BioCarta, Reactome , GenMAPP , PID , and others. Because each pathway database has its own curation standard, a pathway event in different database may contain different components and interactions. For instance, mTOR signaling pathway is curated by many database, but a few components are common (Additional file 1). Therefore, to avoid redundancies, only the pathway data from a single database were used for analysis in this study.
Pathway data were downloaded from Pathway Interaction Database (PID) , which deposits curated and peer-reviewed human signaling and regulatory pathways. We chose PID for several reasons. Firstly, pathways in PID are curated by standardized criteria and reviewed by several curators, unlike BioCarta which pathways are contributed and uploaded by users. Secondly, PID separates a signaling event into two or more distinct pathways. For instance, WNT signals are transduced to different pathways for different situations. The canonical WNT pathway is through Frizzled (FZD) family receptors and LRP5/LRP6 co-receptors for cell fate determination, but the non-canonical WNT pathways through FZD family receptors and ROR2/RKY co-receptors for cell movement and tissue polarity . Therefore, unlike KEGG which has only a WNT signaling pathway, PID deposits canonical and non-canonical WNT signaling pathways, respectively. Finally, PID also contains information of pathway cross-talks which can be used as positive data for evaluating the performance of different methods.
We collected 168 pathways from PID after removing redundant and less informative pathways (Additional file 2). Thus, there were 14,028 non-redundant pathway pairs. A function-based approach (FBA) was proposed to identify the pathway cross-talks from these pathway pairs.
Using GO annotations to calculate the functional relations between pathways
Gene Ontology (GO) is widely used for functional annotations of genes. Most genes have been assigned with multiple GO terms, and the assignments of GO terms are generally based on pathways in which the genes participate. Therefore, the function annotations of a pathway could be inferred from the GO terms of the pathway components. The function-based approach (FBA) that we proposed applies this character to measure the functional similarities between pathways, comprising two steps: 1) inferring the representative GO terms for each pathway, and 2) calculating the similarity among pathways.
Though pathway components may find numerous relevant GO terms, these terms are not all suitable in describing the function of a given pathway. This problem is similar to the GO term enrichment analysis, which is conducted to investigate whether gene sets associated with particular GO terms. The Fisher exact test has been successfully used to identify "enriched" GO terms of a given gene set [3, 21]. If all the genes in a gene set are from a single pathway, the enriched GO terms should sufficiently describe the function of this pathway. Thus, we employed the Fisher exact test to determine the representative GO terms of each pathway.
On average, 261 representative GO terms emerged per pathway (Additional file 3), covering 3,935 distinct GO terms. In these representative GO terms, many related descriptions and functions were correctly identified. Taking the WNT-mediated β-catenin pathway (PID pathway ID: wnt_beta_catenin_pathway) as an example is to examine if the related GO terms are correctly enriched. The WNT-mediated β-catenin pathway plays the role in regulation of cell proliferation and apoptosis and embryonic development [22, 23]. In total 283 GO terms were selected as representative GO terms for the WNT-mediated β-catenin pathway. The relative terms, such as "regulation of Wnt receptor signaling pathway (GO: 0030111)", "regulation of cell proliferation (GO:0042127)", "regulation of apoptosis (GO:0042981)", and "mesoderm development (GO:0007498)", were correctly found. This example indicates the procedure of Fisher exact test infers the representative GO term of a pathway indeed.
In principle, functionally related pathways should share GO term annotations. Each pathway pair has on average 79 common GO terms (Additional file 3). Although the amount of overlap is tremendous, the information content of a GO term and the number of representative GO terms of a pathway should be taken into account to adjust and normalize the GO term overlap between pathways. We employed a Vector Space Model [24, 25] to quantify the functional similarity between pathways. A weighting scheme associated with the importance of each GO term was determined by the frequency of this term occurring in annotations of the given pathway and whole human genes, and was incorporated into the vectors. Finally, a functional similarity score (funSim) between two pathways was computed via cosine measure. The higher the funSim score, the more functionally related this pathway pair.
Identification of pathway cross-talk pairs
The application of the aforementioned procedure calculated the functional similarity (funSim) score of the 14,028 combinations for 168 pathways. The distribution of these scores is shown in Figure 1A. Though different pathways may share numerous GO terms (Additional file 3), most of the pathway pairs have low scores.
In order to decide whether two pathways interact with each other, a cut-off value is required. The cut-off value was estimate by comparing the distribution of funSim of pathways with that of random gene sets (Figure 1A). To control the false positive rate as low as possible, the cut-off value of funSim was defined as 0.5, so that the false positive rate at this cutoff-value was less than 0.05%. Here, the pathway pairs which funSim are larger than the cut-off value denote as function-related pathway pairs (FRPs). However, the reliability of this cut-off value was further examined by two methods.
Firstly, the funSim were examined whether it can correctly reveal the functional relations. If two pathways are functionally related, they are more likely to fall into the same functional category. Therefore, the pathway pair from the same functional category should have higher funSim than those not in the same category. To test this hypothesis, pathways were manually classified into 8 categories based on the description of each pathway in PID. A pathway may be assigned into more than one category because a pathway may play multiple roles in a cell. Since 45 pathways lacked a clear description, only 123 pathways were classified (Additional file 4). For each functional category, the numbers of FRPs in inter- and intra-categories were counted, respectively, and the Fisher exact test was performed to access if these two values are occurred by chance (see Materials and Methods section for details). As shown in Table 1, in all categories, the proportion of FRPs in the same category (inter-category) is significantly higher than that not in the same category (intra-category). This result shows that funSim could distinguish whether pathways are functionally related.
Secondly, since all pathways are part of regulator circuit in the cell, each pathway is expected to have at least one functionally related pathway. Thus, the largest funSim for each pathway should in principle larger than the cut-off value. As shown in Figure 1B, 166 out of 168 pathways support this argument. The only two pathways that failed to pass the cut-off value are the "effects of Botulinum toxin (botulinumtoxinpathway)" (max funSim = 0.15) and "circadian rhythm pathway (circadianpathway)" (max funSim = 0.29). The mechanism of both pathways may be different from other pathways. The "effect of Botulinum toxin", for example, is involved in the transportation of neuron transmitters and muscle contraction causes. Therefore, the mechanism and effects of this pathway are quite different from other signal transduction pathways.
On the whole, FBA can correctly identify the functional relations between pathways. Setting cut-off value of funSim as 0.5 is reliable to distinguish the functionally related pathway pairs. Based on this cut-off value, 4,661 out of 14,028 pathway pairs were functionally related pathway pairs (FRPs), which were among 166 pathways (Additional file 5). FRPs were considered as putative pathway cross-talk pairs.
Comparison to other approaches
By re-implementing the analyses described by Li et al , the significantly overlapping pathway pairs (SOPs) and the significantly interacting pathway pairs (SIPs) were computed. For 14,028 pathway pairs, there were 2,412 SOPs, which were found by assessing the amount of shared components between pathways. The remaining 11,616 pathway pairs (i.e. non-SOPs) were further analyzed using protein-protein interactions (PPIs). Finally, 1,681 SIPs were identified. These two methods are complementary to each other, so they should be taken together to find all putative pathway cross-talk pairs, and we denote these two methods as the physical entity-based approach (PEBA). Therefore, PEBA identified 4,093 putative pathway cross-talk pairs among 167 pathways (Additional file 5).
Figure 2 depicts the overlap between the predicted pathway cross-talks pairs of function-based approach (FBA) and physical entity-based approach (PEBA). There were 3,266 pathway pairs in common. Although FBA can identify 79.8% (3,266/4,093) of pathway pairs by PEBA, FBA and PEBA still have 1,395 and 827 unique pairs, respectively. This result shows that FBA and PEBA are substantially different on pathway cross-talk discovery.
To evaluate the performance of the different method, 143 pathway interacting or cross-talk pairs were extracted from PID as positive data sets. The performance of a method is evaluated in terms of precision and recall. Precision is the fraction of identified pathway pairs that are true pathway interactions. Recall is the fraction of true pathway interactions that are successfully identified. As shown in Table 2, although the precisions of both approaches are extremely low due to the limited size of positive data, FBA achieved recall of 0.93, higher than PEBA. The higher recall indicates that FBA is more sensitive than PEBA in discovering pathway cross-talks.
Because PID does not comprehensively collect pathway interactions, many well-known pathway cross-talk pairs are not curated into PID. Table 3 presents additional 23 positive examples summarized from other methodology and review papers [26–29]. For instance, the pathway pairs of cxcr4_pathway to et_egfrpathway and vegfr1_pathway to et_egfrpathway are discussed in the SIP methodology paper . FBA can identify 21 out of 24 well-known pathway cross-talks, but PEBA only identified 14 out of 24 pathway pairs. Although FBA is more sensitive to predict pathway interactions, a few well-studied pathway cross-talks are not detected by FBA, but by PEBA. For example, the cross-talk between glucocorticoid receptor (reg_gr_pathway) and FGF signaling pathway (fgf_pathway) was identified by PEBA as SOP, but the funSim of these two pathways be FAB is only 0.45 which is less than the cut-off of 0.5. Additionally, the pathway pairs of notch_pathway to tgfbrpathway and wnt_canonical_pathway failed to be identified by both FBA and PEBA (Table 3).
To show that the abovementioned examples are not isolated cases, BMP signaling pathway (bmppathway) was chosen as a positive control to study its related pathways. This pathway is known to play diverse functions in vertebrates [30–32] and has cross-talk with numerous pathways to regulate a wide variety of biological process . FBA identified 14 pathways that may have cross-talks with the BMP signaling pathway (Table 4). The pathways, including TGFβ, ALK1, ALK2, NOTCH, EGF, WNT, and SMAD2/3 signaling pathways, have been reported that they have cross-talks with the BMP pathway [13, 33]. FBA also detected glypican signaling pathways (glypican_3pathway and glypican_1pathway) as related pathways. Current studies indicate that the main function of glypicans, heparan sulfate proteoglycans on the cell surface, consists in regulating several signaling pathways, including the BMP pathway . However, PEBA identified total of 5 pathways related to cross-talk with BMP pathway, but only the NK-κB pathway (nfkappabcanonicalpathway), which might be activated by the BMP pathway for immune cytokine response , was not identified by FBA (Table 4).
To summarize the results from these three different testing examples, it appears that FBA has the ability to discover pathway cross-talks. Moreover, FBA can identify the most documented pathway interactions. Because of the lack of negative data, the false positive rate of each approach cannot be evaluated. Here, an alternative evaluation, pathway co-expression analysis, was applied to assess the false positive rate.
Assessment of false positive rate by pathway co-expression analysis
In a biological point of view, a pair of pathway can interact with each other if they are expressed at the same time and in the same place, e.g. tissue. Thus, pathway co-expression is a requisite for a real pathway cross-talk. This character can be used to evaluate the false positive rate of pathway cross-talk prediction methods: if the co-expression of a predicted pathway pair does not behave well, this pair may be a false positive.
Although the protein expression data are the best evidence to support co-expression, such data are difficult to obtain. This study used gene expression as an alternative, because a gene needs to be expressed before the protein is expressed. The expression of a pathway in a given tissue was assessed by the presence of expressed sequence tags (ESTs) for the components in this pathway. If two pathways are expressed in more common tissue, it implies these two pathways may have higher probability of being cross-talks. Here, the co-expression value of a pair of pathway was presented by the arithmetic average of Jaccard coefficient and overlap coefficient (see Methods section for details).
The distributions of co-expression values of putative pathway cross-talk pairs are given in Figure 3. The common pairs identified by both of FBA and PEBA have the significantly higher co-expression values than unique pairs by FBA and PEBA, respectively (P-value < 2.2 × 10-16, Wilcoxon signed-rank test). This is not surprising, since the common pairs that pass the criteria of the two distinct approaches are the most reliable pathway cross-talk pairs. Interestingly, the average co-expression value of unique pairs of FBA is significantly higher than that of PEBA (P-value = 5.8 × 10-12, Wilcoxon signed-rank test). This result shows that the predicted pairs by FBA are more reliable than those by PEBA. In other words, the false positive rate of FBA might be less than that of PEBA.
From pathway associations to cross-talk mechanisms
The previous results reveal that FBA is advantageous in discovering real pathway cross-talks. Furthermore, FBA can assist researchers to find some pathways associations which mechanisms are explainable. First, we focused on the pathway pairs which are predicted as FRPs and have only one common gene. Although these cases are unable to pass the criterion of SOPs, but this single shared component may be important for pathway interaction. Additionally, this shared component could assist us to understand the regulating relations between pathways without additional information.
There were 2,301 pathway pairs with one common gene. In these pairs, 399 and 329 pairs are FRPs and SIPs, respectively, and 172 pairs are both FRPs and SIPs. We examined the 227 unique pathway pairs which are only identified by FBA and found several pathway interactions which are biologically significant. The first example is the pathway pair of S1P4 pathway (s1p_s1p4_pathway) and RHOA signaling pathway (rhoa_pathway). These two pathways share only one gene, i.e. RHOA, and are connected by 20 PPIs which is less than expected value. Hence, this pair is unable to pass the criteria of PEBA. However, FBA predicted this pair is highly function-related with funSim of 0.65. Merging these two pathways by the Pathway Integration Tool (PINT)  shows that the S1P4 pathway appears as the upstream of the RHOA signaling pathway (Figure 4). Sphingosine 1-phosphate (S1P) is a signaling lipid that plays a significant role in the regulation of cell growth, survival, and migration . S1P might bind to S1P receptor 4 (S1P4) before regulating the activity of RHOA for particular biological processes. Numerous studies have reported that S1P stimulates cell motility through ROHA activation .
Another similar example is the interaction between syndecan-1-mediated signaling pathway (syndecan_1_pathway) and TGFβ receptor signaling pathway (tgfbrpathway). Though these two pathways share only one gene, i.e. TFGB1, and are connected by 41 PPIs, they do not satisfy the criteria of PEBA. However, they have a significantly high functional similarity score (funSim = 0.69), implying these two pathways should interact with each other. Indeed, this pathway association has been observed in different situations. In epithelial cells, syndecan-1 expression is regulated via TGFβ-mediated signaling . In cardiac fibrosis, syndican-1 may promote TGFβ activation or activate the downstream TGFβ signaling pathways . These evidences strongly suggest that these two pathways may interact with each other for different biological processes.
If a pathway pair does not share any component (i.e. non-SOP), and the number of PPIs between this pair fails to pass the statistical test (i.e. non-SIP), this pathway interactions is easy to ignore by PEBA. Therefore, FBA is able to re-connect the relations of these pathway pairs. Total of 200 FRPs among 104 pathways are unable to be detected by PEBA and without common genes. Among these pathway interactions, several pathways formed cliques, which is a set of pathways fully connected to each other. We used CFinder  to identify pathway crosstalk cliques. 17 size-3 cliques were present among 32 pathways identified (Figure 5). Interestingly, 7 out of 17 cliques contains the interaction between p38 mediated by MAPK (p38_mk2pathway) and class IB PI3K (pi3kcibpathway) signaling pathways. Indeed, the cross-talk between these two pathways involves in varied biological process [40, 41]. Additionally, some cliques have been demonstrated the biological significance. For example, cross-talks among class IB PI3K (pi3kcibpathway), p38 mediated by MAPK (p38_mk2pathway), and PDGFRβ (pdgfrbpathway) pathways are associated with the differentiation of neural stem cells  and proliferation of vascular smooth muscle cells . For another example, the TCR mediated by JNK (tcrjnkpathway), p38 mediated by MAPK (p38_mk2pathway), and canonical NF-κB (nfkappabcanonicalpathway) pathways are influenced each other in T cell activation .
Such "pathway cross-talk cliques" also imply the complexity of regulations. For example, the pathway cross-talk clique of S1P1 (s1p_s1p1_pathway), atypical NF-κB (nfkappabatypicalpathway), and EGFR (et_egfrpathway) pathways (Figure 5) reveals the two ways to regulate one pathway. The association of S1P1 and EGFR has been well documented that S1P1 pathway activates the EGFR signaling in cancer cell . However, S1P1 might also activate EGFR pathway through the NF-κB pathway. This phenomenon has been observed in rat vascular smooth muscle cells in which S1P1 induce EGFR expression via NF-κB pathway . This case also demonstrates the pathway interaction information is useful for understanding the regulatory mechanisms.
Assessing reproducibility of cross-talks pairs by FBA
Because there are many pathway databases available, we examined if FBA can produce the same results by using different pathway data. We manually collected corresponding signaling events from PID and Reactome, respectively. The ten signaling events which are all curated by PID and Reactome, respectively, were analyzed and listed in Table 5. There were 45 possible combinations for 10 pathways. We found no signaling event curated by two databases is completely identical, and the average size of pathway components in PID is larger than that of Reactome. Nonetheless, we expected that the FBA can produce the consistent results from different data sets.
Firstly, the funSim scores of pathway pairs from the same database were performed. As shown in Figure 6A, the funSim score between using pathways from PID and Reactome is highly correlated (Pearson correlation coefficient = 0.78). When cut-off value of 0.5 was used to distinguish if the two pathways interact with each other, 41 out of 45 pathway pairs are consistent between two pathway databases. The four inconsistent cases are the pathway pairs PDGFR-mTOR, mTOR-TGFβ, VEGFR-TGFβ, and PDGFR-p38 MAPK. The first three cases are the funSim > 0.5 by using PID data and funSim < 0.5 by using Reactome, but the last one is opposite.
Secondly, the funSim scores of pathway pairs from different databases, e.g. for each pathway pairs, one pathway is from PID, and the other is from Reactome, were calculated. The funSim scores for PID-Reactome (i.e. the first pathway from PID and the second one from Reactome) and Reactome-PID (i.e. the first pathway from Reactome and the second one from PID) reveal still high correlation (Pearson correlation coefficient = 0.67) (Figure 6B). Only 8 out of 45 pathway pairs resulted in different conclusions. The five cases which funSim of PID-Reactome is larger than 0.5, but funSim of Reactome-PID is less than 0.5 are pathway pair FGFR-p38 MAPK, insulin-p38 MAPK, BMP-TGFβ, PDGFR-p38 MAPK, and TGFβ-p38 MAPK. Additionally, the three cases, which funSim of PID-Reactome are less than 0.5, but funSim of Reactome-PID are larger than 0.5, are pathway pairs FGFR-VEGFR, PDGFR-mTOR, and VEGFR-p38 MAPK.
The results show that prediction of pathway cross-talks by FBA is robust and reproducible even though the pathways curated by different databases are diverse. Additionally, the funSim of 0.5 can be a general threshold to determine the pathway cross-talks.
Limitation of FBA for prediction of pathway cross-talks
Despite the fact that FBA has the ability to predict the pathway cross-talks, it does have limitations. Because the relations are inferred from the GO annotations of pathway, the performance of FBA may be dependent on the quality of GO annotations. In this study, Fisher exact test with a multiple testing correction was applied to selection of the representative GO terms of a pathway. However, this procedure might still infer the false pathway-GO term associations due to the quality of GO annotations of genes  and the intrinsic limitations of statistical analysis . The former one might be improved by considering the evidence codes of GO annotations which has been used in this study. The latter one might be overcome by the advanced statistical models [48, 49]. Moreover, in the portion of similarity measurement, we did not consider the relations between GO terms and simply compute the proportion of common terms by cosine measure. Therefore, FBA might be further improved by the advanced GO semantic similarity measurement techniques [50, 51].
Some important pathway interactions still fail to be identified by these computational approaches. The notable example is NOTCH signaling pathway (notch_pathway). This pathway is important to developmental process and able to integrate with several major pathways . However, FAB and PEBA only identified 3 (syndecan_3_pathway, vegfr1_2_pathway, and hedgehog_2pathway) and 4 (syndecan_3_pathway, p75ntrpathway, ps1pathway, and il1pathway) pathways cross-talking with NOTCH pathway, respectively. Actually, some pathways, such as WNT and TGFβ signaling pathways, interacting with NOTCH pathway are essential for development , but these interactions are not detected by all approaches (Table 3). In addition, as shown in Figure 1B, "effect of Botulinum toxin" (botulinumtoxinpathway) and "circadian rhythm pathway" (circadianpathway) fail to be identified interacting pathways by FBA. These two pathways also fail to be detected interacting pathways by PEBA, except E2F transcription factor network (e2f_pathway) which was defined as significantly interacting with circadian rhythm pathway. All in all, computational approaches have still many limitations for predicting pathway cross-talks.
We present a novel approach to identifying pathway cross-talks by measuring the functional relations between pathways. The functional relations rely on GO annotations of pathway components through the vector space model. The concept of this function-based approach (FBA) quite differs from the physical entity-based approach (PEBA) which identifies pathway cross-talks based on shared components and protein-protein interaction. The comparison with PEBA corroborates the contribution of FBA. Many well-studied pathway cross-talks can only be successfully predicted by FBA. Though FBA identified approximately 4,600 putative pathway interactions among 166 pathways, the false positive rate of FBA might be significantly less than that of PEBA, assessed by pathway co-expression analysis. Therefore, FBA not only is more sensitive to detect cross-talks but also infers more biologically significantly and explainable pathway relations. The most important character of FBA is that the analysis results are reproducible even though different pathway data were used. With the development of pathway analysis and visualization tools, this approach can assist biological researchers to propose a potential mechanism and to prioritize the pathways for further experimental design.
Undoubtedly, discovery of pathway cross-talks is indeed important for understanding biological regulations, but we may face several challenges. The first problem is the lack of gold standard data sets. Therefore, we are unable to evaluate the prediction power of a new method. In this study, we collected real pathway interactions from PID and literature. Although the collection is not comprehensive, it may be sufficient for evaluation of different methods. Additionally, we used an alternative way, considering the pathway co-expression, to assess the false positive rate. The second problem is that pathways are dynamic, not static. Pathway may interact with the other pathways in a specific condition, but dot not influence each other in another condition. Several studies address this problem by incorporating gene expression information to filter the active interactions. Finally, because each method has its own advantage on predicting certain pathway cross-talks, how to integrate different characters to improve the precision of prediction is an important task in the future.
Materials and methods
Pathway data containing 184 pathways with 2,346 genes were downloaded from the Pathway Interaction Database (PID)  in Aug. 2010. Because pathways with too few genes may not possess sufficient biological content for analysis, 13 pathways with less than five genes were removed . Additionally, three pathways that entirely overlapped with other pathways were also ignored, because they may be redundant. Finally, 168 pathways with 2,285 genes were collected.
PID also records some pathway interaction information. These pathway interactions were extracted from XML format file of each pathway. Finally, 143 pathway interactions among 118 pathways were obtained from PID and regarded as positive data.
Determining GO terms to represent a pathway
The proposed function-based approach (FBA) utilizes GO annotations to measure the functional similarity between pathways. The first step required determining the GO terms that could represent the biological function of a pathway. The GO terms were obtained from the GO website (http://www.geneontology.org/), and the GO annotations for all human genes were downloaded from NCBI Entrez Gene (ftp://ftp.ncbi.nlm.nih.gov/gene/DATA/gene2go.gz). Only GO terms from the biological process ontology were analyzed. To avoid an overestimation of the performance of our pathway cross-talk predicting method, only annotations based on directly experimental evidence were considered, including EXP (inferred from experiment), IDA (inferred from direct assay), IPI (inferred from physical interaction), IMP (inferred from mutant phenotype), IGI (inferred from genetic interaction), IEP (inferred from expression pattern), and IC (inferred by curator). In other words, these gene-GO term associations are supported by relevant literature.
The over-representation analysis method, a common method to assess the enrichment of specific biological themes in a gene list , was used to determine the representative GO terms of a pathway. A one-sided Fisher exact test was performed to evaluate whether GO terms are enriched in a pathway, and then the P-values were adjusted via the Benjamini-Hochberg (BH) method . GO terms with adjusted P-values < 0.05 were considered representative GO terms for a pathway.
Measurement of functional similarity between pathways
A vector space model was used to compute the functional similarity between pathways. A pathway is represented by a specific vector p i , as follows:
where w i, j is the weight of the representative GO term j for pathway i, and n is the number of representative GO terms associated with all pathways. If the pathway does not have a given GO term, the weight of the GO term for this pathway is 0. Since not all GO terms are equally informative, the TF-IDF (term frequency-inverse document frequency measure, which is common used for information retrieval , was applied to determine the weight of each term. The concept is that the importance of a term increases proportionally to frequency of this term appearing in the pathway but is offset by the frequency of this term appearing in the whole genes in a given organism. Therefore, the weight of term j in pathway i is calculated as:
where N G is the total number of genes in a given organism G, and tf i, j and tf G, j are the frequency of genes annotated by term j in pathway i and a given organism G, respectively. Because GO is presented as a directed acyclic graph (DAG), a GO term's semantics inherits the biological meanings of all its parent terms. In other words, when a term is used to describe a gene, all its parent terms also apply to this gene. Therefore, the frequency of GO term j appearing in pathway i, tf i, j , is given by:
where a i, j is the number of genes in pathway i annotated by the term j, and children(j) is the set of child terms of term j.
The functional similarity between pathways can be qualified by comparing the vectors. The functional similarity score of a pathway pair, funSim(p 1 , p 2 ), was calculated by using the cosine measure , defined as:
The functional similarity was performed pairwisely for all pathways of the collections.
Background distribution of funSim
The background distribution of funSim was estimated by a randomization procedure. 9,011 human genes were collected from NCBI Entrez after removing genes without annotations of GO terms from the biological process ontology. For each pathway, the number of annotated GO terms of each gene in a given pathway was counted and replaced by other gene which was randomly drawn from the set of 9,011 genes and has the same number of annotated GO terms. The random gene set list was generated, and the funSim of each pair of random gene sets was calculated. The background distribution of fusSim was established from the merged results of the 100 random gene set lists.
Functional category analysis
The pathways were manually categorized into different functional groups based on the "biological process" descriptions which were extracted from XML format file of each pathway in PID. 8 functional categories were collected. Because a pathway may play multiple roles in a cell, a pathway may be assigned to multiple functional categories.
For each functional category, the proportions of function-related pathway pairs (FRPs) in intra- and inter-categories were compared. If a given functional category has k pathways, N intra and N inter pathway pairs are present in the intra- and inter-category, respectively, where N intra is the pairwise combination of k pathways (i.e., ), and N inter is the combination between k pathways and all pathways excluding pathways in this category. The number of FRPs, n intra and n inter , were then counted in the intra- and inter-category, respectively. The null hypothesis is that the ratio of n intra /N intra is the same as the ratio of n inter /N inter . Fisher exact test was used to assess the proportional differences of FPRs between the intra- and inter-category. In addition, relative enrichment, R e , was calculated and defined as follows:
These two factors were used to evaluate the effect of the function-based method on measurement of functional similarity between pathways.
Identifying pathway cross-talks by shared components
An intuitive manner of studying pathway cross-talks is by measuring the number of shared components between pathways. Li et al  utilized the Fisher exact test to assess whether the components of two pathways were significantly overlapping. The P-values were adjusted via BH method. The pathway pairs with adjusted P-value < 0.05 were regarded as the significantly overlapping pathway pairs (SOPs).
Identifying pathway cross-talks via protein-protein interactions
The remaining pathway pairs that were not significantly overlapping (non-SOPs) were studied via protein-protein interactions (PPIs). PPIs were downloaded from QuasiPro (http://csb2.ym.edu.tw/quasipro), which integrated PPI data from nine sources, including DIP , BIND , IntAct , MIPS , MINT , HPRD , BioGRID , Reactome , and Pathway Commons . This dataset contains 140,382 interactions and 12,164 human genes.
PPIs were used to assess the pathway cross-talks according to the procedure proposed by Li et al. . The number of PPIs among components of each pathway pair was counted. An estimation of the background distribution of the protein-interaction count of each pathway pair was generated from 1,000 rounds of the randomization procedure, as described in Li's study . A one-sided Fisher exact test was performed to assess whether two pathways are significantly interacting, and then P-values were adjusted via the BH method. Pathway pairs with adjusted P-value < 0.05 were considered significantly interacting pathway pairs (SIPs).
Pathway co-expression analysis
The gene expression information was based on the ESTs (Expression Sequence Tags) from UniGene (Build 222). The standardized tissue names for libraries were obtained from the Cancer Genome Anatomy Project (CGAP, http://cgap.nci.nih.gov/Tissues/). 46 tissues were present in the EST dataset, excluding uncharacterized and pooled tissues. ESTs from the same tissues were pooled together. A gene is considered to be expressed in a specific tissue if at least one of its EST sequences is found in the dataset.
For each pathway and tissue, an assessment was conducted on whether the pathway was expressed in a given tissue. A p-value was calculated by the hypergeometric test:
where N is the number of total genes in the human genome, m is the number of expressed genes in a given tissue, n is the number of components in a given pathway, and k is the number of pathway components expressed in this tissue. If a pathway with P-value < 0.05 in a given tissue, this pathway is regarded as expressed pathway in this tissue.
The co-expression value between two pathways was measured by combining Jaccard coefficient (JC) and overlap coefficient (OC) defined as:
Where E 1 and E 2 denote the number of tissues in which pathway 1 and 2 are expressed, respectively, and E 12 denotes the number of common tissues where both pathways are expressed. Because both coefficients have weakness when E 1 and E 2 are imbalance, the arithmetic average of JC and OC was used to refer to as the co-expression value between two pathways here.
Curtis RK, Oresic M, Vidal-Puig A: Pathways to the analysis of microarray data. Trends Biotechnol. 2005, 23 (8): 429-435. 10.1016/j.tibtech.2005.05.011.
Werner T: Bioinformatics applications for pathway analysis of microarray data. Curr Opin Biotechnol. 2008, 19 (1): 50-54. 10.1016/j.copbio.2007.11.005.
Rivals I, Personnaz L, Taing L, Potier MC: Enrichment or depletion of a GO category within a class of genes: which test?. Bioinformatics. 2007, 23 (4): 401-407. 10.1093/bioinformatics/btl633.
Subramanian A, Tamayo P, Mootha VK, Mukherjee S, Ebert BL, Gillette MA, Paulovich A, Pomeroy SL, Golub TR, Lander ES, et al: Gene set enrichment analysis: a knowledge-based approach for interpreting genome-wide expression profiles. Proc Natl Acad Sci USA. 2005, 102 (43): 15545-15550. 10.1073/pnas.0506580102.
Lu LJ, Sboner A, Huang YJ, Lu HX, Gianoulis TA, Yip KY, Kim PM, Montelione GT, Gerstein MB: Comparing classical pathways and modern networks: towards the development of an edge ontology. Trends Biochem Sci. 2007, 32 (7): 320-331. 10.1016/j.tibs.2007.06.003.
Guo X, Wang XF: Signaling cross-talk between TGF-beta/BMP and other pathways. Cell Res. 2009, 19 (1): 71-88. 10.1038/cr.2008.302.
Francesconi M, Remondini D, Neretti N, Sedivy JM, Cooper LN, Verondini E, Milanesi L, Castellani G: Reconstructing networks of pathways via significance analysis of their intersections. BMC Bioinformatics. 2008, 9 (Suppl 4): S9-10.1186/1471-2105-9-S4-S9.
Pinto D, Pagnamenta AT, Klei L, Anney R, Merico D, Regan R, Conroy J, Magalhaes TR, Correia C, Abrahams BS, et al: Functional impact of global rare copy number variation in autism spectrum disorders. Nature. 2010, 466 (7304): 368-372. 10.1038/nature09146.
Li Y, Agarwal P, Rajagopalan D: A global pathway crosstalk network. Bioinformatics. 2008, 24 (12): 1442-1447. 10.1093/bioinformatics/btn200.
Huang Y, Li S: Detection of characteristic sub pathway network for angiogenesis based on the comprehensive pathway network. BMC Bioinformatics. 2010, 11 (Suppl 1): S32-10.1186/1471-2105-11-S1-S32.
Liu ZP, Wang Y, Zhang XS, Chen L: Identifying dysfunctional crosstalk of pathways in various regions of Alzheimer's disease brains. BMC Syst Biol. 2010, 4 (Suppl 2): S11-10.1186/1752-0509-4-S2-S11.
Schaefer CF, Anthony K, Krupa S, Buchoff J, Day M, Hannay T, Buetow KH: PID: the Pathway Interaction Database. Nucleic Acids Res. 2009, 37: D674-679. 10.1093/nar/gkn653.
Itasaki N, Hoppler S: Crosstalk between Wnt and bone morphogenic protein signaling: a turbulent relationship. Dev Dyn. 2010, 239 (1): 16-33.
Ashwell JD, King LB, Vacchio MS: Cross-talk between the T cell antigen receptor and the glucocorticoid receptor regulates thymocyte development. Stem Cells. 1996, 14 (5): 490-500. 10.1002/stem.140490.
Jamieson CA, Yamamoto KR: Crosstalk pathway for inhibition of glucocorticoid-induced apoptosis by T cell receptor signaling. Proc Natl Acad Sci USA. 2000, 97 (13): 7319-7324. 10.1073/pnas.97.13.7319.
Sudhir PR, Hsu CL, Wang MJ, Wang YT, Chen YJ, Sung TY, Hsu WL, Yang UC, Chen JY: Phosphoproteomics identifies oncogenic Ras signaling targets and their involvement in lung adenocarcinomas. PLoS ONE. 2011, 6 (5): e20199-10.1371/journal.pone.0020199.
Kanehisa M, Goto S, Furumichi M, Tanabe M, Hirakawa M: KEGG for representation and analysis of molecular networks involving diseases and drugs. Nucleic Acids Res. 2010, 38: D355-360. 10.1093/nar/gkp896.
Matthews L, Gopinath G, Gillespie M, Caudy M, Croft D, de Bono B, Garapati P, Hemish J, Hermjakob H, Jassal B, et al: Reactome knowledgebase of human biological pathways and processes. Nucleic Acids Res. 2009, 37: D619-622. 10.1093/nar/gkn863.
Dahlquist KD, Salomonis N, Vranizan K, Lawlor SC, Conklin BR: GenMAPP, a new tool for viewing and analyzing microarray data on biological pathways. Nat Genet. 2002, 31 (1): 19-20. 10.1038/ng0502-19.
Katoh M: WNT signaling pathway and stem cell signaling network. Clin Cancer Res. 2007, 13 (14): 4042-4045. 10.1158/1078-0432.CCR-06-2316.
Zeeberg BR, Feng W, Wang G, Wang MD, Fojo AT, Sunshine M, Narasimhan S, Kane DW, Reinhold WC, Lababidi S, et al: GoMiner: a resource for biological interpretation of genomic and proteomic data. Genome Biol. 2003, 4 (4): R28-10.1186/gb-2003-4-4-r28.
Staal FJ, Luis TC: Wnt signaling in hematopoiesis: crucial factors for self-renewal, proliferation, and cell fate decisions. J Cell Biochem. 2010, 109 (5): 844-849.
Cadigan KM, Peifer M: Wnt signaling from development to disease: insights from model systems. Cold Spring Harb Perspect Biol. 2009, 1 (2): a002881-10.1101/cshperspect.a002881.
Chabalier J, Mosser J, Burgun A: A transversal approach to predict gene product networks from ontology-based similarity. BMC Bioinformatics. 2007, 8: 235-10.1186/1471-2105-8-235.
van Driel MA, Bruggeman J, Vriend G, Brunner HG, Leunissen JA: A text-mining analysis of the human phenome. Eur J Hum Genet. 2006, 14 (5): 535-542. 10.1038/sj.ejhg.5201585.
Teglund S, Toftgard R: Hedgehog beyond medulloblastoma and basal cell carcinoma. Biochim Biophys Acta. 2010, 1805 (2): 181-208.
Pyne NJ, Pyne S: Sphingosine 1-phosphate and cancer. Nat Rev Cancer. 2010, 10 (7): 489-503. 10.1038/nrc2875.
Miraoui H, Marie PJ: Fibroblast growth factor receptor signaling crosstalk in skeletogenesis. Sci Signal. 2010, 3 (146): re9-10.1126/scisignal.3146re9.
Hurlbut GD, Kankel MW, Lake RJ, Artavanis-Tsakonas S: Crossing paths with Notch in the hyper-network. Curr Opin Cell Biol. 2007, 19 (2): 166-175. 10.1016/j.ceb.2007.02.012.
Blanco Calvo M, Bolos Fernandez V, Medina Villaamil V, Aparicio Gallego G, Diaz Prado S, Grande Pulido E: Biology of BMP signalling and cancer. Clin Transl Oncol. 2009, 11 (3): 126-137. 10.1007/S12094-009-0328-8.
Hogan BL: Bone morphogenetic proteins: multifunctional regulators of vertebrate development. Genes Dev. 1996, 10 (13): 1580-1594. 10.1101/gad.10.13.1580.
Zhang J, Li L: BMP signaling and stem cell regulation. Dev Biol. 2005, 284 (1): 1-11. 10.1016/j.ydbio.2005.05.009.
von Bubnoff A, Cho KW: Intracellular BMP signaling regulation in vertebrates: pathway or network?. Dev Biol. 2001, 239 (1): 1-14. 10.1006/dbio.2001.0388.
Filmus J, Capurro M, Rast J: Glypicans. Genome Biol. 2008, 9 (5): 224-10.1186/gb-2008-9-5-224.
Matluk N, Rochira JA, Karaczyn A, Adams T, Verdi JM: A role for NRAGE in NF-kappaB activation through the non-canonical BMP pathway. BMC Biol. 2010, 8: 7-10.1186/1741-7007-8-7.
Wang YT, Huang YH, Chen YC, Hsu CL, Yang UC: PINT: Pathways INtegration Tool. Nucleic Acids Res. 2010, 38: W124-131. 10.1093/nar/gkq499.
Hayashida K, Johnston DR, Goldberger O, Park PW: Syndecan-1 expression in epithelial cells is induced by transforming growth factor beta through a PKA-dependent pathway. J Biol Chem. 2006, 281 (34): 24365-24374. 10.1074/jbc.M509320200.
Frangogiannis NG: Syndecan-1: a critical mediator in cardiac fibrosis. Hypertension. 2010, 55 (2): 233-235. 10.1161/HYPERTENSIONAHA.109.147256.
Adamcsek B, Palla G, Farkas IJ, Derenyi I, Vicsek T: CFinder: locating cliques and overlapping modules in biological networks. Bioinformatics. 2006, 22 (8): 1021-1023. 10.1093/bioinformatics/btl039.
Kim HJ, Oh JE, Kim SW, Chun YJ, Kim MY: Ceramide induces p38 MAPK-dependent apoptosis and Bax translocation via inhibition of Akt in HL-60 cells. Cancer Lett. 2008, 260 (1-2): 88-95. 10.1016/j.canlet.2007.10.030.
Martin MM, Buckenberger JA, Jiang J, Malana GE, Knoell DL, Feldman DS, Elton TS: TGF-beta1 stimulates human AT1 receptor expression in lung fibroblasts by cross talk between the Smad, p38 MAPK, JNK, and PI3K signaling pathways. Am J Physiol Lung Cell Mol Physiol. 2007, 293 (3): L790-799. 10.1152/ajplung.00099.2007.
Hu JG, Wang YX, Wang HJ, Bao MS, Wang ZH, Ge X, Wang FC, Zhou JS, Lu HZ: PDGF-AA Mediates B104CM-Induced Oligodendrocyte Precursor Cell Differentiation of Embryonic Neural Stem Cells Through Erk, PI3K, and p38 Signaling. J Mol Neurosci. 2012, 46: 644-653. 10.1007/s12031-011-9652-x.
Perez J, Torres RA, Rocic P, Cismowski MJ, Weber DS, Darley-Usmar VM, Lucchesi PA: PYK2 signaling is required for PDGF-dependent vascular smooth muscle cell proliferation. Am J Physiol Cell Physiol. 2011, 301 (1): C242-251. 10.1152/ajpcell.00315.2010.
Park SG, Schulze-Luehrman J, Hayden MS, Hashimoto N, Ogawa W, Kasuga M, Ghosh S: The kinase PDK1 integrates T cell antigen receptor and CD28 coreceptor signaling to induce NF-kappaB and activate T cells. Nat Immunol. 2009, 10 (2): 158-166. 10.1038/ni.1687.
Shida D, Kitayama J, Yamaguchi H, Yamashita H, Mori K, Watanabe T, Yatomi Y, Nagawa H: Sphingosine 1-phosphate transactivates c-Met as well as epidermal growth factor receptor (EGFR) in human gastric cancer cells. FEBS Lett. 2004, 577 (3): 333-338. 10.1016/j.febslet.2004.10.024.
Hsieh HL, Sun CC, Wu CB, Wu CY, Tung WH, Wang HH, Yang CM: Sphingosine 1-phosphate induces EGFR expression via Akt/NF-kappaB and ERK/AP-1 pathways in rat vascular smooth muscle cells. J Cell Biochem. 2008, 103 (6): 1732-1746. 10.1002/jcb.21563.
Buza TJ, McCarthy FM, Wang N, Bridges SM, Burgess SC: Gene Ontology annotation quality analysis in model eukaryotes. Nucleic Acids Res. 2008, 36 (2): e12-
Bauer S, Gagneur J, Robinson PN: GOing Bayesian: model-based gene set analysis of genome-scale data. Nucleic Acids Res. 2010, 38 (11): 3523-3532. 10.1093/nar/gkq045.
Zhang S, Cao J, Kong YM, Scheuermann RH: GO-Bayes: Gene Ontology-based overrepresentation analysis using a Bayesian approach. Bioinformatics. 2010, 26 (7): 905-911. 10.1093/bioinformatics/btq059.
Pesquita C, Faria D, Falcao AO, Lord P, Couto FM: Semantic similarity in biomedical ontologies. PLoS Comput Biol. 2009, 5 (7): e1000443-10.1371/journal.pcbi.1000443.
Guzzi PH, Mina M, Guerra C, Cannataro M: Semantic similarity analysis of protein data: assessment with biological features and issues. Brief Bioinform. 2012, 13: 569-585. 10.1093/bib/bbr066.
Benjamini Y, Hochberg Y: Controlling the false discovery rate: a practical and powerful approach to multiple testing. J Roy Stat Soc B. 1995, 57: 289-300.
Salton G, McGill M: Introduction to Modern Information Retrieval. 1983, New York: McGraw Hill Companies
Popescu M, Keller JM, Mitchell JA: Fuzzy measures on the Gene Ontology for gene product similarity. IEEE/ACM Trans Comput Biol Bioinform. 2006, 3 (3): 263-274. 10.1109/TCBB.2006.37.
Salwinski L, Miller CS, Smith AJ, Pettit FK, Bowie JU, Eisenberg D: The Database of Interacting Proteins: 2004 update. Nucleic Acids Res. 2004, 32: D449-451. 10.1093/nar/gkh086.
Alfarano C, Andrade CE, Anthony K, Bahroos N, Bajec M, Bantoft K, Betel D, Bobechko B, Boutilier K, Burgess E, et al: The Biomolecular Interaction Network Database and related tools 2005 update. Nucleic Acids Res. 2005, 33: D418-424.
Aranda B, Achuthan P, Alam-Faruque Y, Armean I, Bridge A, Derow C, Feuermann M, Ghanbarian AT, Kerrien S, Khadake J, et al: The IntAct molecular interaction database in 2010. Nucleic Acids Res. 2010, 38: D525-531. 10.1093/nar/gkp878.
Pagel P, Kovac S, Oesterheld M, Brauner B, Dunger-Kaltenbach I, Frishman G, Montrone C, Mark P, Stumpflen V, Mewes HW, et al: The MIPS mammalian protein-protein interaction database. Bioinformatics. 2005, 21 (6): 832-834. 10.1093/bioinformatics/bti115.
Ceol A, Chatr Aryamontri A, Licata L, Peluso D, Briganti L, Perfetto L, Castagnoli L, Cesareni G: MINT, the molecular interaction database: 2009 update. Nucleic Acids Res. 2010, 38: D532-539. 10.1093/nar/gkp983.
Keshava Prasad TS, Goel R, Kandasamy K, Keerthikumar S, Kumar S, Mathivanan S, Telikicherla D, Raju R, Shafreen B, Venugopal A, et al: Human Protein Reference Database--2009 update. Nucleic Acids Res. 2009, 37: D767-772. 10.1093/nar/gkn892.
Breitkreutz BJ, Stark C, Reguly T, Boucher L, Breitkreutz A, Livstone M, Oughtred R, Lackner DH, Bahler J, Wood V, et al: The BioGRID Interaction Database: 2008 update. Nucleic Acids Res. 2008, 36: D637-640.
Cerami EG, Gross BE, Demir E, Rodchenkov I, Babur O, Anwar N, Schultz N, Bader GD, Sander C: Pathway Commons, a web resource for biological pathway data. Nucleic Acids Res. 2011, 39: D685-690. 10.1093/nar/gkq1039.
We would like to thank the anonymous referees for helpful comments on this paper. This work was supported by the National Research Program in Genomic Medicine (NRPGM), the National Science Council (NSC101-2319-B-010-002 and NSC101-2325-B-002-078), Ministry of Education, Aiming for the Top University Plan, and National Yang-Ming University, Taiwan.
This article has been published as part of BMC Genomics Volume 13 Supplement 7, 2012: Eleventh International Conference on Bioinformatics (InCoB2012): Computational Biology. The full contents of the supplement are available online at http://www.biomedcentral.com/bmcgenomics/supplements/13/S7.
The authors declare that they have no competing interests.
CLH conceived, designed, and performed the experiments. UCY analyzed and interpreted data. All the authors wrote and revised the manuscript.
Electronic supplementary material
About this article
Cite this article
Hsu, C., Yang, U. Discovering pathway cross-talks based on functional relations between pathways. BMC Genomics 13, S25 (2012). https://doi.org/10.1186/1471-2164-13-S7-S25
- Gene Ontology
- False Positive Rate
- Pathway Interaction
- Shared Component
- Pathway Interaction Database