Prediction of evolutionarily conserved interologs inMus musculus
© Yellaboina et al. 2008
Received: 05 May 2008
Accepted: 08 October 2008
Published: 08 October 2008
Skip to main content
© Yellaboina et al. 2008
Received: 05 May 2008
Accepted: 08 October 2008
Published: 08 October 2008
Identification of protein-protein interactions is an important first step to understand living systems. High-throughput experimental approaches have accumulated large amount of information on protein-protein interactions in human and other model organisms. Such interaction information has been successfully transferred to other species, in which the experimental data are limited. However, the annotation transfer method could yield false positive interologs due to the lack of conservation of interactions when applied to phylogenetically distant organisms.
To address this issue, we used phylogenetic profile method to filter false positives in interologs based on the notion that evolutionary conserved interactions show similar patterns of occurrence along the genomes. The approach was applied toMus musculus, in which the experimentally identified interactions are limited. We first inferred the protein-protein interactions inMus musculusby using two approaches: i) identifying mouse orthologs of interacting proteins (interologs) based on the experimental protein-protein interaction data from other organisms; and ii) analyzing frequency of mouse ortholog co-occurrence in predicted operons of bacteria. We then filtered possible false-positives in the predicted interactions using the phylogenetic profiles. We found that this filtering method significantly increased the frequency of interacting protein-pairs coexpressed in the same cells/tissues in gene expression omnibus (GEO) database as well as the frequency of interacting protein-pairs shared the similar Gene Ontology (GO) terms for biological processes and cellular localizations. The data supports the notion that phylogenetic profile helps to reduce the number of false positives in interologs.
We have developed protein-protein interaction database in mouse, which contains 41109 interologs. We have also developed a web interface to facilitate the use of databasehttp://lgsun.grc.nia.nih.gov/mppi/.
Many functions in living organisms are determined by interactions among proteins in cells. Identifying these interactions is an important first step in systems level understanding of various developmental, physiological, and disease processes. High-throughput experimental approaches such as yeast two-hybrid system and tandem affinity purification coupled with mass spectrometry have been carried out to map protein-protein interactions in model organisms [1–6]. These experimental data have been curated to produce protein-protein interaction databases such as BIOGRID , INTACT , MINT , DIP , and Reactome . Computational methods have also been developed to transfer the interaction annotation from one organism to another through identifying orthologs by comparative genomics methodology [12,13].
In addition to the experimental approaches mentioned above, a number of algorithms have been developed to predict protein-protein interactions by computationally analyzing completely sequenced genomes. Some of these algorithms identify the interactions between proteins on the basis of chromosomal proximity of two genes. These methods rely on the notion that genes encoding functionally interacting proteins show conserved gene neighborhood and are often localized in gene clusters or operons in the bacterial genomes [14–17]. Special case of chromosomal proximity is a gene-fusion, where the fusion between two genes in another genome is usually a strong indication for a physical interaction between the proteins encoded therein . Regardless of the proximity in the chromosome, being encoded in the same genome and their co-evolution can be a prerequisite for functional interaction. One such approach is a phylogenetic profile method that identifies interactions by using the pattern of occurrence of genes or protein domains in genomes of different species [19–21]. Other coevolution methods are anin-silicotwo hybrid system and mirror tree method, which detects interactions between the proteins on the basis of correlated mutations and similarity of phylogenetic trees, respectively .
A potential problem in predicting protein-protein interactions using such an interolog-based method is that it may generate false positive interactions, because of false positives in the original high-throughput interaction data [23,16] and false positive interologs due to the lack of evolutionary conservation of interactions when applied to phylogenetically distant organisms . Topology of the network (quasi clique score) has been used to filter out the false positives interologs on the basis of notion that the highly interconnected proteins are likely to be evolutionary conserved . For accurate transfer of interactions to orthologs, HomoMINT uses domain matching algorithm to filter the false positives in orthologs . Because the interacting proteins are likely to show similar functions, functional similarity of gene ontology terms has been used to reduce the false positives in high-throughput protein-protein interaction data [27,28].
In the present work, we inferred the interactions betweenMus musculusproteins, if their orthologs are known to be interacting in other species or part of predicted operons in bacteria. We anticipated the presence of false positives in predicted interactions due to the lack of evolutionary conservation of interactions. To reduce the false positives, we have used the phylogenetic profiles of interacting proteins and filtered out unlikely interactions.
Distribution of interologs in mouse before and after filtering with phylogenetic profiles
Non-redundant interactions identified experimentally in each species
Interologs transferred to mouse based on orthologous relationship
Interologs remained after filtering by phylogenetic profiles
Fraction of filtered interologs (%)
Escherichia coli K12
We transferred the interactions from each of the reference organisms toMus musculuson the basis of orthology relationship predicted as the best hit by bi-directional BLASTp  searches against all proteins using an 10-4as a cut-off e-value. As for the redundant interologs in mouse, an interolog from evolutionarily more closely related species was selected. Table1shows the combined non-redundant set of original interactions for each reference organism andMus musculus.Homo sapienscontributed the greatest number of interologs toMus musculus, followed bySaccharomyces cerevisiae. After removing redundancy, we obtained a total 55913 non-redundant interologs inMus musculus. The final number of interactions consisting of interologs and interactions identified experimentally inMus musculuswas 58352 [See Additional file 1].
We used the support vector machine (SVM) that was trained on intergenic distances to predict the operons in 186 species of bacteria, as described previously  [See Additional file 2]. When two mouse orthologs were found at least in one predicted operon, we considered these two mouse proteins interacting either functionally or physically. Using this method, we identified 7870 interactions between 2054 proteins inMus musculus[See Additional File 3]. In general, the reliability of the interaction decreases as ortholog frequency of co-occurrence in predicted operons decreases. To make this point clear, we sorted the interactions by the decrease in frequency of co-occurrence in predicted operons and showed it in the column 5 in Additional file 3.
We combined 58352 experiment-based interologs and 7870 operon-based interactions, removed redundancy, and obtained 65515 protein-protein interactions inMus musculus. Relatively low overlap (707 common interactions) between experiment-based interologs and operon-based interologs may possibly be due to the scarCity of the known interactions.
The interactions transferred from both experimentally identified interactions from model organisms (section 2.1) and predicted operons of bacteria (section 2.2.) may include false positives due to false positives in original interactions obtained experimentally or the lack of evolutionary conservation of interactions. We, therefore, used a phylogenetic profile of 26 eukaryotic and 186 bacterial species to filter possible false positives in the predicted interactions. The reason for including bacterial species for the analysis was that many interactions were derived from predicted operons of bacteria. Furthermore, some orthologous proteins in experimentally identified interactions for eukaryote model organisms can be found in bacterial species.
We first built a model by training the SVM on phylogenetic profiles of positive and negative protein-protein interaction datasets. The positive data for protein-protein interactions were taken on the basis of evolutionary conservation of interactions and the number of experimental observations of interactions using the PubMed IDs. Conserved interactions or interologs that are present in more than one species are likely to be true interactions or interologs. The interactions observed by multiple experiments are also likely to be true interactions. There were 1637 interologs present in multiple species and 6043 interologs in mammals (Mus musculus, Rattus norvegicus, andHomo sapiens) with multiple PubMed IDs. After merging both datasets and removing the redundancy, the final dataset contained 7308 protein pairs corresponding to the 6348 gene pairs. The negative dataset for predicting functional linkages was assumed to be those proteins that are not co-localized in the same sub-cellular compartment . The protein localization data forMus musculuswas obtained from eSLDB . The negative dataset of protein interactions was prepared by the pairwise combination of proteins from nucleus/mitochondria and extracellular space. The negative dataset contained 708060 protein pairs corresponding to 657924 gene pairs.
The conservation score for a gene is defined as a total number of genomes in which gene homologs are found . The conservation score of a pair of genes was in turn defined as the least conservation score of any of two genes in pairs. To understand the effect of conservation score of a gene pair on prediction accuracy in the phylogenetic profile method, we used a half of randomly picked data from the positive and negative data sets for training SVM and the remaining half for testing the prediction accuracy. The process was repeated 100 times with each time by incrementing the cut-off conservation score by 1 in the negative data set while retaining the same positive data set. Figure3shows that the prediction accuracy of protein-protein interactions reached the maximum at the conservation score of 59.
We observed a similar trend when we plotted a true positive rate (i.e., "sensitivity") versus a false positive rate (i.e., "1 - specifiCity") in a receiver operator characteristic (ROC) graph [See Additional file 4]. As expected, we found that the accuracy value became maximum, when the "sensitivity" (0.82 on y-axis) and "1 - specifiCity" (0.13 on x-axis) values were at the point near the upper left corner. The accuracy remained constant beyond the conservation score of 59, and therefore, we considered phylogenetic profiles of genes in the negative dataset with the conservation score greater than 59. The number of negative dataset with a conservation score greater than 59 was 4454.
The best model for the prediction of protein-protein interactions was selected using the standard five-fold cross validation. Positive and negative datasets were randomly divided into five groups. One-fifth was used as a test set and remaining four-fifth was used as a training set. This was repeated five times with a different set of one-fifth used for testing each time. Additional file 5 shows the specifiCity, sensitivity, and accuracy at each trial of cross validation. Prediction accuracy at each trial of the cross validation was consistent with each other, indicating the homogeneity of the training dataset. The average accuracy was 84.1%. A model generated with the highest accuracy was retained as the best model, which was used to predict the positives and false positives in the interactions predicted above.
Among 7870 predicted interactions by ortholog co-occurrence in operons, 2309 were predicted as true interactions on the basis of phylogenetic profiles [See Additional file 6]. Similarly, among 58352 interactions, 41109 were predicted as true interactions using phylogenetic profiles [See Additional file 7]. In Table1, Column 2 shows the final number of interologs in mouse from each reference organism, whereas Column 3 shows the fraction of interologs that were filtered out from each reference organism by phylogenetic profiles. The fraction of interologs that were predicted as false positives using phylogenetic profiles gradually increased with evolutionary distance between mouse and a reference organism. Exceptions wereArabidopsis thaliana and Rattus norvegicus: this might be caused by the fewer number of available interactions in the datasets.
Evaluation of predicted interactions by frequency of co-expression and functional similarity of GO terms
Frequency of co-expression (Mean/Stddev)
Similarity of GO term (BP) Mean/Stddev)
Similarity of GO term(CC)(Mean/Stddev)
Protein - protein interaction datasets
interolog + phylogenetic profile
Interologs predicted as false positives by phylogenetic profiles
Ortholog co-occurrence in operons
Ortholog co-occurrence in operons + phylogenetic profile
To provide a user-friendly access to the database, we developed a WWW interface that allows one to search for the potential protein interactions for a gene or a list of genehttp://lgsun.grc.nia.nih.gov/mppi/. Users can select a type of protein interaction dataset and enter names of genes as an Entrez gene ID, gene symbol, GenBank accession number for nucleotide and proteins, or NIA Mouse Gene Index U cluster IDs. Genes have also been directly linked to the NIA Mouse Gene Index . The web interface returns results as a network diagram  and a table that lists information on individual interactions, such as a method of identification, protein domains, species conservation, co-occurrence of gene symbols in PubMed abstracts, and protein localization. All the data are also available for download at our websitehttp://lgsun.grc.nia.nih.gov/mppi/.
Interactions between proteins inMus musculuswere inferred on the basis of their orthologous interaction information in other organisms and the functional linkage information in predicted operons of bacteria. Possible false-positives in these interactions were filtered out using phylogenetic profiles on the basis of the notion that the evolutionarily conserved interactions should show similar pattern of occurrence along the genomes. Information about protein-protein interactions with high confidence will be useful to understand various processes in mammalian model organism,Mus musculus. Predicted interactions based on bacterial operons will provide useful insights into the function of mammalian mitochondrial proteins and their functional interactions. A web interface provides access to the database for a variety of investigations, including DNA microarrays and proteomics researches.
The proteomes and completely sequenced genome of bacteria and eukaryotes were downloaded from NCBI ftp siteftp://ftp.ncbi.nih.gov/genomes/. The homologous sequences of all the known open reading frames (ORFs) ofMus musculuswere searched using BLASTp  against the proteome of other species with 10-4as the cut off value. Orthologs of theMus musculusgenes were identified as the best hit by bi-directional BLASTp  searches against all proteins with 10-4as the cut off value. It is known that, if multiple proteomes for each species are included, phylogenetic profile produces less accurate results [39,40]. Therefore, when more than two proteome sequences for the same species were available, we selected the one that shared the maximum number of orthologs withMus musculus. Finally there were 186 genomes of bacterial species and 26 genomes of eukaryotes species [See Additional file 2].
The SVM was trained on datasets for both positive and negative interactions. Pearson correlation co-efficient between the phylogenetic profiles of gene pairs was used as inputs to the SVM classifier. To validate the datasets for model selection and prediction accuracy, we have used five fold cross validation, in which the positives and negative datasets were randomly divided into five equal size sets. Training and testing carried out using the "svm-train" and "svm-predict" tools of the LibSvm software . In each step of cross validation four sets are used for training and remaining one for testing. In each step of testing, sensitivity, specifiCity and "balanced accuracy " were calculated in the following manner:Sensitivity = (True Positives)/[(True Positives) + (False Negatives)]SpecifiCity = (True Negatives)/[(True Negatives) + (False Positives)]Balanced accuracy = (SpecifiCity + Sensitivity)/2
We used "balanced accuracy" instead of the standard overall "accuracy," because it has been reported that the accuracy becomes particularly problematic as a measure of validity, when the difference between sensitivity and specifiCity increases . We indeed observed this problem, when we applied the standard overall "accuracy" to the data shown in Figure3. When the sensitivity was low and the specifiCity was high (1 < = gene conversion score < = 26), the overall accuracy was unreasonably high (99%) (Figure3). In contrast, the "balanced accuracy" provided more reasonable estimates even in these cases (Figure3; See Additional file 5).
Radial basis function (RBF) was used as a kernel of the Support vector Machine (SVM). To choose kernel parameters of SVM, we carried out "grid-search" using "grid.py" of LibSVM. In "grid-search", pairs of cost (c) and gamma (γ) were tested in each step of cross validation and one with the best cross validation accuracy was picked.
The co-expression frequency of gene pairs was calculated using a method similar to the one described previously.Mus musculusmicroarray datasets were downloaded from the NCBI GEO databaseftp://ftp.ncbi.nih.gov/pub/geo/. The datasets with a sample number less than 11 were excluded from the analysis. Finally, there were 286 datasets. Between each possible gene pair in each dataset, Pearson correlation coefficient and its p-value was calculated using the "Pearson" function described in the Numerical recipes in C . A functional link between a gene pair was inferred if the Bonferroni corrected p value is less than 0.05.
gene expression omnibus
National Center for Biotechnology Information
National Institute on Aging
open reading frames
Radial basis function
receiver operator characteristic
support vector machine
We are grateful to the high-performance computational capabilities of the Biowulf PC/Linux cluster at the NIHhttp://biowulf.nih.govfor providing computational facilities. We thank Alexei Sharov for his suggestions on the Manuscript. This work was supported by the Intramural Research Program of National Institute on Aging, NIH (Z01 AG000656).
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.