A traveling salesman approach for predicting protein functions
© Johnson and Liu. 2006
Received: 24 June 2006
Accepted: 12 October 2006
Published: 12 October 2006
Protein-protein interaction information can be used to predict unknown protein functions and to help study biological pathways.
Here we present a new approach utilizing the classic Traveling Salesman Problem to study the protein-protein interactions and to predict protein functions in budding yeast Saccharomyces cerevisiae. We apply the global optimization tool from combinatorial optimization algorithms to cluster the yeast proteins based on the global protein interaction information. We then use this clustering information to help us predict protein functions. We use our algorithm together with the direct neighbor algorithm  on characterized proteins and compare the prediction accuracy of the two methods. We show our algorithm can produce better predictions than the direct neighbor algorithm, which only considers the immediate neighbors of the query protein.
Our method is a promising one to be used as a general tool to predict functions of uncharacterized proteins and a successful sample of using computer science knowledge and algorithms to study biological problems.
With the development of the genome projects, the focus of research has shifted from studying a single gene or protein to analyzing groups of genes or proteins. In addition to the progress in genome sequencing, researchers have also made great progress in the area called proteomics where people study proteins on the genome level based on their sequence data and their interaction information on a large scale. Protein-protein interactions are very informative for protein function predictions. We speculate that proteins interacting with each other are within the same functional group or within closely related functional groups. By this reasoning, if we have adequate protein-protein interaction information, we can try to predict the functions of uncharacterized proteins based on their interacting neighbors that have been characterized. We can further predict the biological pathways of those proteins. With the rapid progress in identifying protein-protein interactions systematically using two-hybrid experiments and mass spectrometry, we have collected a wealth of information on protein interactions. Here we study in the field of yeast protein clustering and function prediction utilizing a combinatorial optimization tool. The results show that we can cluster the proteins based on their interaction patterns, and we can make predictions of their biological functions based on those clustering. The prediction method works better than the traditional method based only on the direct neighbors of the query protein because our method adopts a global view and hence makes better usage of the information available. With the success in predicting yeast protein functions with the interaction database currently available, we can anticipate continued success as we get more accurate and larger collections of protein-protein interaction information from additional experimental results. Also, we can apply the same methodology to other more complicated organisms, including humans.
In a previously reported study , the authors have tried to use graphical display to show protein interaction patterns, to identify protein clusters, and to predict protein functions through visual discerning. This method has given us good intuition about how the proteins are related, but it is not a quantitative or systematic way to study the proteins, especially as the network gets larger.
Other workers in the field have been trying to utilize protein interaction information to predict protein functions using a direct neighbor approach – for a particular protein they try to identify all its interacting neighbors and use a simple mechanism such as voting ("the majority rule") to determine which might be the most likely function . However, many proteins of unknown functions either do not have interacting partners that are characterized or have too few of them for us to trust the voting. This has limited the use of the direct neighbor approach or made its predictions less accurate. In essence the traditional approach adopts a local view of the problem where we only look at the small region of the protein's immediate neighborhood. Here we try to develop an approach that makes use of the global connectivity pattern of the protein interaction network.
The Traveling Salesman Problem (TSP) is a classic problem in the field of graph theory and combinatorial optimization. The Traveling Salesman Problem can be described as following: Given n cities where the distances between any two cities are known, a traveling salesman wants to visit all n cities in a tour so that each city is visited exactly once and the total distance of traveling is minimal . The Traveling Salesman Problem is NP-hard and no polynomial algorithm has been found, but the optimal solutions can be approximated using methods like linear programming or heuristic searching . Among those solutions, the Concorde program  is a state-of-the-art program that has provided good quality solutions within reasonable computation time. Concorde is an award winning TSP solver publicly available at http://www.tsp.gatech.edu/concorde.html.
The Traveling Salesman Problem has many applications in areas such as vehicle routing, job sequencing and data array clustering. The key to convert a data array clustering problem into a Traveling Salesman Problem is to think of the rows and columns as the intermediate cities visited [2, 5, 6]. In order to make this intuitive notion concrete, we build a target function called the measure of effectiveness (ME)  and transform the clustering problem into maximizing this target function, which is a typical global optimization equivalent to TSP. Because of the global and combinatorial nature of the TSP, viewing protein clustering from the TSP perspective automatically makes use of the global information.
In this approach we download the yeast protein interaction database , describe the protein-protein interactions as a connectivity graph represented by the interaction matrix aij, and transform the clustering problem into a Traveling Salesman Problem by using an auxiliary matrix (see methods section.)
We analyze the distribution of the difference scores in Figure 1 and use the 95% percentile of the scores as a cut-off to define the boundaries of protein clusters. This way we use a cut-off score of 22 and define 75 clusters for the whole protein network. The cut-off is empirical in that we have tried different cut-off values and have found that a cut-off between 90% and 97% produces good clustering and prediction. When the cut-off is too high, the clusters contain too many proteins some of which are not similar at all and this dilutes the useful information; on the other hand, when the cut-off is too low, the clusters are too small so there is not enough information for protein function prediction.
The analysis above gives us a better understanding of the behaviors of the two approaches. To get the best of both worlds, we use a combination of the two approaches in our prediction. We try various combinations of the two using either the protein's degree or the protein's similarity with the query protein in terms of interaction patterns as the cut-off. We find the following rule simple and effective – when the protein's degree is lower than 4, we use the TSP approach; when the protein's degree is greater than or equal to 4, we use the direct neighbor approach. This way we get a prediction accuracy of 69.72% as compared to the 64.81% from the direct neighbor approach alone.
These results show that our method can give better predictions of protein functions by incorporating the global optimization algorithms. This is especially useful when the protein has no or very few characterized neighbors directly interacting with it. Since we utilize global information of the interactions instead of concerning only the direct interactions in the neighborhood, the method is more robust with regard to local inaccuracies or incompleteness of the information.
One concern of this method is the accuracy of the topology of the network. We need to take into account the false positives and false negatives of the protein-protein interactions obtained from experiments. Incorrect input data affect prediction accuracy and we expect to get better predictions when the input data has better quality.
Another determinant of the method's prediction accuracy is the fineness of the classification. The more coarse-grained the classification, the fewer degrees of freedom there are in the network, and therefore the more likely we will have a correct prediction. On the other hand, to gain more insight from the predictions, we would like the method to be able to predict protein functions on a more fine-grained level.
At this point, we use the first level GO (Gene Ontology) classification for our prediction based on the information we can get from the protein function catalogue. In the future, with more protein annotation and protein-protein interaction data available, we will apply our prediction system on different levels of classification and find a level at which we can predict with meaningful accuracy and the predictions will be most insightful for further biological studies.
Certainly, when we predict the functions for uncharacterized proteins, the ultimate way to validate the predictions is to perform biological experiments. However, the predictions produced by computational methods can give us a good place to begin the experimental exploration and can hence reduce the amount of bench work needed. Instead of speculating wild guesses for an uncharacterized protein's functions, we can form some educated hypotheses and perform experiments to test those hypotheses. The clustering information can also give us some insights into biological pathways because proteins functioning in the same pathway tend to interact with each other and fall into the same cluster. Therefore the global optimization clustering method can help us either to better understand some pathways or to find the missing pieces in them.
The combinatorial optimization tools we use here can easily be used on larger data sets. Given that the Concorde program has solved a 24,978-city TSP problem to the optimum , we can expect it to solve the TSP problems obtained from the protein-protein interaction matrices of most organisms. When we get adequate protein-protein interaction information for other organisms, we can use the same methodology to predict protein functions and biological pathways for those organisms.
The reason why our TSP solver based clustering performs better than traditional gene clustering algorithms such as hierarchical clustering or nearest neighbor tree clustering is that the latter methods are essentially greedy bottom-up algorithms where they progressively combine the most similar nodes or clusters at each step till a tree of clusters is built. Greedy algorithms adopt locally best decisions at each step and are likely to face very costly moves at later stages. For this reason, greedy algorithms tend to produce sub-optimal solutions especially for larger problems. In contrast, in our approach, we use Concorde the TSP solver to find the globally optimal solution for the TSP equivalent of our clustering problem. Aiming at global optimization, our method works better especially in the context that there are thousands of nodes (proteins) to be clustered.
Most recently, Climer and Zhang have proposed the TSPCluster algorithm , which is an improved TSP-based approach to optimal rearrangement clustering. Their algorithm produces optimal solutions when we have known the number of clusters (k) we are going to cluster the data into and the goal is to find the cluster borders optimally . The rationale is that if we know the number of clusters beforehand, we can use that information, introduce dummy nodes, and modify the object function to minimize the total intra-cluster dissimilarity while tolerating large inter-cluster dissimilarity . Their algorithm works better in situations where we know in advance the range of values for the number of clusters k that are of interest, and we can try a few k values in that range. An example of such situations would be to determine the locations of a few distribution centers based on population clustering . In the more explorative situations like we have now where we do not know how many clusters the proteins are going to be clustered into based on their interaction information, it is better to use our algorithm to globally cluster the proteins and use that clustering information for protein function prediction. After we have performed the study by our algorithm and found out the viable number of clusters k, we can further apply the TSPCluster algorithm with that k value and some nearby values to additionally optimize the clustering.
The success of the method relies on the insight that we need to get information, not only from the protein's immediate neighbors, but also from other components more remotely related. Our method is still a simple one in that we adopt a simple rule where we use the clustering information for proteins with small numbers of neighbors and use direct voting for proteins with more neighbors. If we try to perceive the protein interaction relationship with a more integrated view, we can see that a protein can have direct neighbors, indirect neighbors with a certain number of "bridge" proteins, non-neighbors in the same cluster, and non-neighbors in different clusters. If we assign different weights to those relationships according to the distances of how the proteins are related, and we fine-tune the weights based on our training sets, we hope to get a more sophisticated and more accurate prediction system.
In this study we have performed yeast protein clustering and function prediction utilizing a combinatorial optimization tool. Our results show that we can cluster the proteins based on their interaction patterns, and that we can make predictions of the biological functions of uncharacterized proteins based on the clustering. The clustering reveals the global patterns of protein-protein interactions within and across functional classes. Although the clustering is not an exact replica of the protein-protein interactions in a proteome, it can be used as a base for protein function prediction. Our prediction method works better than the traditional method based only on the direct neighbors of the query protein in terms of prediction accuracy and prediction robustness with regard to local inaccuracies or incompleteness. The advantage is more prominent when the protein has very few characterized immediate neighbors or no such neighbors at all. The success of our method lies in the fact that it adopts a global view and hence makes better use of the information available.
Our approach is the first one to use the Traveling Salesman Problem, a classical and well studied computer problem and a combinatorial optimization tool, to study the protein-protein interactions from a global point of view. The results show that this approach is a promising one to be used as a general tool to predict functions of uncharacterized proteins. This is a successful sample of using computer science knowledge and algorithms to study biological problems. With the success of being able to predict yeast protein functions more accurately based on the yeast protein database currently available, we can anticipate continued success as we get more complete protein-protein interaction information from additional experimental results. Also, we can apply the same methodology to other more complicated organisms, including humans.
Data and software
We downloaded the yeast protein interaction database and yeast protein function catalogue from the Comprehensive Yeast Genome Database http://mips.gsf.de/genre/proj/yeast/. We downloaded the Concorde TSP solver from Concorde Home http://www.tsp.gatech.edu//concorde/downloads/downloads.htm. We ran the Concorde program on a Sun ® Ultra 10 work station with a total of 32 GB memory. Our protein function prediction algorithm was implemented in the Perl programming language and was run on an Intel® Xeon processor 2.80 GHz with 2.00 GB RAM installed with Microsoft Windows operating system. We used Microsoft Excel and the SAS® software package for data analysis.
Transformation of the protein clustering to a Traveling Salesman Problem
Let ρ indicate the permutation of both the rows and the columns because the interaction matrix is a symmetric one. The Measure of Effectiveness (ME) represents the overall similarity and it is the objective function to be maximized. ME is calculated as following [2, 9]:
With the symmetry between the rows and columns, this function reduces to
Therefore, the network clustering problem becomes a combinatorial optimization problem where the optimal clustering corresponds to the configuration or permutation ρ where ME(ρ) is maximal. This amounts to a Traveling Salesman Problem looking for an optimized permutation ρ with the distance matrix being [2, 9, 10]. We use the formula to make sure the matrix cells are non-negative numbers. By this analysis, we transform the problem of rearranging the protein-protein interaction matrix into a Traveling Salesman Problem which can be represented by a new matrix C, where . We call this new matrix the auxiliary matrix . The solution to this Traveling Salesman Problem gives us the permutation we need to rearrange the protein interaction matrix.
- Schwikowski B, Uetz P, Fields S: A network of protein-protein interactions in yeast. Nature Biotechnology 18:1257–1261.
- Lawler EL, Lenstra JK, Rinnooy Kan AHG, Shmoys DB: The Traveling Salesman Problem: A Guided Tour of Combinatorial Optimization. A Wiley Inter-science Publication;
- Lin S, Kernighan BW: An effective heuristic algorithm for the traveling salesman problem. Oper Res 21:498–516.
- Concorde Home [http://www.tsp.gatech.edu//concorde/index.html]
- Hubert LJ, Baker FB: Applications of combinatorial programming to data analysis: the traveling salesman and related problems. Psychometrika 43:81–91.
- Lenstra JK: Clustering a data array and the traveling salesman problem. Oper Res 22:413–414.
- Comprehensive Yeast Genome Database [http://mips.gsf.de/genre/proj/yeast/]
- Rain JC, Selig L, De Reuse H, Battaglia V, Reverdy C: The protein-protein interaction map of Helicobacter pylori. Nature 409:211–215.
- Gutin G, Punnen Gutin AP: The Traveling Salesman Problem and Its Variations. Kluwer Academic Publishers;
- Lenstra JK, Kan AHGR: Some simple applications of the traveling salesman problem. Oper Res Quant 26:717–733.
- McCormick WT, Schweitzer PJ, White TJ: Problem decomposition and data reorganization by a clustering technique. Oper Res 20:993–1009.
- Climer S, Zhang W: Take a walk and cluster genes: A TSP-based approach to optimal rearrangement clustering. Proceedings of the 21st International conference on machine learning (ICML'04), Banff, Canada 2004:169–176.
- Climer S, Zhang W: Rearrangement clustering: Pitfalls, remedies, and applications. Journal of Machine Learning Research, in press. http://www.cse.wustl.edu/~sclimer/paper08.pdf
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.