Related Experiment Video
Updated: Jul 5, 2026
08:38
Genome-wide Protein-protein Interaction Screening by Protein-fragment Complementation Assay (PCA) in Living Cells
Published on: March 3, 2015
Comparative analysis of five protein-protein interaction corpora
Sampo Pyysalo1, Antti Airola, Juho Heimonen
1Turku Centre for Computer Science (TUCS), Department of IT, University of Turku, Joukahaisenkatu 3-5, 20520 Turku, Finland. sampo.pyysalo@it.utu.fi
BMC Bioinformatics
|May 9, 2008
Summary
Evaluating protein-protein interaction (PPI) extraction methods is challenging due to incompatible corpora. This study unifies PPI annotations, revealing significant performance variations across corpora, highlighting the need for standardization.
Area of Science:
- Biomedical Informatics
- Computational Biology
- Natural Language Processing
Background:
- The increasing application of natural language processing (NLP) in biomedical text analysis has spurred the development of numerous corpora and methods for protein-protein interaction (PPI) extraction.
- A lack of consensus in PPI annotation standards leads to incompatible resources and difficulties in evaluating extraction methods.
Purpose of the Study:
- To conduct the first comparative evaluation of diverse PPI corpora.
- To quantitatively assess PPI extraction methods and analyze corpus properties statistically and qualitatively.
- To identify factors contributing to performance variations and propose methods for improving comparability.
Main Methods:
- Unifying PPI annotations from various corpora to a common standard (undirected, untyped, binary interactions).
- Performing quantitative evaluations using two distinct information extraction methods.
- Conducting detailed statistical and qualitative analyses of corpus properties and annotation differences.
Main Results:
- State-of-the-art PPI extraction method performance varied by an average of 19 F-score percentage units across corpora, with some differences exceeding 30 units.
- Corpus choice significantly impacts method performance, potentially more than the methods themselves, limiting cross-resource comparisons.
- Factors explaining approximately half of the observed performance variance were identified, along with key areas of agreement and disagreement in PPI corpus annotation.
Conclusions:
- The comparative analysis reveals critical similarities and differences among PPI corpora, advancing efforts toward standardization.
- A practical contribution was made by converting corpora into a shared format, with conversion software made freely available.
- The findings underscore the need for standardized annotation practices to enable reliable evaluation of PPI extraction methods.
Related Concept Videos
02:04Protein-protein Interfaces
Many proteins form complexes to carry out their functions, making protein-protein interactions (PPIs) essential for an organism's survival. Most PPIs are stabilized by numerous weak noncovalent chemical forces. The physical shape of the interfaces determines the way two proteins interact. Many globular proteins have closely-matching shapes on their surfaces, which form a large number of weak bonds. Additionally, many PPIs occur between two helices or between a surface cleft and a polypeptide...
02:04Protein-Protein Interfaces
Many proteins form complexes to carry out their functions, making protein-protein interactions (PPIs) essential for an organism's survival. Most PPIs are stabilized by numerous weak noncovalent chemical forces. The physical shape of the interfaces determines the way two proteins interact. Many globular proteins have closely-matching shapes on their surfaces, which form a large number of weak bonds. Additionally, many PPIs occur between two helices or between a surface cleft and a polypeptide...
02:26Protein Networks
An organism can have thousands of different proteins, and these proteins must cooperate to ensure the health of an organism. Proteins bind to other proteins and form complexes to carry out their functions. Many proteins interact with multiple other proteins creating a complex network of protein interactions.
These interactions can be represented through maps depicting protein-protein interaction networks, represented as nodes and edges. Nodes are circles that are representative of a protein,...
These interactions can be represented through maps depicting protein-protein interaction networks, represented as nodes and edges. Nodes are circles that are representative of a protein,...
02:26Protein Networks
An organism can have thousands of different proteins, and these proteins must cooperate to ensure the health of an organism. Proteins bind to other proteins and form complexes to carry out their functions. Many proteins interact with multiple other proteins creating a complex network of protein interactions.
These interactions can be represented through maps depicting protein-protein interaction networks, represented as nodes and edges. Nodes are circles that are representative of a protein,...
These interactions can be represented through maps depicting protein-protein interaction networks, represented as nodes and edges. Nodes are circles that are representative of a protein,...
01:57Protein Complexes with Interchangeable Parts
Groups of proteins may form a complex where each protein in this complex has a different role in the overall execution of the complex’s function. Often some of the proteins in the complex can be replaced by a closely related variant to give a complex that contains many of the same components yet is functionally distinct.
The SCF ubiquitin ligase is a protein complex of five individual proteins. This complex attaches ubiquitin to other target proteins to mark them for degradation. In order to...
The SCF ubiquitin ligase is a protein complex of five individual proteins. This complex attaches ubiquitin to other target proteins to mark them for degradation. In order to...
01:57Protein Complexes with Interchangeable Parts
Groups of proteins may form a complex where each protein in this complex has a different role in the overall execution of the complex’s function. Often some of the proteins in the complex can be replaced by a closely related variant to give a complex that contains many of the same components yet is functionally distinct.
The SCF ubiquitin ligase is a protein complex of five individual proteins. This complex attaches ubiquitin to other target proteins to mark them for degradation. In order to...
The SCF ubiquitin ligase is a protein complex of five individual proteins. This complex attaches ubiquitin to other target proteins to mark them for degradation. In order to...