Related Experiment Video
Updated: May 8, 2026
07:51
High-throughput Identification of Synergistic Drug Combinations by the Overlap2 Method
Published on: May 21, 2018
Efficient discovery of overlapping communities in massive networks.
1Department of Computer Science, Princeton University, Princeton, NJ 08540, USA. pgopalan@cs.princeton.edu
Summary
This study introduces a scalable Bayesian approach for detecting overlapping communities in large networks. The method accurately reveals hidden structures in real-world and simulated data, enabling analysis of massive datasets.
Area of Science:
- Network Science
- Computational Social Science
- Data Mining
Background:
- Analyzing natural networks (social, biological, citation) requires community detection.
- Existing methods struggle with the scale of real-world networks.
- Overlapping community structures are common but challenging to identify.
Purpose of the Study:
- To develop a scalable approach for detecting overlapping communities in massive networks.
- To enable sophisticated statistical modeling for large-scale network analysis.
- To address the limitations of current community detection algorithms.
Main Methods:
- Developed a Bayesian network model allowing nodes to belong to multiple communities.
- Created an algorithm that interleaves network subsampling and community estimation.
- Applied the approach to large real-world datasets (US patents, arXiv, web pages) and simulated networks.
Main Results:
- Successfully discovered hidden community structures in massive real-world networks.
- Demonstrated accurate community structure discovery on large simulated networks.
- The proposed algorithm scales effectively to millions of nodes and edges.
Conclusions:
- The developed Bayesian approach offers a scalable solution for overlapping community detection.
- This work facilitates the analysis of massive networks previously intractable.
- Opens avenues for applying advanced statistical models to large-scale network data.
Related Concept Videos
02:26Protein Networks
An organism can have thousands of different proteins, and these proteins must cooperate to ensure the health of an organism. Proteins bind to other proteins and form complexes to carry out their functions. Many proteins interact with multiple other proteins creating a complex network of protein interactions.
These interactions can be represented through maps depicting protein-protein interaction networks, represented as nodes and edges. Nodes are circles that are representative of a protein,...
These interactions can be represented through maps depicting protein-protein interaction networks, represented as nodes and edges. Nodes are circles that are representative of a protein,...
02:26Protein Networks
An organism can have thousands of different proteins, and these proteins must cooperate to ensure the health of an organism. Proteins bind to other proteins and form complexes to carry out their functions. Many proteins interact with multiple other proteins creating a complex network of protein interactions.
These interactions can be represented through maps depicting protein-protein interaction networks, represented as nodes and edges. Nodes are circles that are representative of a protein,...
These interactions can be represented through maps depicting protein-protein interaction networks, represented as nodes and edges. Nodes are circles that are representative of a protein,...
02:04Protein-protein Interfaces
Many proteins form complexes to carry out their functions, making protein-protein interactions (PPIs) essential for an organism's survival. Most PPIs are stabilized by numerous weak noncovalent chemical forces. The physical shape of the interfaces determines the way two proteins interact. Many globular proteins have closely-matching shapes on their surfaces, which form a large number of weak bonds. Additionally, many PPIs occur between two helices or between a surface cleft and a polypeptide...
01:08Outliers and Influential Points
An outlier is an observation of data that does not fit the rest of the data. It is sometimes called an extreme value. When you graph an outlier, it will appear not to fit the pattern of the graph. Some outliers are due to mistakes (for example, writing down 50 instead of 500), while others may indicate that something unusual is happening. Outliers are present far from the least squares line in the vertical direction. They have large "errors," where the "error" or residual is the vertical...
01:19Methods to Assess Microbial Communities
Microbial communities, comprising bacteria, archaea, and eukaryotic microorganisms, inhabit diverse ecosystems and play crucial roles in environmental and biological processes. Their diversity is defined by three main parameters: species richness (the number of distinct species), species abundance (the relative quantity of each species), and species evenness (how uniformly individual species are distributed in various locations). These factors together shape the structure and ecological balance...