Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

A strategy for evaluating pathway analysis methods.

Chenggang Yu1, Hyung Jun Woo1, Xueping Yu1

  • 1Department of Defense Biotechnology High Performance Computing Software Applications Institute, Telemedicine and Advanced Technology Research Center, U.S. Army Medical Research and Materiel Command, Fort Detrick, Fort Detrick, MD, 21702, USA.

BMC Bioinformatics
|October 15, 2017
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

ToxMet: a web tool for toxicogenomic data analysis using genome-scale metabolic modeling.

Toxicological sciences : an official journal of the Society of Toxicology·2026
Same author

Effect of exertion on the biomechanics of walking with load carriage and running in young, healthy women.

Scientific reports·2026
Same author

Cross-bridge model-based quantification of muscle metabolite alterations leading to fatigue during all-out knee extension exercise.

Frontiers in physiology·2026
Same author

Genomic Features and Response to Poly(ADP-ribose) Polymerase Inhibition in Metastatic Castration-Resistant Prostate Cancer.

JCO precision oncology·2026
Same author

A Case Study of AI-Enabled Software as a Medical Device Cleared by the FDA for Assessing Hemorrhage Risk Index (APPRAISE-HRI) after Trauma.

NEJM AI·2026
Same author

A reinforcement learning algorithm to optimize resource utilization in combat casualty care.

Scientific reports·2025
Same journal

SNPio: a Python interface for population genomic data processing.

BMC bioinformatics·2026
Same journal

SpaHNR: a spatial domain identification method via sparse attention-based hierarchical node representation and multi-view contrastive learning.

BMC bioinformatics·2026
Same journal

OpenIMC: an open-source platform for analyzing single-cell and spatial proteomics by imaging mass cytometry.

BMC bioinformatics·2026
Same journal

NAP: an open source pipeline for cross-domain microbiome profiling using Nanopore sequencing-derived amplicon data.

BMC bioinformatics·2026
Same journal

SurvGME: an R package for survival analysis with graphical and measurement error models.

BMC bioinformatics·2026
Same journal

SimMapNet: a Bayesian framework for gene regulatory network inference using gene ontology similarities as external hint.

BMC bioinformatics·2026
See all related articles

This study introduces a novel, gold-standard-free strategy for evaluating pathway analysis (PA) methods. The dual-metric approach uses recall and discrimination to reliably assess PA method performance across diverse datasets.

Area of Science:

  • Bioinformatics
  • Computational Biology
  • Genomics

Background:

  • High-throughput data analysis requires reliable biological pathway identification methods.
  • Evaluating pathway analysis (PA) methods is crucial but often hindered by the lack of established 'ground truth' datasets.
  • Previous evaluation strategies struggle to objectively assess PA methods under varied conditions.

Purpose of the Study:

  • To develop a novel strategy for evaluating PA methods that does not rely on a pre-defined 'gold standard'.
  • To enable systematic and objective assessment of PA methods across diverse experimental conditions.

Main Methods:

  • Proposed a novel evaluation strategy using two complementary metrics: recall and discrimination.
  • Recall measures consistency between large and sub-datasets; discrimination measures specificity between different experimental datasets.
Keywords:
Gene set enrichment analysisMethod evaluationPathway analysis

Related Experiment Videos

  • Applied the dual-metric strategy to evaluate six common PA methods using 24 datasets.

    • Main Results:

    • The strategy effectively evaluated six widely used PA methods without requiring a gold standard.
    • Highlighted challenges in reliably identifying significant pathways from small datasets.
    • Confirmed the strategy's effectiveness by corroborating previous comparative study findings.

    Conclusions:

    • The proposed dual-metric strategy offers a ground-truth-independent approach for evaluating PA methods.
    • Enables systematic and objective performance assessment of PA methods using any number of datasets and conditions.
    • Facilitates more reliable biological interpretation of high-throughput data.