Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Assessing the accuracy of prediction algorithms for classification: an overview.

P Baldi1, S Brunak, Y Chauvin

  • 1Department of Information and Computer Science, University of California, Irvine, CA 92697, USA. pfbaldi@ics.uci.edu

Bioinformatics (Oxford, England)
|June 28, 2000
PubMed
Summary

This study reviews prediction algorithm accuracy assessment methods, including information theory measures. New algorithms optimizing the correlation coefficient for classification tasks are presented, with applications in protein structure prediction.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Evaluation of exertional leg pain: claudication or neuromuscular pain.

Orthopedics·2014
Same author

Clinical lipoatrophy in HIV-1 patients on HAART is not associated with increased abdominal girth, hyperlipidaemia or glucose intolerance.

HIV medicine·2002
Same author

Additive effects of Helicobacter pylori lipopolysaccharide and proteins in monocyte inflammatory responses.

Scandinavian journal of gastroenterology·2002
Same author

Prediction of human protein function from post-translational modifications and localization features.

Journal of molecular biology·2002
Same author

The critical path to leadership development. A student perspective.

Imprint·2002
Same author

Low body weight and type of protease inhibitor predict discontinuation and treatment-limiting adverse drug reactions among HIV-infected patients starting a protease inhibitor regimen: consistent results from a randomized trial and an observational cohort.

HIV medicine·2001

Area of Science:

  • Computational Biology
  • Bioinformatics
  • Machine Learning

Background:

  • Accurate prediction algorithms are crucial in bioinformatics.
  • Existing methods for assessing prediction accuracy vary widely.
  • A unified approach to evaluating prediction performance is needed.

Purpose of the Study:

  • To provide a comprehensive overview of current prediction accuracy assessment methods.
  • To introduce new learning algorithms for prediction systems.
  • To demonstrate the applicability of these methods in biological contexts.

Main Methods:

  • Review of common accuracy metrics: percentages, error measures, correlation coefficients, relative entropy, and mutual information.
  • Derivation of novel learning algorithms that directly optimize the correlation coefficient for classification.

Related Experiment Videos

  • Analysis of relationships between sensitivity and specificity in optimal prediction systems.

    • Main Results:

    • A comparative analysis of the advantages and disadvantages of various accuracy assessment techniques.
    • Development of new algorithms for designing prediction systems based on correlation coefficient optimization.
    • Demonstration of improved performance in protein secondary structure and signal peptide prediction tasks.

    Conclusions:

    • The presented methods offer a unified framework for evaluating prediction algorithm accuracy.
    • Direct optimization of the correlation coefficient yields effective classification algorithms.
    • The approach is broadly applicable to various biological prediction problems.