Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Prediction Intervals01:03

Prediction Intervals

The interval estimate of any variable is known as the prediction interval. It helps decide if a point estimate is dependable.
However, the point estimate is most likely not the exact value of the population parameter, but close to it. After calculating point estimates, we construct interval estimates, called confidence intervals or prediction intervals. This prediction interval comprises a range of values unlike the point estimate and is a better predictor of the observed sample value, y. 
The...
Accuracy, limits, and approximation01:28

Accuracy, limits, and approximation

Accuracy, limits, and approximations are common in many fields, especially in engineering calculations. These concepts are imperative for ensuring that a given value is as close as possible to its true value.
Accuracy is defined as the closeness of the measured value to the true or actual value. In engineering mechanics, repeated measurements are taken during theoretical or experimental analyses to ensure that the result is precise and accurate.
The accuracy of any solution is based on the...
Classification of Systems-I01:26

Classification of Systems-I

Linearity is a system property characterized by a direct input-output relationship, combining homogeneity and additivity.
Homogeneity dictates that if an input x(t) is multiplied by a constant c, the output y(t) is multiplied by the same constant. Mathematically, this is expressed as:
Accuracy and Errors in Hypothesis Testing01:13

Accuracy and Errors in Hypothesis Testing

Hypothesis testing is a fundamental statistical tool that begins with the assumption that the null hypothesis H0 is true. During this process, two types of errors can occur: Type I and Type II. A Type I error refers to the incorrect rejection of a true null hypothesis, while a Type II error involves the failure to reject a false null hypothesis.
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5% chance...
Receiver Operating Characteristic Plot01:15

Receiver Operating Characteristic Plot

A ROC (Receiver Operating Characteristic) plot is a graphical tool used to assess the performance of a binary classification model by illustrating the trade-off between sensitivity (true positive rate) and specificity (false positive rate). By plotting sensitivity against 1 - specificity across various threshold settings, the ROC curve shows how well the model distinguishes between classes, with a curve closer to the top-left corner indicating a more accurate model. The area under the ROC curve...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Evaluation of exertional leg pain: claudication or neuromuscular pain.

Orthopedics·2014
Same author

Clinical lipoatrophy in HIV-1 patients on HAART is not associated with increased abdominal girth, hyperlipidaemia or glucose intolerance.

HIV medicine·2002
Same author

Additive effects of Helicobacter pylori lipopolysaccharide and proteins in monocyte inflammatory responses.

Scandinavian journal of gastroenterology·2002
Same author

Prediction of human protein function from post-translational modifications and localization features.

Journal of molecular biology·2002
Same author

The critical path to leadership development. A student perspective.

Imprint·2002
Same author

Low body weight and type of protease inhibitor predict discontinuation and treatment-limiting adverse drug reactions among HIV-infected patients starting a protease inhibitor regimen: consistent results from a randomized trial and an observational cohort.

HIV medicine·2001

Related Experiment Video

Updated: Jul 24, 2026

Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances
07:35

Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances

Published on: October 11, 2018

Assessing the accuracy of prediction algorithms for classification: an overview.

P Baldi1, S Brunak, Y Chauvin

  • 1Department of Information and Computer Science, University of California, Irvine, CA 92697, USA. pfbaldi@ics.uci.edu

Bioinformatics (Oxford, England)
|June 28, 2000
PubMed
Summary

This study reviews prediction algorithm accuracy assessment methods, including information theory measures. New algorithms optimizing the correlation coefficient for classification tasks are presented, with applications in protein structure prediction.

Related Experiment Videos

Last Updated: Jul 24, 2026

Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances
07:35

Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances

Published on: October 11, 2018

Area of Science:

  • Computational Biology
  • Bioinformatics
  • Machine Learning

Background:

  • Accurate prediction algorithms are crucial in bioinformatics.
  • Existing methods for assessing prediction accuracy vary widely.
  • A unified approach to evaluating prediction performance is needed.

Purpose of the Study:

  • To provide a comprehensive overview of current prediction accuracy assessment methods.
  • To introduce new learning algorithms for prediction systems.
  • To demonstrate the applicability of these methods in biological contexts.

Main Methods:

  • Review of common accuracy metrics: percentages, error measures, correlation coefficients, relative entropy, and mutual information.
  • Derivation of novel learning algorithms that directly optimize the correlation coefficient for classification.
  • Analysis of relationships between sensitivity and specificity in optimal prediction systems.

Main Results:

  • A comparative analysis of the advantages and disadvantages of various accuracy assessment techniques.
  • Development of new algorithms for designing prediction systems based on correlation coefficient optimization.
  • Demonstration of improved performance in protein secondary structure and signal peptide prediction tasks.

Conclusions:

  • The presented methods offer a unified framework for evaluating prediction algorithm accuracy.
  • Direct optimization of the correlation coefficient yields effective classification algorithms.
  • The approach is broadly applicable to various biological prediction problems.