Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Sensitivity, Specificity, and Predicted Value01:13

Sensitivity, Specificity, and Predicted Value

908
In healthcare diagnostics, laboratory tests play a crucial role in identifying and diagnosing a wide range of medical conditions. However, interpreting test results is not always straightforward. An abnormal test result does not always confirm the presence of a disease, just as a normal result does not guarantee its absence. To assess the reliability of these diagnostic tools, healthcare practitioners rely on two key statistical indicators: sensitivity and specificity.
Sensitivity is the...
908
Significance Testing: Overview01:04

Significance Testing: Overview

8.2K
Significance testing is a set of statistical methods used to test whether a claim about a parameter is valid. In analytical chemistry, significance testing is used primarily to determine whether the difference between two values comes from determinate or random errors. The effect of a particular change in the measurement protocol, analyst, or sample itself can cause a deviation from the expected result. In the case of a suspected deviation/outlier, we need to be able to confirm mathematically...
8.2K
Receiver Operating Characteristic Plot01:15

Receiver Operating Characteristic Plot

368
A ROC (Receiver Operating Characteristic) plot is a graphical tool used to assess the performance of a binary classification model by illustrating the trade-off between sensitivity (true positive rate) and specificity (false positive rate). By plotting sensitivity against 1 - specificity across various threshold settings, the ROC curve shows how well the model distinguishes between classes, with a curve closer to the top-left corner indicating a more accurate model. The area under the ROC curve...
368
Interpretation of Confidence Intervals01:19

Interpretation of Confidence Intervals

8.2K
A confidence interval is a better estimate of the population than a point estimate, as it uses a range of values from a sample instead of a single value.
Confidence intervals have confidence coefficients that are crucial for their interpretation. The most common confidence coefficients are 0.90, 0.95, and 0.99, which can be written as percentages–90%, 95%, and 99%, respectively.
Suppose a person calculates a confidence interval with a confidence coefficient of 0.95. In that case, they can...
8.2K
Confidence Intervals01:21

Confidence Intervals

8.8K
An unbiased point estimate is often insufficient to predict a population estimate, such as population mean or population proportion. In this scenario, a confidence interval is used. A confidence interval is an estimate similar to a  sample proportion. However, unlike the point estimate which is a single value, the confidence interval  contains a range of values. These values have lower and upper limits, known as confidence limits, and can be designated as L1 and L2, respectively.
A...
8.8K
Accuracy and Errors in Hypothesis Testing01:13

Accuracy and Errors in Hypothesis Testing

409
Hypothesis testing is a fundamental statistical tool that begins with the assumption that the null hypothesis H0 is true. During this process, two types of errors can occur: Type I and Type II. A Type I error refers to the incorrect rejection of a true null hypothesis, while a Type II error involves the failure to reject a false null hypothesis.
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
409

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Assessing accuracy for multi-class classification when subclasses are involved.

Statistical methods in medical research·2025
Same author

Historical Redlining and All-Cause Survival after Breast Cancer Diagnosis.

Cancer epidemiology, biomarkers & prevention : a publication of the American Association for Cancer Research, cosponsored by the American Society of Preventive Oncology·2025
Same author

Optimal Cut-Point Selection Methods Under Binary Classification When Subclasses Are Involved.

Pharmaceutical statistics·2024
Same author

Evaluating joint confidence region of hypervolume under ROC manifold and generalized Youden index.

Statistics in medicine·2023
Same author

A new accuracy metric under three classes when subclasses are involved and its confidence interval estimation.

Statistics in medicine·2023
Same author

Joint inference about the AUC and Youden index for paired biomarkers.

Statistics in medicine·2021

Related Experiment Video

Updated: Nov 8, 2025

A Machine Learning Approach to Design an Efficient Selective Screening of Mild Cognitive Impairment
12:18

A Machine Learning Approach to Design an Efficient Selective Screening of Mild Cognitive Impairment

Published on: January 11, 2020

7.7K

Confidence interval estimation for sensitivity and difference between two sensitivities at a given specificity under

Yi Gao1, Lili Tian1

  • 1Department of Biostatistics, University at Buffalo, Buffalo, New York, USA.

Statistics in Medicine
|April 27, 2021
PubMed
Summary
This summary is machine-generated.

This study introduces methods to evaluate biomarker accuracy in complex disease classifications, offering new ways to estimate diagnostic test performance for various subclasses. The research provides confidence intervals for sensitivity, aiding in accurate disease identification.

Keywords:
MOVERROC curvebiomarker evaluationbootstrapcopulasdiagnostic studiesgeneralized inference

More Related Videos

Signal Acquisition, Score Interpretation, and Economics of a Non-Invasive Point-of-Care Test for Coronary Artery Disease
06:16

Signal Acquisition, Score Interpretation, and Economics of a Non-Invasive Point-of-Care Test for Coronary Artery Disease

Published on: August 9, 2024

628
An R-Based Landscape Validation of a Competing Risk Model
05:37

An R-Based Landscape Validation of a Competing Risk Model

Published on: September 16, 2022

2.3K

Related Experiment Videos

Last Updated: Nov 8, 2025

A Machine Learning Approach to Design an Efficient Selective Screening of Mild Cognitive Impairment
12:18

A Machine Learning Approach to Design an Efficient Selective Screening of Mild Cognitive Impairment

Published on: January 11, 2020

7.7K
Signal Acquisition, Score Interpretation, and Economics of a Non-Invasive Point-of-Care Test for Coronary Artery Disease
06:16

Signal Acquisition, Score Interpretation, and Economics of a Non-Invasive Point-of-Care Test for Coronary Artery Disease

Published on: August 9, 2024

628
An R-Based Landscape Validation of a Competing Risk Model
05:37

An R-Based Landscape Validation of a Competing Risk Model

Published on: September 16, 2022

2.3K

Area of Science:

  • Biostatistics
  • Medical Diagnostics
  • Biomarker Research

Background:

  • Diagnostic studies often involve a healthy class and a diseased class with multiple subclasses.
  • Accurately evaluating biomarker performance without pre-specified subclass ordering is a practical challenge.
  • Existing methods may not adequately address complex disease subclass structures.

Purpose of the Study:

  • To develop and evaluate methods for estimating biomarker accuracy in settings with multiple disease subclasses.
  • To provide confidence intervals for the sensitivity of single and paired biomarkers under tree ordering.
  • To compare the performance of parametric and nonparametric approaches for biomarker evaluation.

Main Methods:

  • Exploration of parametric and nonparametric statistical approaches.
  • Estimation of confidence intervals for sensitivity at a given specificity.
  • Utilizing tree ordering and umbrella ordering frameworks.
  • Comprehensive simulation studies to assess method performance.
  • Application to a published microarray dataset.

Main Results:

  • Proposed methods provide reliable confidence intervals for biomarker sensitivity under tree ordering.
  • Parametric and nonparametric approaches show varying performance depending on data characteristics.
  • The study successfully applies novel methods to real-world microarray data.
  • Comparative analysis highlights the strengths of different estimation techniques.

Conclusions:

  • The developed methods offer robust tools for evaluating biomarker accuracy in complex diagnostic scenarios.
  • The findings support the use of tree ordering frameworks for biomarker assessment with multiple disease subclasses.
  • This research contributes to improved diagnostic test evaluation and biomarker discovery.