Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Receiver Operating Characteristic Plot01:15

Receiver Operating Characteristic Plot

562
A ROC (Receiver Operating Characteristic) plot is a graphical tool used to assess the performance of a binary classification model by illustrating the trade-off between sensitivity (true positive rate) and specificity (false positive rate). By plotting sensitivity against 1 - specificity across various threshold settings, the ROC curve shows how well the model distinguishes between classes, with a curve closer to the top-left corner indicating a more accurate model. The area under the ROC curve...
562
Comparing the Survival Analysis of Two or More Groups01:20

Comparing the Survival Analysis of Two or More Groups

688
Survival analysis is a cornerstone of medical research, used to evaluate the time until an event of interest occurs, such as death, disease recurrence, or recovery. Unlike standard statistical methods, survival analysis is particularly adept at handling censored data—instances where the event has not occurred for some participants by the end of the study or remains unobserved. To address these unique challenges, specialized techniques like the Kaplan-Meier estimator, log-rank test, and...
688
Sensitivity, Specificity, and Predicted Value01:13

Sensitivity, Specificity, and Predicted Value

1.7K
In healthcare diagnostics, laboratory tests play a crucial role in identifying and diagnosing a wide range of medical conditions. However, interpreting test results is not always straightforward. An abnormal test result does not always confirm the presence of a disease, just as a normal result does not guarantee its absence. To assess the reliability of these diagnostic tools, healthcare practitioners rely on two key statistical indicators: sensitivity and specificity.
Sensitivity is the...
1.7K
Prediction Intervals01:03

Prediction Intervals

3.5K
The interval estimate of any variable is known as the prediction interval. It helps decide if a point estimate is dependable.
However, the point estimate is most likely not the exact value of the population parameter, but close to it. After calculating point estimates, we construct interval estimates, called confidence intervals or prediction intervals. This prediction interval comprises a range of values unlike the point estimate and is a better predictor of the observed sample value, y. 
3.5K
Odds Ratio01:09

Odds Ratio

2.1K
The odds ratio (OR) is a statistical measure used extensively in epidemiology and research to quantify the strength of association between exposure and outcome across different groups. Unlike relative risk, which compares the probabilities of an event occurring, the odds ratio compares the odds of an event occurring in the exposed group to the odds of it occurring in the unexposed group. The odds, in this context, are calculated as the probability of the event happening divided by the...
2.1K
Goodness-of-Fit Test01:16

Goodness-of-Fit Test

9.4K
The goodness-of-fit test is a type of hypothesis test which determines whether the data "fits" a particular distribution. For example, one may suspect that some anonymous data may fit a binomial distribution. A chi-square test (meaning the distribution for the hypothesis test is chi-square) can be used to determine if there is a fit. The null and alternative hypotheses may be written in sentences or stated as equations or inequalities. The test statistic for a goodness-of-fit test is given as...
9.4K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Precision Diagnostics in Prostate Cancer Treatment (PREDICT): A Phase II Multiarm Biomarker-Based Study (Alliance A032102).

JCO oncology advances·2026
Same author

Reply to: Methodologic Considerations for Subsequent Colorectal Cancer in Survivors of Childhood Cancer.

Journal of clinical oncology : official journal of the American Society of Clinical Oncology·2026
Same author

Atrial Fibrillation Following Autologous Stem Cell Transplantation in Multiple Myeloma: Incidence, Predictors, and Prognostic Impact.

JACC. CardioOncology·2026
Same author

Breast cancer recurrence and mortality among survivors of childhood cancer.

Journal of the National Cancer Institute·2026
Same author

International Guideline Harmonization Group Recommendations for Breast Cancer Surveillance in Childhood, Adolescent, and Young Adult Cancer Survivors After Anthracyclines.

JCO oncology practice·2026
Same author

Safety and efficacy of Yttrium-90 transarterial radioembolization of neuroendocrine liver metastasis - A retrospective single-institution study.

European journal of radiology·2025

Related Experiment Video

Updated: Mar 14, 2026

Comparison of Predictive Performance of Three Lymph Node Staging Systems in Colorectal Signet Ring Cell Carcinoma Based on Machine Learning Model
07:13

Comparison of Predictive Performance of Three Lymph Node Staging Systems in Colorectal Signet Ring Cell Carcinoma Based on Machine Learning Model

Published on: April 18, 2025

842

Inference for the difference in the area under the ROC curve derived from nested binary regression models.

Glenn Heller, Venkatraman E Seshan, Chaya S Moskowitz

    Biostatistics (Oxford, England)
    |September 23, 2016
    PubMed
    Summary

    This study revises how to assess model performance using the area under the curve (AUC) statistic. New methods improve confidence intervals for nested models, aiding in evaluating new factors in binary regression.

    Keywords:
    Area under the receiver operating characteristic curveConfidence intervalIncremental valueMaximum rank correlationNested modelsRisk classification model

    More Related Videos

    Machine Learning-Based Cough Tone Classification: Diagnostic Exploration of Chronic Obstructive Pulmonary Disease and Respiratory Tract Infections
    06:22

    Machine Learning-Based Cough Tone Classification: Diagnostic Exploration of Chronic Obstructive Pulmonary Disease and Respiratory Tract Infections

    Published on: September 19, 2025

    608
    Asthma Detection Research Based on Voice Signal Processing and Machine Learning
    04:04

    Asthma Detection Research Based on Voice Signal Processing and Machine Learning

    Published on: July 22, 2025

    1.2K

    Related Experiment Videos

    Last Updated: Mar 14, 2026

    Comparison of Predictive Performance of Three Lymph Node Staging Systems in Colorectal Signet Ring Cell Carcinoma Based on Machine Learning Model
    07:13

    Comparison of Predictive Performance of Three Lymph Node Staging Systems in Colorectal Signet Ring Cell Carcinoma Based on Machine Learning Model

    Published on: April 18, 2025

    842
    Machine Learning-Based Cough Tone Classification: Diagnostic Exploration of Chronic Obstructive Pulmonary Disease and Respiratory Tract Infections
    06:22

    Machine Learning-Based Cough Tone Classification: Diagnostic Exploration of Chronic Obstructive Pulmonary Disease and Respiratory Tract Infections

    Published on: September 19, 2025

    608
    Asthma Detection Research Based on Voice Signal Processing and Machine Learning
    04:04

    Asthma Detection Research Based on Voice Signal Processing and Machine Learning

    Published on: July 22, 2025

    1.2K

    Area of Science:

    • Statistics
    • Biostatistics
    • Medical Informatics

    Background:

    • The area under the curve (AUC) is a standard metric for binary regression model performance.
    • Nested models are frequently used to evaluate the added value of new predictors.
    • Current inference methods for AUC differences rely on asymptotic normality, which has limitations.

    Purpose of the Study:

    • To investigate the asymptotic distribution of the difference in AUC statistics for nested models.
    • To develop improved confidence intervals for AUC differences, especially when new factors are not strongly associated with the outcome.
    • To provide a method for quantifying the added value of new factors in regression models.

    Main Methods:

    • The study analyzes the asymptotic distribution of the AUC difference under various conditions of predictor association.
    • A variance-stabilizing reparameterization is proposed for small population differences.
    • Simulations are conducted to evaluate the coverage properties of the new confidence interval.

    Main Results:

    • Asymptotic normality for AUC differences holds only when new factors are associated with the outcome.
    • When new factors are unassociated, the distribution is a chi-square combination.
    • The proposed reparameterization and confidence interval improve inference, particularly for small AUC differences.

    Conclusions:

    • The findings clarify the conditions under which standard inference for AUC differences is valid.
    • The developed confidence interval offers a more reliable way to assess the incremental predictive value of new factors.
    • This approach aids researchers in balancing the benefits of new predictors against their costs, as demonstrated with a pancreatic cancer dataset.