Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Receiver Operating Characteristic Plot01:15

Receiver Operating Characteristic Plot

576
A ROC (Receiver Operating Characteristic) plot is a graphical tool used to assess the performance of a binary classification model by illustrating the trade-off between sensitivity (true positive rate) and specificity (false positive rate). By plotting sensitivity against 1 - specificity across various threshold settings, the ROC curve shows how well the model distinguishes between classes, with a curve closer to the top-left corner indicating a more accurate model. The area under the ROC curve...
576
Sensitivity, Specificity, and Predicted Value01:13

Sensitivity, Specificity, and Predicted Value

1.8K
In healthcare diagnostics, laboratory tests play a crucial role in identifying and diagnosing a wide range of medical conditions. However, interpreting test results is not always straightforward. An abnormal test result does not always confirm the presence of a disease, just as a normal result does not guarantee its absence. To assess the reliability of these diagnostic tools, healthcare practitioners rely on two key statistical indicators: sensitivity and specificity.
Sensitivity is the...
1.8K
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches01:23

Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches

548
Biopharmaceutical studies constitute a vital field aiming to enhance drug delivery methods and refine therapeutic approaches, drawing upon diverse interdisciplinary knowledge. In research methodologies, the choice between controlled and non-controlled studies significantly influences the study's reliability and accuracy.
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
548
Kaplan-Meier Approach01:24

Kaplan-Meier Approach

739
The Kaplan-Meier estimator is a non-parametric method used to estimate the survival function from time-to-event data. In medical research, it is frequently employed to measure the proportion of patients surviving for a certain period after treatment. This estimator is fundamental in analyzing time-to-event data, making it indispensable in clinical trials, epidemiological studies, and reliability engineering. By estimating survival probabilities, researchers can evaluate treatment effectiveness,...
739

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Copas-Heckman-Type Sensitivity Analysis for Publication Bias in Rare-Event Meta-Analysis Under Generalized Linear Mixed Models.

Statistics in medicine·2026
Same author

Clinical Value of Circulating Endometrial Cells in the Diagnosis and Stratified Diagnosis of Endometriosis.

Journal of clinical medicine·2026
Same author

Sensitivity Analysis for Publication Bias in Diagnostic Meta-Analysis of Sparsity Using the Copas t-Statistic Selection Function.

Statistics in medicine·2026
Same author

Biomarker Combination Based on the Youden Index With and Without Gold Standard.

Statistics in medicine·2025
Same author

Inference for Cumulative Incidences and Treatment Effects in Randomized Controlled Trials With Time-to-Event Outcomes Under ICH E9 (R1).

Statistics in medicine·2025
Same author

A practical analysis procedure on generalizing comparative effectiveness in the randomized clinical trial to the real-world trial-eligible population.

Journal of biopharmaceutical statistics·2025
Same journal

A Causal Framework for Evaluating the Total Effect of Strategies Aiming to Expand Screening and to Improve Outcomes.

Statistics in medicine·2026
Same journal

Causal Effects on Nonterminal Event Time With Application to Antibiotic Usage and Future Resistance.

Statistics in medicine·2026
Same journal

Subgroup Analysis of Interval-censored Failure Time Data With Application to Alzheimer's Disease.

Statistics in medicine·2026
Same journal

Rejoinder to Commentaries on "A Perspective on the Appropriate Implementation of ICH E9(R1) Addendum Strategies for Handling Intercurrent Events".

Statistics in medicine·2026
Same journal

A Multi-Stage Drop-the-Loser Design With Superiority Boundaries.

Statistics in medicine·2026
Same journal

Interpretable ROI Identification in Brain Image Analysis: Overcoming CNN Black Box Challenges With Kriging-Enhanced Adaptive Sampling.

Statistics in medicine·2026
See all related articles

Related Experiment Video

Updated: Apr 3, 2026

Machine Learning Algorithms for Early Detection of Bone Metastases in an Experimental Rat Model
07:15

Machine Learning Algorithms for Early Detection of Bone Metastases in an Experimental Rat Model

Published on: August 16, 2020

7.7K

Evaluation of AI-Based Medical Device Concerning Localization Information Using Nonparametric Inference for the

Kaiyuan Liu1, Xiao-Hua Zhou2,3

  • 1School of Mathematical Sciences, Peking University, Beijing, China.

Statistics in Medicine
|April 2, 2026
PubMed
Summary
This summary is machine-generated.

This study introduces a new nonparametric method for analyzing alternative free-response receiver operating characteristic (AFROC) curves in diagnostic tests. The proposed approach offers more reliable performance evaluations for lesion detection and localization compared to existing parametric methods.

Keywords:
AI‐based medical device evaluationFROClocation‐specific ROC curvesnonparametric methods

More Related Videos

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education
09:00

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education

Published on: August 16, 2024

1.3K
An R-Based Landscape Validation of a Competing Risk Model
05:37

An R-Based Landscape Validation of a Competing Risk Model

Published on: September 16, 2022

2.7K

Related Experiment Videos

Last Updated: Apr 3, 2026

Machine Learning Algorithms for Early Detection of Bone Metastases in an Experimental Rat Model
07:15

Machine Learning Algorithms for Early Detection of Bone Metastases in an Experimental Rat Model

Published on: August 16, 2020

7.7K
Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education
09:00

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education

Published on: August 16, 2024

1.3K
An R-Based Landscape Validation of a Competing Risk Model
05:37

An R-Based Landscape Validation of a Competing Risk Model

Published on: September 16, 2022

2.7K

Area of Science:

  • Medical Imaging Analysis
  • Statistical Methods in Diagnostics
  • Biostatistics

Background:

  • Alternative free-response receiver operating characteristic (AFROC) curves are widely used for diagnostic test performance evaluation, particularly for lesion detection and localization.
  • Current AFROC inference methods often depend on untestable assumptions of data independence and specific parametric models, limiting their practical applicability.
  • The limitations of existing parametric approaches necessitate the development of more robust and flexible statistical methods for AFROC analysis.

Purpose of the Study:

  • To propose and validate novel nonparametric inference methods for the AFROC curve.
  • To develop a bootstrap-based approach for constructing confidence intervals and bands for AFROC curves and related indices.
  • To demonstrate the practical utility of the proposed nonparametric methods in real-world diagnostic scenarios.

Main Methods:

  • Development of nonparametric inference techniques for the AFROC curve, including derivation of asymptotic properties for the empirical AFROC curve.
  • Introduction of a novel bootstrap methodology to generate confidence intervals for AFROC-related indices and confidence bands for the AFROC curve.
  • Comparative analysis through simulations to assess the performance of the proposed nonparametric method against existing parametric approaches.

Main Results:

  • The proposed nonparametric inference method for AFROC curves demonstrates superior performance compared to traditional parametric methods, especially when parametric assumptions are not met.
  • The bootstrap method effectively constructs reliable confidence intervals and bands, enhancing the interpretability of diagnostic test performance.
  • Simulations confirm the robustness and accuracy of the nonparametric approach under various conditions.

Conclusions:

  • The developed nonparametric methods provide a more reliable and flexible framework for analyzing AFROC curves in diagnostic test evaluation.
  • This approach overcomes the limitations of parametric assumptions, offering improved accuracy in assessing lesion detection and localization performance.
  • The method is practically applicable, as shown by its use in evaluating an AI-assisted pulmonary nodule diagnosis system.