Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Receiver Operating Characteristic Plot01:15

Receiver Operating Characteristic Plot

72
A ROC (Receiver Operating Characteristic) plot is a graphical tool used to assess the performance of a binary classification model by illustrating the trade-off between sensitivity (true positive rate) and specificity (false positive rate). By plotting sensitivity against 1 - specificity across various threshold settings, the ROC curve shows how well the model distinguishes between classes, with a curve closer to the top-left corner indicating a more accurate model. The area under the ROC curve...
72
Sensitivity, Specificity, and Predicted Value01:13

Sensitivity, Specificity, and Predicted Value

165
In healthcare diagnostics, laboratory tests play a crucial role in identifying and diagnosing a wide range of medical conditions. However, interpreting test results is not always straightforward. An abnormal test result does not always confirm the presence of a disease, just as a normal result does not guarantee its absence. To assess the reliability of these diagnostic tools, healthcare practitioners rely on two key statistical indicators: sensitivity and specificity.
Sensitivity is the...
165
Comparing the Survival Analysis of Two or More Groups01:20

Comparing the Survival Analysis of Two or More Groups

122
Survival analysis is a cornerstone of medical research, used to evaluate the time until an event of interest occurs, such as death, disease recurrence, or recovery. Unlike standard statistical methods, survival analysis is particularly adept at handling censored data—instances where the event has not occurred for some participants by the end of the study or remains unobserved. To address these unique challenges, specialized techniques like the Kaplan-Meier estimator, log-rank test, and...
122

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Gene-Function-Based Clusters Explore Intricate Networks of Gene Expression of Circulating Tumor Cells in Patients with Colorectal Cancer.

Biomedicines·2023
Same author

Assessment System for Predicting Maximal Safe Range for Heel Height by Using Force-Sensing Resistor Sensors and Regression Models.

Sensors (Basel, Switzerland)·2022
Same author

Sample size determination for comparing accuracies between two diagnostic tests under a paired design.

Biometrical journal. Biometrische Zeitschrift·2022
Same author

Beverage-Drug Interaction: Effects of Green Tea Beverage Consumption on Atorvastatin Metabolism and Membrane Transporters in the Small Intestine and Liver of Rats.

Membranes·2020
Same author

Left atrial emptying fraction predicts recurrence of atrial fibrillation after radiofrequency catheter ablation.

PloS one·2018
Same author

Effect of commercially available green and black tea beverages on drug-metabolizing enzymes and oxidative stress in Wistar rats.

Food and chemical toxicology : an international journal published for the British Industrial Biological Research Association·2014

Related Experiment Video

Updated: May 28, 2025

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education
09:00

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education

Published on: August 16, 2024

668

Performance of tests based on the area under the ROC curve for multireader diagnostic data.

Yi-Ting Hwang1, Ya-Ru Hsu1, Nan-Cheng Su1

  • 1Department of Statistics, National Taipei University, Sancia, New Taipei City, Taiwan.

Journal of Applied Statistics
|February 14, 2025
PubMed
Summary

This study introduces new statistical tests for diagnostic accuracy, addressing limitations of previous methods. The research offers improved analysis for reader variability in medical imaging, enhancing diagnostic tool evaluation.

Keywords:
DBM modelROC curveWald testmultireaderspseudovalues

More Related Videos

Detection of Architectural Distortion in Prior Mammograms via Analysis of Oriented Patterns
13:44

Detection of Architectural Distortion in Prior Mammograms via Analysis of Oriented Patterns

Published on: August 30, 2013

42.7K
Machine Learning Algorithms for Early Detection of Bone Metastases in an Experimental Rat Model
07:15

Machine Learning Algorithms for Early Detection of Bone Metastases in an Experimental Rat Model

Published on: August 16, 2020

6.6K

Related Experiment Videos

Last Updated: May 28, 2025

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education
09:00

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education

Published on: August 16, 2024

668
Detection of Architectural Distortion in Prior Mammograms via Analysis of Oriented Patterns
13:44

Detection of Architectural Distortion in Prior Mammograms via Analysis of Oriented Patterns

Published on: August 30, 2013

42.7K
Machine Learning Algorithms for Early Detection of Bone Metastases in an Experimental Rat Model
07:15

Machine Learning Algorithms for Early Detection of Bone Metastases in an Experimental Rat Model

Published on: August 16, 2020

6.6K

Area of Science:

  • Medical diagnostics
  • Biostatistics
  • Radiology

Background:

  • Reliable diagnostic tools are crucial for disease prevention, healthcare cost reduction, and improved quality of life.
  • Receiver Operating Characteristic (ROC) curves and Area Under the Curve (AUC) are standard metrics for diagnostic performance.
  • Subjectivity in interpreting medical images (e.g., MRI) can lead to reader-dependent accuracy variations.

Purpose of the Study:

  • To develop novel statistical tests for analyzing diagnostic accuracy, specifically addressing issues with existing methods like AUC pseudovalues.
  • To provide methods that account for correlations arising from multiple readers interpreting diagnostic data.
  • To introduce a two-stage test to correct for potential negative random effect estimates in small reader groups.

Main Methods:

  • Development of new tests based on AUC estimates and their asymptotic distributions.
  • Application of a two-stage testing procedure to mitigate issues with negative random effect estimates.
  • Evaluation of the proposed tests' performance using Monte Carlo simulations.
  • Assessment of the robustness of distributional assumptions for the developed tests.

Main Results:

  • The study proposes four new tests for diagnostic accuracy analysis.
  • Monte Carlo simulations demonstrate the performance of these tests.
  • The robustness of the distributional assumptions underlying the tests is verified.
  • The practical applicability of the tests is confirmed using two real-world datasets.

Conclusions:

  • The developed statistical tests offer an improvement over existing methods for analyzing diagnostic accuracy, particularly in scenarios with multiple readers.
  • The proposed two-stage test effectively addresses the problem of negative random effect estimates.
  • These new methods enhance the objective evaluation of diagnostic tools, especially those relying on expert interpretation.