Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Imaging Studies for Cardiovascular System VI: Calcium -Scoring CT01:25

Imaging Studies for Cardiovascular System VI: Calcium -Scoring CT

Calcium-Scoring CT ScanA calcium-scoring CT scan, also known as coronary artery calcium (CAC) scan, detects calcium deposits in the coronary arteries. This test assesses the risk of coronary artery disease (CAD), which can lead to cardiovascular events such as angina, heart failure, and sudden cardiac arrest.A calcium-scoring CT scan is generally recommended for individuals at intermediate risk of CAD without symptoms. It includes:Men aged 40-75 and women aged 50-75: Especially those with a...
Receiver Operating Characteristic Plot01:15

Receiver Operating Characteristic Plot

A ROC (Receiver Operating Characteristic) plot is a graphical tool used to assess the performance of a binary classification model by illustrating the trade-off between sensitivity (true positive rate) and specificity (false positive rate). By plotting sensitivity against 1 - specificity across various threshold settings, the ROC curve shows how well the model distinguishes between classes, with a curve closer to the top-left corner indicating a more accurate model. The area under the ROC curve...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Enhancing Study Design and Analysis of MR Imaging Markers Through Measurement Error Modeling.

Journal of magnetic resonance imaging : JMRI·2026
Same author

Scalable Clinical Annotation with Location Evidence (SCALE).

Computers in biology and medicine·2025
Same author

Association of Statistical Methodology and Design in Preclinical Animal Studies With Successful Translation Into Clinical Phase 2 Trials.

Neurology·2025
Same author

Objective Task-Based Evaluation of Quantitative Medical Imaging Methods: Emerging Frameworks and Future Directions.

PET clinics·2025
Same author

Understanding Repeatability and Reproducibility Coefficients for Quantitative Imaging Biomarkers.

Radiology·2025
Same author

ISIT-GEN: An in silico imaging trial to assess the inter-scanner generalizability of CTLESS for myocardial perfusion SPECT on defect-detection task.

ArXiv·2025
Same journal

Improving Reliability of MRI Lumbar Spinal Stenosis Assessment Across Radiology and Spine Specialties: Impact of a Structured Education Intervention.

Academic radiology·2026
Same journal

Advances in CT and MRI for Yttrium-90 Radioembolization of Hepatocellular Carcinoma.

Academic radiology·2026
Same journal

Homogeneity of Liver Fat Distribution Serves as a Diagnostic Marker for Metabolic Dysfunction-Associated Steatohepatitis.

Academic radiology·2026
Same journal

MRI-based Predictors and Risk Constellations of Chronic Ankle Instability After Acute Lateral Ankle Sprain: A Multicenter Study.

Academic radiology·2026
Same journal

Early Prediction of Pathological Complete Response to Neoadjuvant Chemotherapy in Breast Cancer using a Longitudinal US-based Stack-model.

Academic radiology·2026
Same journal

Evaluating the Impact of Embolization on Outcomes in Iliopsoas Hematomas: A Multicenter Retrospective Propensity-matched Study.

Academic radiology·2026
See all related articles

Related Experiment Video

Updated: May 29, 2026

Signal Acquisition, Score Interpretation, and Economics of a Non-Invasive Point-of-Care Test for Coronary Artery Disease
06:16

Signal Acquisition, Score Interpretation, and Economics of a Non-Invasive Point-of-Care Test for Coronary Artery Disease

Published on: August 9, 2024

Predicting readers' diagnostic accuracy with a new CAD algorithm.

Nancy A Obuchowski1

  • 1Cleveland Clinic Foundation, Department of Quantitative Health Sciences, Cleveland, OH 44195, USA. obuchon@ccf.org

Academic Radiology
|September 16, 2011
PubMed
Summary
This summary is machine-generated.

A new modeling approach can predict reader accuracy with updated computer-aided detection (CAD) algorithms, potentially reducing the need for extensive clinical trials. This method shows feasibility for assessing CAD algorithm improvements before full-scale testing.

More Related Videos

Detection of Architectural Distortion in Prior Mammograms via Analysis of Oriented Patterns
13:44

Detection of Architectural Distortion in Prior Mammograms via Analysis of Oriented Patterns

Published on: August 30, 2013

Advancing Dyslexia Assessment in Children Through Computerized Testing
09:00

Advancing Dyslexia Assessment in Children Through Computerized Testing

Published on: August 16, 2024

Related Experiment Videos

Last Updated: May 29, 2026

Signal Acquisition, Score Interpretation, and Economics of a Non-Invasive Point-of-Care Test for Coronary Artery Disease
06:16

Signal Acquisition, Score Interpretation, and Economics of a Non-Invasive Point-of-Care Test for Coronary Artery Disease

Published on: August 9, 2024

Detection of Architectural Distortion in Prior Mammograms via Analysis of Oriented Patterns
13:44

Detection of Architectural Distortion in Prior Mammograms via Analysis of Oriented Patterns

Published on: August 30, 2013

Advancing Dyslexia Assessment in Children Through Computerized Testing
09:00

Advancing Dyslexia Assessment in Children Through Computerized Testing

Published on: August 16, 2024

Area of Science:

  • Medical Imaging
  • Artificial Intelligence in Medicine
  • Clinical Trials

Background:

  • Computer-aided detection (CAD) algorithms require rigorous testing to prove clinical utility.
  • Multireader, multicase (MRMC) clinical trials are the standard for evaluating CAD algorithm performance but are resource-intensive.
  • Repeated MRMC studies are burdensome for each new CAD algorithm release.

Purpose of the Study:

  • To develop and present a novel modeling approach for predicting reader accuracy with new CAD algorithms.
  • To assess the feasibility of this modeling approach as an alternative to full-scale MRMC studies.
  • To provide a method for pre-screening CAD algorithms for potential accuracy improvements.

Main Methods:

  • Utilized multiple-variable logistic regression to build predictive models.
  • Models were based on data from a prior MRMC study of an older CAD algorithm and the standalone performance of a new CAD algorithm.
  • The approach was illustrated and tested using data from a large lung MRMC CAD trial.

Main Results:

  • The developed model slightly overestimated reader sensitivity with the new CAD algorithm, but the difference was not statistically significant (0.621 vs 0.603, P = .147).
  • Observed and predicted false-positive rates also showed no significant difference (0.275 vs 0.285, P = .250).

Conclusions:

  • The proposed modeling approach is feasible for predicting reader accuracy with new CAD algorithms.
  • Further testing is required to validate its use as a replacement for full-scale MRMC studies.
  • This approach can help determine if a new CAD algorithm warrants further investigation via MRMC trials.