Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Video

Updated: Jun 6, 2025

Detection of Architectural Distortion in Prior Mammograms via Analysis of Oriented Patterns
13:44

Detection of Architectural Distortion in Prior Mammograms via Analysis of Oriented Patterns

Published on: August 30, 2013

42.8K

A Comprehensive Review of Performance Metrics for Computer-Aided Detection Systems.

Doohyun Park1

  • 1VUNO Inc., Seoul 06541, Republic of Korea.

Bioengineering (Basel, Switzerland)
|November 27, 2024
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

Receiver Operating Characteristic Plot01:15

Receiver Operating Characteristic Plot

82
A ROC (Receiver Operating Characteristic) plot is a graphical tool used to assess the performance of a binary classification model by illustrating the trade-off between sensitivity (true positive rate) and specificity (false positive rate). By plotting sensitivity against 1 - specificity across various threshold settings, the ROC curve shows how well the model distinguishes between classes, with a curve closer to the top-left corner indicating a more accurate model. The area under the ROC curve...
82

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Multimodal AI model for preoperative prediction of axillary lymph node metastasis in breast cancer using whole slide images.

NPJ precision oncology·2025
Same author

Deep Learning-Based Slice Thickness Reduction for Computer-Aided Detection of Lung Nodules in Thick-Slice CT.

Diagnostics (Basel, Switzerland)·2024
Same author

Deep Learning-Based Joint Effusion Classification in Adult Knee Radiographs: A Multi-Center Prospective Study.

Diagnostics (Basel, Switzerland)·2024
Same journal

Correction: Komatsu et al. Three-Dimensional Visualization and Detection of the Pulmonary Venous-Left Atrium Connection Using Artificial Intelligence in Fetal Cardiac Ultrasound Screening. <i>Bioengineering</i> 2026, <i>13</i>, 100.

Bioengineering (Basel, Switzerland)·2026
Same journal

Comparison of CO<sub>2</sub> Laser and Microdebrider in the Surgical Treatment of Pediatric Recurrent Respiratory Papillomatosis: A Retrospective Analysis.

Bioengineering (Basel, Switzerland)·2026
Same journal

Toward More Translational Tumor Models: Breast dECM-Based 3D Systems Capture Native Microenvironmental Cues.

Bioengineering (Basel, Switzerland)·2026
Same journal

Postural Stability Changes During the 4 Phases of the Half Squat: Kinematics Profile of the Center of Pressure and Center of Mass in High-Performance Weightlifters-A Pilot Study.

Bioengineering (Basel, Switzerland)·2026
Same journal

Definite Implant Position as Novel Readout for Effectiveness of Ridge Preservation Indicates to Beneficial Effect of Combined Treatment with Platelet-Rich Fibrin (PRF) and Xenogenic Biomaterial in Bone Regeneration.

Bioengineering (Basel, Switzerland)·2026
Same journal

Trueness and Precision of Intraoral Scanners for 3D-Printed Orthodontic Models with Attachments: An In Vitro Comparative Study.

Bioengineering (Basel, Switzerland)·2026
See all related articles

This study analyzes performance metrics for computer-aided detection (CAD) systems in lung nodule detection using CT scans. It guides metric selection by detailing strengths and limitations of methods like ROC and FROC curves.

Area of Science:

  • Medical Imaging Analysis
  • Radiology Informatics
  • Computational Pathology

Background:

  • Computer-aided detection (CAD) systems are crucial for identifying lung nodules in computed tomography (CT) images.
  • Accurate performance evaluation of CAD systems is essential for clinical adoption and improvement.
  • Existing evaluation metrics have limitations that can affect the interpretation of CAD system performance.

Purpose of the Study:

  • To provide a structured analysis of performance metrics for CAD systems in lung nodule detection.
  • To examine the strengths and limitations of various evaluation metrics.
  • To offer guidelines for selecting appropriate metrics for CAD system evaluation.

Main Methods:

  • Categorization of evaluation methods into per-scan and per-nodule approaches.
Keywords:
alternative free-response receiver operating characteristicartificial intelligencecomputer-aided detectionfree-response receiver operating characteristiclung noduleperformance metricreceiver operating characteristic

More Related Videos

Design and Analysis for Fall Detection System Simplification
08:05

Design and Analysis for Fall Detection System Simplification

Published on: April 6, 2020

10.6K
Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education
09:00

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education

Published on: August 16, 2024

700

Related Experiment Videos

Last Updated: Jun 6, 2025

Detection of Architectural Distortion in Prior Mammograms via Analysis of Oriented Patterns
13:44

Detection of Architectural Distortion in Prior Mammograms via Analysis of Oriented Patterns

Published on: August 30, 2013

42.8K
Design and Analysis for Fall Detection System Simplification
08:05

Design and Analysis for Fall Detection System Simplification

Published on: April 6, 2020

10.6K
Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education
09:00

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education

Published on: August 16, 2024

700
  • Analysis of key metrics including Area Under the Receiver Operating Characteristic (ROC) curve (AUROC).
  • Discussion of nodule-level sensitivity, Free-Response ROC (FROC) curves, Competition Performance Metric (CPM), and Alternative FROC (AFROC).

    • Main Results:

    • AUROC is a key metric for per-scan analysis, assessing the distinction between scans with and without nodules.
    • Per-nodule analysis often uses nodule-level sensitivity at fixed false positives per scan, FROC, and CPM.
    • CPM has limitations due to its unnormalized scores and data dependency; AFROC was introduced to combine per-scan and per-nodule strengths.

    Conclusions:

    • Understanding the principles and relative strengths of different metrics is vital for accurate CAD system evaluation.
    • The choice of metric impacts the interpretation of clinical utility and practical application of lung nodule detection CAD systems.
    • AFROC offers a potential improvement by integrating benefits of both per-scan and per-nodule evaluation frameworks.