Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Observer studies involving detection and localization: modeling, analysis, and validation.

Dev P Chakraborty1, Kevin S Berbaum

  • 1Department of Radiology, University of Pittsburgh, Pittsburgh, Pennsylvania 15213, USA. dpc10@pitt.edu

Medical Physics
|September 21, 2004
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Effect of fatigue on reading computed tomography examination of the multiply injured patient.

Journal of medical imaging (Bellingham, Wash.)·2017
Same author

The Impact of Fatigue on Satisfaction of Search in Chest Radiography.

Academic radiology·2017
Same author

Due to potential concerns of bias and conflicts of interest, regulatory bodies should not do evaluation methodology research related to their regulatory missions.

Medical physics·2017
Same author

Erratum: "Evaluating computer-aided detection algorithms".

Medical physics·2017
Same author

A bivariate contaminated binormal model for robust fitting of proper ROC curves to a pair of correlated, possibly degenerate, ROC datasets.

Medical physics·2017
Same author

ROC or FROC? It depends on the research question.

Medical physics·2017
Same journal

Correction to "On the shape of the radiation survival curve in tumor spheroids: The role of oxygen heterogeneity".

Medical physics·2026
Same journal

Multi-view constrained semi-supervised vertebra detection for 3D ultrasound spine volume.

Medical physics·2026
Same journal

Accuracy of quantitative <sup>177</sup>Lu SPECT/CT imaging: A systematic review.

Medical physics·2026
Same journal

Physics-constrained dual-domain network for CBCT reconstruction from orthogonal X-rays in gynecologic radiotherapy.

Medical physics·2026
Same journal

Decomposition-based harmonization for quantitative PET imaging across scanners and radiotracers.

Medical physics·2026
Same journal

Development and evaluation of an in vivo dose-based monitoring system for electron FLASH radiation therapy.

Medical physics·2026
See all related articles

The new JAFROC analysis method improves diagnostic imaging evaluation by allowing multiple abnormality reports per image and using location data. JAFROC offers greater statistical power than traditional ROC and DBM methods, potentially reducing sample size needs.

Area of Science:

  • Medical Imaging Analysis
  • Statistical Modeling in Diagnostics
  • Radiology Research

Background:

  • Receiver Operating Characteristic (ROC) analysis is standard for diagnostic imaging but limited to single reports per image.
  • Free-Response ROC (FROC) allows multiple abnormality reports and uses location data, but faces independence assumption concerns.
  • Existing FROC methods like AFROC have limitations in statistical power and hypothesis testing.

Purpose of the Study:

  • To introduce and evaluate a novel jackknife FROC (JAFROC) analysis method.
  • To compare JAFROC's performance against AFROC and Dorfman-Berbaum-Metz (DBM) methods using simulated data.
  • To assess statistical power and null hypothesis behavior of JAFROC.

Main Methods:

  • Developed a simulation model for Free-Response ROC data based on expert image evaluation eye-movement patterns.

Related Experiment Videos

  • Compared JAFROC, AFROC, and DBM methods using the simulated data.
  • Evaluated null hypothesis (NH) test performance and statistical power of each method.

    • Main Results:

    • AFROC analysis was unduly conservative and failed the NH test.
    • Both JAFROC and DBM methods passed the NH test.
    • JAFROC demonstrated significantly higher statistical power compared to the DBM method.

    Conclusions:

    • JAFROC analysis overcomes the independence assumption limitation of traditional FROC methods.
    • JAFROC offers improved statistical power for diagnostic performance studies.
    • The JAFROC method may allow for reduced sample size requirements in future diagnostic imaging research.