Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Free-response methodology: alternate analysis and a new observer-performance experiment.

D P Chakraborty1, L H Winter

  • 1Department of Radiology, Hospital of the University of Pennsylvania, Philadelphia 19104.

Radiology
|March 1, 1990
PubMed
Summary

This study evaluates new analysis methods for free-response receiver operating characteristic (FROC) experiments. These advanced techniques, including alternative FROC (AFROC) and free-response forced error (FFE), show good agreement in observer performance analysis.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Dr Tom Swifties….

Postgraduate medicine·2016
Same author

Effect of reconstruction methods and x-ray tube current-time product on nodule detection in an anthropomorphic thorax phantom: A crossed-modality JAFROC observer study.

Medical physics·2016
Same author

Mammography test sets: reading location and prior images do not affect group performance.

Clinical radiology·2014
Same author

Breast tomosynthesis and digital mammography: a comparison of diagnostic accuracy.

The British journal of radiology·2012
Same author

Quantifying the clinical relevance of a laboratory observer performance paradigm.

The British journal of radiology·2012
Same author

Environmental and familial risk factors of Parkinsons disease: case-control study.

The Canadian journal of neurological sciences. Le journal canadien des sciences neurologiques·2010

Area of Science:

  • Medical imaging analysis
  • Observer performance studies
  • Radiology and medical physics

Background:

  • Free-response receiver operating characteristic (FROC) experiments are crucial for evaluating diagnostic accuracy in medical imaging.
  • Traditional FROC analysis requires correct localization of abnormalities, posing challenges with multiple findings per image.
  • The alternative FROC (AFROC) plot offers a performance index but requires specific scoring methods.

Purpose of the Study:

  • To review and evaluate recently introduced methods for analyzing FROC observer-performance experiments.
  • To introduce and assess the utility of AFROC analysis and the free-response forced error (FFE) experiment.
  • To compare the agreement between FROC, AFROC, and FFE methods for observer performance evaluation.

Main Methods:

Related Experiment Videos

  • Review of existing FROC analysis techniques and introduction of AFROC analysis.
  • Description of the novel free-response forced error (FFE) experimental design.
  • Application of FROC and AFROC analysis to existing datasets and simultaneous FROC-AFROC-FFE experiments with radiologists.

Main Results:

  • AFROC analysis provides a generalized approach to scoring FROC images.
  • The FFE experiment offers an alternative paradigm for observer performance assessment.
  • All three methods (FROC, AFROC, and FFE) demonstrated good agreement in evaluating radiologist performance.

Conclusions:

  • The reviewed and introduced methods offer robust and consistent analysis of observer performance in FROC experiments.
  • AFROC analysis and FFE experiments provide valuable, complementary insights into diagnostic accuracy.
  • These methods enhance the evaluation of imaging systems and observer performance in complex scenarios.