Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Using localization data from image interpretations to improve estimates of performance accuracy.

R G Swensson1

  • 1Department of Radiology, The University of Pittsburgh, Pennsylvania 15261, USA. rswensson@radserv.arad.upmc.edu

Medical Decision Making : an International Journal of the Society for Medical Decision Making
|April 20, 2000
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

A constrained formulation for the receiver operating characteristic (ROC) curve based on probability summation.

Medical physics·2001
Same author

Observer variation and the performance accuracy gained by averaging ratings of abnormality.

Medical physics·2000
Same author

Influence of visual distractors on detectability of liver nodules on contrast-enhanced spiral computed tomography scans.

Academic radiology·1997
Same author

Measuring performance efficiency and consistency in visual discriminations with noisy images.

Journal of experimental psychology. Human perception and performance·1996
Same author

Unified measurement of observer performance in detecting and localizing target objects on images.

Medical physics·1996
Same author

Spiral CT of the chest: comparison of cine and film-based viewing.

Radiology·1995
Same journal

Flexible Survival Extrapolation with Blended Hazards: Accounting for Treatment Effect Waning in Health Technology Assessment.

Medical decision making : an international journal of the Society for Medical Decision Making·2026
Same journal

A Microsimulation Model for Chronic Kidney Disease Progression in Type 2 Diabetes Patients in the United States: Michigan Model for Diabetes-Chronic Kidney Disease Model.

Medical decision making : an international journal of the Society for Medical Decision Making·2026
Same journal

Cardiovascular Risk Estimation and Statin Adherence: A Historical Cohort Study.

Medical decision making : an international journal of the Society for Medical Decision Making·2026
Same journal

Taste or Scale? Methodological Approach to Health Preferences Comparison across Groups.

Medical decision making : an international journal of the Society for Medical Decision Making·2026
Same journal

Mind the Gap: Impact of New Labels on Public Perceptions and Calculated Risk of Adverse Outcomes after a Melanoma In Situ Diagnosis-A Secondary Analysis of an Online Randomized Experiment.

Medical decision making : an international journal of the Society for Medical Decision Making·2026
Same journal

A Metamodel-Based General-Purpose Autocalibration Tool for Simulation Models.

Medical decision making : an international journal of the Society for Medical Decision Making·2026
See all related articles

Incorporating localization data into image analysis significantly enhances the accuracy of detection metrics, particularly for less accurate assessments. This method improves statistical precision, offering benefits comparable to larger sample sizes.

Area of Science:

  • Radiology
  • Medical Imaging Analysis
  • Statistical Modeling in Medicine

Background:

  • Receiver Operating Characteristic (ROC) curve analysis is crucial for evaluating diagnostic accuracy.
  • Area under the ROC curve (Az) quantifies detection accuracy but can be imprecise.
  • Statistical precision of Az estimates is vital for reliable diagnostic performance measurement.

Purpose of the Study:

  • To evaluate the improvement in statistical precision of Az estimates by incorporating image localization data.
  • To quantify the reduction in the standard error of Az when localization information is included in the analysis.
  • To compare the impact of localization data on Az estimates across different imaging modalities and lesion types.

Main Methods:

  • A recently developed model utilizing abnormality localization on images was employed.

Related Experiment Videos

  • Comparisons were made between statistical analyses with and without localization data.
  • Estimates of Az were analyzed for observers' ROC curves on chest films and liver CT scans.
  • Monte Carlo simulations of 2,000 independent rating experiments were conducted to assess sampling distributions.

    • Main Results:

    • Localization information significantly improved the precision of Az estimates.
    • The improvement in precision was most notable when detection accuracy was low (Az approximately 0.60).
    • The benefits in estimation precision were comparable to a two-to-fourfold increase in sample sizes (both cases and observers).

    Conclusions:

    • Integrating localization data into the statistical analysis of diagnostic accuracy metrics substantially enhances precision.
    • This approach offers a statistically efficient method to improve the reliability of Az estimates, especially in challenging detection scenarios.
    • The findings suggest that localization-aware models can reduce the need for larger datasets, optimizing resource allocation in diagnostic accuracy studies.