Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Estimating diagnostic test accuracy using a "fuzzy gold standard"

C E Phelps1, A Hutson

  • 1Department of Community and Preventive Medicine, University of Rochester, NY 14627.

Medical Decision Making : an International Journal of the Society for Medical Decision Making
|January 1, 1995
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Long-Range Transverse-Momentum Correlations and Radial Flow in Pb-Pb Collisions at the LHC.

Physical review letters·2026
Same author

Search for Quasiparticle Scattering in the Quark-Gluon Plasma with Jet Splittings in pp and Pb-Pb Collisions at sqrt[s_{NN}]=5.02  TeV.

Physical review letters·2025
Same author

First Measurement of A=4 Hypernuclei and Antihypernuclei at the LHC.

Physical review letters·2025
Same author

Probing Strangeness Hadronization with Event-by-Event Production of Multistrange Hadrons.

Physical review letters·2025
Same author

Measurements of Chemical Potentials in Pb-Pb Collisions at sqrt[s_{NN}]=5.02  TeV.

Physical review letters·2024
Same author

Observation of Medium-Induced Yield Enhancement and Acoplanarity Broadening of Low-p_{T} Jets from Measurements in pp and Central Pb-Pb Collisions at sqrt[s_{NN}]=5.02  TeV.

Physical review letters·2024

Diagnostic test accuracy can be miscalculated when the gold standard has errors. A new "two-truth" method using probabilistic gold standards can improve accuracy assessment by reducing bias.

Area of Science:

  • Medical diagnostics
  • Biostatistics
  • Diagnostic accuracy research

Background:

  • Evaluating diagnostic test accuracy is crucial in medicine.
  • Criterion standards, often called "gold standards," are used for this evaluation.
  • Errors in the gold standard can significantly impact accuracy assessments.

Purpose of the Study:

  • To analyze the impact of erroneous gold standards on diagnostic test accuracy using ROC curves.
  • To propose methods for correcting accuracy estimates when the gold standard is imperfect.
  • To investigate the interplay between diagnostic test errors and gold standard errors.

Main Methods:

  • Utilized Monte Carlo simulations to model diagnostic accuracy.
  • Introduced the concept of a "fuzzy" gold standard (FGS) with inherent errors.

Related Experiment Videos

  • Developed and evaluated two methods requiring probabilistic gold-standard statements, including the "two-truth" method.

    • Main Results:

    • Inaccurate gold standards can lead to underestimation or overestimation of test accuracy, depending on error dependency.
    • When test and FGS errors are independent, accuracy is underestimated.
    • When test and FGS errors are dependent, accuracy can be overestimated.
    • The "two-truth" method effectively reduces underestimation bias when errors are independent.
    • The "two-truth" method may still lead to overestimation if errors are dependent.

    Conclusions:

    • The accuracy of diagnostic tests can be biased by errors in the gold standard.
    • Probabilistic gold standards and methods like "two-truth" offer potential solutions for bias correction.
    • Careful consideration of error dependency is necessary when applying bias correction methods to diagnostic accuracy studies.