Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Assessing predictive accuracy: how to compare Brier scores.

D A Redelmeier1, D A Bloch, D H Hickam

  • 1Department of Medicine, University of Toronto, Canada.

Journal of Clinical Epidemiology
|January 1, 1991
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Berkson's paradox in medical care.

Journal of internal medicine·2015
Same author

Patients' willingness-to accept risk of medical treatments.

The International journal of risk & safety in medicine·2013
Same author

Patients' willingness to accept risks of medical intervention: intubation and ventilatory support for short periods of time.

The International journal of risk & safety in medicine·2013
Same author

Safety and efficacy of retreatment with a bioengineered hyaluronate for painful osteoarthritis of the knee: results of the open-label Extension Study of the FLEXX Trial.

Osteoarthritis and cartilage·2011
Same author

Safety issues in the development of treatments for osteoarthritis: recommendations of the Safety Considerations Working Group.

Osteoarthritis and cartilage·2011
Same author

Discharge after discharge: predicting surgical site infections after patients leave hospital.

The Journal of hospital infection·2010

A new statistical method helps compare medical judgment accuracy using the Brier score. This tool identifies significant differences in predictive accuracy among clinicians, aiding in better uncertainty expression analysis.

Area of Science:

  • Medical Statistics
  • Clinical Decision Making

Background:

  • The Brier index is used to assess medical judgment predictive accuracy.
  • Comparing Brier scores between raters is challenging due to the lack of statistical tests.

Purpose of the Study:

  • To demonstrate a statistical method for differentiating between Brier scores.
  • To compare the predictive accuracy of medical students' judgments.

Main Methods:

  • Analysis of judgments from five medical students evaluating 25 patients with recurrent chest pain.
  • Application of a novel statistical test to compare Brier scores.
  • Comparison with receiver operating characteristic curve area analysis.

Main Results:

  • Two students' judgments were found to be incompatible with observed outcomes (p < 0.05).

Related Experiment Videos

  • A significant difference was detected between two of the remaining three students (p < 0.05).
  • Results differed from receiver operating characteristic curve area analysis.

    • Conclusions:

    • The proposed method provides a statistically sound tool for comparing Brier scores.
    • This method aids in evaluating how well clinicians express uncertainty through probability judgments.
    • It offers a valuable alternative for assessing predictive accuracy in medical decision-making.