Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Search research articles

Related Experiment Videos

Contrasting groups' standard setting for consequences analysis in validity studies: reporting considerations.

Morten Jørgensen^1,2,3, Lars Konge^1,2, Yousif Subhi^1,3

¹1Faculty of Health and Medical Sciences, University of Copenhagen, Copenhagen, Denmark.

Advances in Simulation (London, England)

|March 21, 2018

Summary

This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Immersive Virtual Reality Simulation-Based Assessments in Orthopedic Surgery: A Systematic Scoping Review.

JBJS reviews·2026

Same author

Real-world insights on switching aflibercept dosage for enhanced outcomes in age-related macular degeneration (RISE-AMD): Safety data.

Acta ophthalmologica·2026

Same author

Re: Navid Roessler, Marcin Miszczyk, Keiichiro Miyajima, et al. Harnessing Artificial Intelligence for Risk Stratification and Outcome Prediction in Urologic Cancers: A Systematic Review. Eur Urol Focus 2025; S2405-4569(25)00362-1. In press. http://dx.doi.org/10.1016/j.euf.2025.12.007.

European urology focus·2026

Same author

European Expert Consensus on Essential Variables for Teledermatological Assessment of Skin Tumours.

Acta dermato-venereologica·2026

Same author

ERS/ESGE/ESTS clinical practice guidelines on endobronchial and oesophageal endosonography for the diagnosis and staging of lung cancer.

The European respiratory journal·2026

Same author

Real-world incidence and clinical characteristics of intraocular inflammation following intravitreal faricimab therapy: A safety study.

Acta ophthalmologica·2026

Same journal

Artificial intelligence to support debriefing in simulation-based healthcare education: a scoping review.

Advances in simulation (London, England)·2026

Same journal

Impact of interprofessional blended learning with low-fidelity simulation on neonatal resuscitation skills among interns: a quasi-experimental study in Tanzania.

Advances in simulation (London, England)·2026

Same journal

Performance using a visuo-haptic surgical simulator is affected by age.

Advances in simulation (London, England)·2026

Same journal

Strengthening simulation design and cultural safe practice: end-user evaluation of the quality simulation assurance framework.

Advances in simulation (London, England)·2026

Same journal

AI integration in healthcare simulation debriefing: support or substitute?

Advances in simulation (London, England)·2026

Same journal

From prototype to national standard: a governance framework for scaling simulation-based bronchoscopy training.

Advances in simulation (London, England)·2026

See all related articles

The contrasting groups method for performance analysis in medical validity studies is sensitive to small group sizes. Using the cumulative distribution function offers a more robust approach to calculating false positives and negatives.

Area of Science:

Medical Education
Performance Assessment
Surgical Training

Background:

The contrasting groups' standard setting method is prevalent in medical and surgical validity studies for performance analysis.
This method establishes a pass/fail cutoff, enabling the identification of false positives and false negatives.
However, small group sizes in validity studies can make these analyses susceptible to outliers.

Purpose of the Study:

To address the limitations of the contrasting groups' standard setting method in validity studies.
To propose a more robust statistical approach for analyzing performance in medical and surgical contexts.

Main Methods:

Utilizing the cumulative distribution function to overcome the shortcomings of the contrasting groups method.
Developing an Excel sheet to simplify the proposed calculations.

Keywords:

Contrasting groups False negatives False positives Medical education Messick’s validity framework Standard setting

Related Experiment Videos

Main Results:

Demonstrated significant absolute differences between observed and theoretical false positives/negatives.
Provided illustrative examples highlighting these discrepancies.

Conclusions:

Advocating for reporting both observed and theoretical false positives and negatives for enhanced validity study reporting.
Introducing a practical tool (Excel sheet) to facilitate these improved reporting practices.