A Modified Contrasting Groups Method Used for Setting the Passmark in a Small Scale Standardised Patient Examination

Area of Science:

• Medical Education
• Professional Certification Examinations
• General Practice Training

Background:

• The Royal College of General Practitioners (UK) uses a Simulated Surgery exam as an alternative assessment for GP registrars.
• This exam is for candidates who cannot provide videotaped patient interviews for their Membership examination.
• It comprises a 20-station Objective Structured Clinical Examination (OSCE) for small candidate cohorts.

Purpose of the Study:

• To establish a reliable passmark for the Simulated Surgery examination.
• To ensure a consistent standard in assessing GP registrars' consulting skills.
• To validate a method for maintaining a stable passing standard over time.

Main Methods:

• A modified contrasting groups method was employed to set the examination passmark.
• Examiners made overall pass/fail judgments based on candidates' whole-test grades.
• The method was applied to two distinct cohorts of candidates.

Main Results:

• A consistent passmark was achieved across two different candidate cohorts.
• The modified contrasting groups method demonstrated its ability to yield stable results.
• This approach allows for the maintenance of a uniform passing standard.

Conclusions:

• The modified contrasting groups method effectively sets a consistent passmark for the Simulated Surgery exam.
• This methodology supports the maintenance of a stable and reliable standard for GP registrar assessment.
• The approach is suitable for ensuring consistent evaluation despite varying candidate groups or future changes.