The objective structured clinical examination revisited for postgraduate trainees in general practice

Area of Science:

• Medical Education
• Assessment and Evaluation

Background:

• Traditional Objective Structured Clinical Examinations (OSCEs) face ongoing discussions regarding their reliability and validity.
• The current learning environment necessitates re-evaluating assessment strategies for postgraduate medical training.

Purpose of the Study:

• To determine if an OSCE incorporating more complex simulated patient encounters maintains psychometric validity and reliability.
• To assess the performance of postgraduate general practice trainees using an enhanced OSCE format.

Main Methods:

• An intervention study replaced the traditional OSCE with a new, complex version for all second and third-phase general practice trainees.
• Psychometric qualities were evaluated using univariate and multivariate analyses on collected assessment data.

Main Results:

• 340 trainees participated, with slightly higher average scores for third-phase students (p=0.05).
• Test scores showed equal distribution across stations, circuits, and phases.
• Multiple regression analysis indicated scores were dependent on stations and circuits, not the training phase.

Conclusions:

• Reshaping the OSCE with more complex patient encounters appears to restore test validity for postgraduate general practice trainees.
• This sophisticated OSCE design may more accurately reflect trainee performance compared to traditional formats.