Using an objective structured clinical examination to evaluate competency in sport medicine

This article discusses the development, format, administration and scoring of the objective structured clinical examination (OSCE) to evaluate competency in sport medicine. The credentials committee of the Canadian Academy of Sport Medicine has developed an examination to evaluate the competency of practicing physicians in the field of sport medicine. The examination is based on a sport medicine matrix that includes five areas: (a) clinical patient care, (b) team and event coverage, (c) medical/legal issues, (d) teaching and administration, and (e) research. The emphasis is on clinical patient care followed by team and event coverage, with the other three areas having a lesser degree of importance. The OSCE format consists of a number of stations or scenarios based on this matrix. The candidates are evaluated on a check list that reflects the emphasis of each station. A typical clinical patient care problem includes check list items related to the history, physical examination, investigations, diagnosis, and treatment. The candidates are also evaluated for their attitudes and techniques on each station. The examination includes volunteer examiners and patients both simulated and real. The candidates are evaluated through the use of checklists that are filled in by the examiners on optical scoring sheets. These are collated and analyzed to generate comparisons between candidates and to determine the psychometric properties of the overall examination. The examination has consistently scored reliability coefficients of 0.8 or greater. The 1993 examination demonstrated reliability coefficients of 0.89-0.97. Interrater reliability was also calculated, and these values ranged from 0.85 to 0.99. The examination also reflects both face and content validity.(ABSTRACT TRUNCATED AT 250 WORDS)