Assessing medical student competency in communication in the pre-clinical phase: objective structured video exam and
Ozlem Surel Karabilgin1, Kevser Vatansever, Suleyman Ayhan Caliskan
1Department of Medical Education, Ege University Faculty of Medicine, Izmir, Turkey. osurelkarabilgin@gmail.com
Objective:
The aim of our study was to present the structure, process and results of the objective structured video exam and One-Station standardized patient exam that have been used to assess second year medical students' communication skills.
Methods:
Scores of 1137 students between the years 2007 and 2010 were analyzed. Means and standard deviations were calculated for scores and ratings. Internal consistency was assessed using Cronbach's alpha coefficient. To analyze reliability and generalizability, multivariate generalizability theory was employed.
Results:
Students' total and item scores on the objective structured video exam (60.5-68.8) were lower than on the One-Station standardized patient exam (90.4-96.6). Internal consistencies of both exams were moderate. Generalizability analysis and D-study results showed that both the objective structured video exam and the One-Station standardized patient exam need improvement.
Conclusion:
Both exams need measures to improve them, such as increasing the number of video cases or stations, and further standardization of raters.
Practice Implications:
This study might encourage medical teachers to consider assessing validity and reliability of written and performance exams on the basis of generalizability theory, and to find out feasible actions to improve assessment procedures by conducting a D-study.
Related Concept Videos
Communication
Role of Communication in the Nursing Process I: Assessment and Diagnosis
The nursing process considers the patient's emotional and physical well-being. The process can be repeated or stopped at any point if judged essential. Assessment is the first step in the nursing process.
Role of Communication in the Nursing Process III: Evaluation and Documentation
Assessment of the Mouth
Mouth Inspection
The inspection begins with visually examining the mouth for symmetry, color, and size.
Assessment of the Cardiovascular System IV: Auscultation
Normal Heart Sounds
S1 (First Heart Sound)-
S1 is made by the closure of the mitral and tricuspid valves (atrioventricular valves), marking the beginning of systole.
S2 (Second Heart Sound)-
S2 is made by the closure of the aortic and pulmonic valves (semilunar valves), marking the end of the systole.
SBAR II: Application of SBAR
SBAR Report from a Nurse to a Health Care Provider
S: "Hello, Dr. Smith. This is Jane, RN, from the Med Surg unit. I am calling to tell you about Ms. White in Room 210, who is experiencing increased pain and redness at her incision site. Her recent...

