Related Experiment Videos
The effect of defined violations of test security on admissions outcomes using multiple mini-interviews
Harold I Reiter1, Penny Salvatori, Jack Rosenfeld
1Dept. of Clinical Epidemiology and Biostatistics, McMaster University, 1200 Main Street West, Hamilton, Ontario L8Z 3N5, Canada.
Introduction:
Heterogeneous results exist regarding the impact of security violations on student performances in objective structured clinical examinations (OSCEs). Three separate studies investigate whether anticipated security violations result in undesirable enhancement of MMI performance ratings.
Methods:
Study 1: low-stakes: MMI station stems provided to a random half of 57 medical school applicants 2 weeks in advance of participation in a research study. Study 2: high-stakes: 384 medical school applicants sat a 12-station MMI to determine admission. Each half received 1 of 2 pilot MMI station stems 2 weeks in advance. Study 3: high-stakes: 38 interviewees with dual applications to occupational therapy and physiotherapy experienced the same 7-station MMI twice on the same date.
Results:
No statistically significant differences in MMI performances were detected.
Conclusions:
Predictable violations of MMI security do not unduly influence applicant performance ratings.
Related Concept Videos
Reliability and Validity
Bonferroni Test
The means of different samples are first paired in all possible combinations.
The null hypothesis of the...
Multiple Comparison Tests
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
Comparing Experimental Results: Student's t-Test
McNemar's Test
Significance Testing: Overview