Related Experiment Videos
Validity of objective tests towards peer-rated competence by students
Rob Dijcks1, Katinka J A H Prince, Cees P M van der Vleuten
1Faculty of Medicine, Maastricht University, The Netherlands.
Medical Teacher
|July 26, 2003
Summary
Written tests effectively predict student performance, while OSCEs moderately predict future physician competence. This study validates objective assessment methods in medical education.
Area of Science:
- Medical Education
- Assessment in Health Professions Education
- Student Competency Evaluation
Background:
- Assessing medical student competence requires reliable and valid methods.
- Longitudinal progress tests, block tests, and Objective Structured Clinical Examinations (OSCEs) are common assessment tools.
- Understanding the predictive validity of these assessments for different competency aspects is crucial.
Purpose of the Study:
- To evaluate the predictive value of written progress tests, block tests, and OSCEs.
- To determine how well these assessments predict peer-rated functioning as a student.
- To assess their ability to predict peer-rated functioning as a future physician.
Main Methods:
- Correlational analysis and discriminant analysis were employed.
- Peer ratings of student competence (functioning as a student and future physician) were collected.
- Past performance data from progress tests, block tests, and OSCEs were analyzed.
Main Results:
- Written tests demonstrated strong predictive accuracy for functioning as a student.
- OSCEs showed moderate predictive accuracy for functioning as a future physician.
- Intercorrelations between assessment methods supported the construct validity of the objective tests.
Conclusions:
- Written assessments are valuable for evaluating current student performance.
- OSCEs offer insights into future physician capabilities.
- Objective testing methods possess construct validity for medical student assessment.