Evidence of Construct Validity of Computer-Based Tests for Clinical Reasoning: Instrument Validation Study

Area of Science:

• Medical Education Technology
• Clinical Reasoning Assessment
• Health Professions Education

Background:

• Traditional clinical reasoning (CR) teaching methods have limitations.
• There is a need for innovative technological solutions to enhance CR training for medical students.
• China Medical University developed a computer-based CR training system (CMU-CBCRT).

Purpose of the Study:

• To evaluate the construct validity of the CMU-CBCRT system.
• To determine if the CMU-CBCRT can differentiate clinical reasoning skills across various training levels.

Main Methods:

• 385 medical students from fifth-year undergraduates to postgraduate year 3 participated.
• The known-groups technique was employed to assess construct validity.
• Test scores were compared across four training levels: fifth-year MD, PGY-1, PGY-2, and PGY-3.

Main Results:

• Test scores demonstrated a positive correlation with years of training.
• Significant differences in information collection, diagnosis, treatment, and total scores were observed across training levels.
• No significant differences were found in the assessment of treatment errors.

Conclusions:

• The CMU-CBCRT system provides evidence of construct validity.
• This system can effectively measure the clinical reasoning skills of medical students at various early career stages.