Rasch analysis of professional behavior in medical education

Area of Science:

• Medical Education Research
• Educational Measurement
• Quantitative Psychology

Background:

• Assessing faculty behavior through student feedback is crucial for medical education improvement.
• Existing qualitative methods for analyzing student comments present challenges in standardization and quantitative analysis.

Purpose of the Study:

• To apply quantitative Rasch measurement to analyze student feedback on faculty behavior.
• To explore the hierarchical structure of student comments across different medical departments.
• To inform the development of novel faculty evaluation instruments.

Main Methods:

• Utilized quantitative Rasch measurement to analyze pre-categorized comments from 385 graduating medical students.
• Examined the number of comments provided by students and their hierarchical arrangement.
• Investigated variations in comment hierarchies across different medical departments and faculty.

Main Results:

• Student comment counts showed minimal variation, forming a probabilistic Rasch hierarchy.
• Significant differences in comment hierarchies were observed between medical departments and faculty.
• Identified specific student-faculty interactions that may elicit or guide student comments.

Conclusions:

• Rasch scaling of student feedback provides valuable quantitative data to complement qualitative approaches in medical education research.
• The findings support the development of robust faculty evaluation instruments based on student comments.
• Understanding departmental variations in feedback hierarchies can refine faculty assessment strategies.