Developing and testing an evaluation tool to measure clinical teaching.

Area of Science:

• Medical Education Research
• Educational Assessment
• Psychometrics

Background:

• Effective feedback is crucial for medical educator development.
• Existing teaching evaluation tools may lack comprehensive validation.
• A need exists for a psychometrically sound clinical teaching evaluation instrument.

Purpose of the Study:

• To develop a novel clinical teaching evaluation tool.
• To rigorously test the validity, reliability, and psychometric properties of the developed tool.

Main Methods:

• Tool development based on literature review and stakeholder input.
• Content validity assessed via stakeholder surveys.
• Construct validity examined using confirmatory factor analysis (LISREL 8.8).
• Reliability evaluated through Cronbach's alpha.
• Item response theory (IRT) analysis (Rasch analysis, Winstep 3.65) for tool fitness.

Main Results:

• The final tool comprises 4 major and 25 minor categories with 43 items.
• High internal consistency (Cronbach's alpha = 0.9689) and item correlations observed.
• 42 out of 43 items demonstrated good fit to the item response theory model.
• Minor modifications suggested for 10 items regarding category placement.

Conclusions:

• The developed clinical teaching evaluation tool is valid, reliable, and IRT-consistent.
• The instrument is suitable for assessing clinical teaching effectiveness.
• This tool can be widely implemented across diverse clinical education environments.