Validation of Multisource Feedback in Assessing Medical Performance: A Systematic Review

Area of Science:

• Medical Education
• Healthcare Quality Improvement
• Psychometrics

Background:

• Multisource feedback (MSF) is increasingly used for medical practice assessment.
• Systematic reviews have evaluated MSF validity over the past decade.
• A holistic overview of MSF validity evidence is needed.

Purpose of the Study:

• To synthesize findings from existing systematic reviews on MSF validity.
• To provide a comprehensive assessment of the evidence base for MSF in medical practice.

Main Methods:

• Systematic search for reviews evaluating MSF validity (Jan 2006-Oct 2016).
• Identified eight relevant systematic reviews.
• Appraised validity evidence using the American Psychological Association's framework.

Main Results:

• All eight reviews found evidence for MSF validity in at least one domain.
• Evidence for internal structure and relationship to other variables is strong.
• Limited evidence exists for content, consequential, and response process validity.

Conclusions:

• MSF demonstrates established validity in several domains for medical performance assessment.
• Variability in the quality and quantity of evidence necessitates further research.
• Future research should focus on improving MSF tool design, delivery, and impact on practice for enhanced patient care.