Related Experiment Video
Updated: Jun 10, 2026

Multimodal Protocol for Assessing Metacognition and Self-Regulation in Adults with Learning Difficulties
Published on: September 27, 2020
Multi-rater feedback with gap analysis: an innovative means to assess communication skill and self-insight
Aaron W Calhoun1, Elizabeth A Rider, Eleanor Peterson
1Division of Critical Care Medicine, University of Louisville, Louisville, KY 40202, USA. aaron.calhoun@lousville.edu
Objective:
Multi-rater assessment with gap analysis is a powerful method for assessing communication skills and self-insight, and enhancing self-reflection. We demonstrate the use of this methodology.
Methods:
The Program for the Approach to Complex Encounters (PACE) is an interdisciplinary simulation-based communication skills program. Encounters are assessed using an expanded Kalamazoo Consensus Statement Essential Elements Checklist adapted for multi-rater feedback and gap analysis. Data from a representative conversation were analyzed.
Results:
Likert and forced-choice data with gap analysis are used to assess performance. Participants were strong in Demonstrating Empathy and Providing Closure, and needed to improve Relationship Building, Gathering Information, and understanding the Patient's/Family's Perspective. Participants under-appraised their abilities in Relationship Building, Providing Closure, and Demonstrating Empathy, as well as their overall performance. The conversion of these results into verbal feedback is discussed.
Conclusions:
We describe an evaluation methodology using multi-rater assessment with gap analysis to assess communication skills and self-insight. This methodology enables faculty to identify undervalued skills and perceptual blind spots, provide comprehensive, data driven, feedback, and encourage reflection.
Practice Implications:
Implementation of graphical feedback forms coupled with one-on-one discussion using the above methodology has the potential to enhance trainee self-awareness and reflection, improving the impact of educational programs.
Related Concept Videos
Sources of Self-Esteem II: Performance Feedback
Introspection
Self-Evaluation: Self-Enhancement and Self-Verification
Self-Evaluation Maintenance Model
Social Foundations of Self III: Self-Evaluation
Self-Presentation: Self-Monitoring and Self-Handicapping