Related Experiment Video
Updated: Apr 30, 2026

Multimodal Protocol for Assessing Metacognition and Self-Regulation in Adults with Learning Difficulties
Published on: September 27, 2020
An investigation into the use of multi-source feedback (MSF) as a work-based assessment tool
Jeremy M Brown1, Kathryn Lowe, Jill Fillingham
1Edge Hill University , UK .
Introduction:
This study compared Specialist Trainees' (STs) hand-selected multi-source feedback (MSF) scores with those made by their clinical supervisors and explored perceptions of both those being assessed and those assessing.
Methods:
Participating STs were asked to hand a mini-PAT questionnaire to a clinical colleague of their choice and also to their Clinical Supervisor. Statistical analysis was carried out on submitted paired assessments to determine any differences in responses between clinical supervisors and hand-chosen assessors. Semi-structured interviews were held with seven nurses, seven Consultants and six postgraduate doctors.
Results:
Forty pairs of mini-PAT questionnaires were analysed. Hand-chosen assessors' ratings were significantly higher than those for clinical supervisors with respect to: "good clinical care" (p < 0.01), "good medical practice" (p < 0.05), "teaching and training" (p < 0.01), "relationship with patients" (p < 0.05) as well as for overall impression of the trainee (p < 0.05). Five themes were identified from interviews: validity of selecting assessors; anonymity of assessors; usefulness of feedback; the value of multi-professional assessors; and grading.
Discussions:
There is a systematic difference in the assessment scores for trainees in MSF between clinical supervisors and hand-chosen assessors, the former scoring trainees more harshly. Grading was open to interpretation. This raised questions, especially from nurse interviewees regarding appropriate benchmarking.
Related Concept Videos
Sources of Self-Esteem II: Performance Feedback
Negative and Positive Feedback
Self-Evaluation Maintenance Model
Effects of feedback
Feedback significantly modifies the gain of a control system. The gain of a system without feedback is altered by a factor of one plus GH, where G represents...
Feedback Loops
Self-Evaluation: Self-Enhancement and Self-Verification

