Related Experiment Video
Updated: May 10, 2026
12:55
Multimodal Protocol for Assessing Metacognition and Self-Regulation in Adults with Learning Difficulties
Published on: September 27, 2020
Multisource feedback: can it meet criteria for good assessment?
1Departmentof Community Health Sciences, Faculty of Medicine, University of Calgary, Canada T2N 4Z6. lockyer@ucalgary.ca
Summary
Multisource feedback (MSF) instruments assessing physicians were evaluated using 7 criteria. While validity, reproducibility, and feasibility were emphasized, educational effects require further study for improved medical education assessment.
Area of Science:
- Medical Education
- Physician Assessment
- Quality Improvement
Background:
- High-quality instruments are essential for physician assessment and feedback.
- Multisource feedback (MSF) utilizes data from colleagues, coworkers, and patients.
- MSF provides feedback on communication, collaboration, professionalism, and interpersonal skills.
Purpose of the Study:
- To apply 7 assessment criteria as a framework to examine the quality of MSF instruments.
- To evaluate the rigor of existing MSF tools used for practicing physicians.
Main Methods:
- Examined 3 sets of MSF instruments using 7 assessment criteria: validity, reproducibility, equivalence, feasibility, educational effect, catalytic effect, and acceptability.
- Drew upon published data for the assessment.
Main Results:
- Three MSF instruments (Canadian Physician Achievement Review, UK GMC, CFEP360) were assessed.
- Evidence supported assessment against all criteria except educational effects, with variable emphasis.
- Validity, reproducibility, and feasibility received the most attention; catalytic effect and educational effects were less examined.
Conclusions:
- The 7 criteria offer a valuable framework for assessing MSF instrument quality.
- This framework aids in identifying gaps in instrument assessment.
- The criteria can be applied to evaluate other medical education instruments.
Related Concept Videos
01:29Nursing Assessment
The two sources for collecting information are primary and secondary. After gathering information, interpretation and validation help to complete the data. The purpose of assessment is to establish data with the initial information, to interpret data about the patient's perceived needs and health problems, and to respond to these problems identified.
The nurse collects all aspects of the patient's health in the initial assessment, establishing priorities for ongoing focused assessments and...
The nurse collects all aspects of the patient's health in the initial assessment, establishing priorities for ongoing focused assessments and...
02:16Surveys
Often, psychologists develop surveys as a means of gathering data. Surveys are lists of questions to be answered by research participants, and can be delivered as paper-and-pencil questionnaires, administered electronically, or conducted verbally. Generally, the survey itself can be completed in a short time, and the ease of administering a survey makes it easy to collect data from a large number of people.
01:24Sources of Self-Esteem II: Performance Feedback
Self-esteem is intricately tied to our perception of competence and our ability to exert control over our lives. One of the primary sources of this perception is performance feedback — the ongoing evaluation of our actions in terms of success and failure. According to Franks and Marolla (1976), people derive self-worth from experiencing themselves as causal agents, capable of achieving goals and overcoming obstacles. This process nurtures a critical component of self-esteem: self-efficacy,...
01:30Social Foundations of Self III: Self-Evaluation
Self-evaluation is the process by which individuals assess their abilities, behaviors, and characteristics based on feedback from others. Charles H. Cooley observed that a person’s self-perception is primarily influenced by how others see and judge them. He suggested that individuals form their identities based on their interpretations of others' reactions. As a result, social interactions play a crucial role in shaping self-esteem and personal identity. These external evaluations often blend...
01:24Strategies of Self-Presentation III: Self-Monitoring
Self-monitoring is a central construct in understanding individual differences in self-presentation strategies across social contexts. It refers to how individuals observe, regulate, and control their expressive behavior and self-presentation following situational cues. Self-monitoring reflects a person's sensitivity to social appropriateness and willingness to adapt behavior to fit varying interpersonal demands.High vs. Low Self-Monitoring IndividualsIndividuals high in self-monitoring are...
01:29Self-Evaluation Maintenance Model
The Self-Evaluation Maintenance (SEM) model offers a psychological framework to understand how individuals’ self-esteem is influenced by the achievements of others, particularly those with whom they share close personal bonds. The SEM model operates when personal rather than social identity guides individuals. Central to this model is the notion that individuals have an inherent desire to preserve a favorable self-image, which is continuously shaped by interpersonal comparisons and...