Related Experiment Video
Updated: Jun 30, 2026
08:16
Movement Retraining using Real-time Feedback of Performance
Published on: January 17, 2013
Changes in performance: a 5-year longitudinal study of participants in a multi-source feedback programme.
Claudio Violato1, Jocelyn M Lockyer, Herta Fidler
1Department of Community Health Sciences, University of Calgary, Calgary, Alberta, Canada.
Medical Education
|October 1, 2008
Summary
Multi-source feedback (MSF) instruments are valid and stable for assessing doctor performance. While performance changes are observed over time, particularly from colleagues, the overall effect size is small to moderate.
Area of Science:
- Medical Education
- Healthcare Professional Assessment
- General Practice Research
Background:
- Multi-source feedback (MSF) provides performance data from patients, co-workers, and medical colleagues.
- Validating MSF instruments is crucial for accurate physician performance evaluation in general practice.
Purpose of the Study:
- To examine the evidence for the validity of MSF instruments in general practice.
- To investigate performance changes in doctors assessed two times, five years apart.
- To determine associations between performance changes and initial assessments/socio-demographic factors.
Main Methods:
- Data collected from 250 doctors, including three datasets per doctor (25 patients, 8 co-workers, 8 medical colleagues) on two occasions.
- Statistical analyses included internal consistency, generalizability coefficients, confirmatory factor analyses, paired t-tests, and multiple linear regressions.
Main Results:
- High internal consistency (alpha > 0.90) and adequate generalizability (Ep(2) > 0.70) were found.
- Confirmatory factor analyses supported the validity of expected factors.
- Significant performance changes were noted between assessments from medical colleagues and co-workers, but not patients. Professionalism was a key predictor.
Conclusions:
- Evidence supports the construct validity and temporal stability of MSF instruments.
- Performance improvements are expected over time, with small to moderate effect sizes.
Related Concept Videos
01:24Sources of Self-Esteem II: Performance Feedback
Self-esteem is intricately tied to our perception of competence and our ability to exert control over our lives. One of the primary sources of this perception is performance feedback — the ongoing evaluation of our actions in terms of success and failure. According to Franks and Marolla (1976), people derive self-worth from experiencing themselves as causal agents, capable of achieving goals and overcoming obstacles. This process nurtures a critical component of self-esteem: self-efficacy,...
02:20Longitudinal Research
Sometimes we want to see how people change over time, as in studies of human development and lifespan. When we test the same group of individuals repeatedly over an extended period of time, we are conducting longitudinal research. Longitudinal research is a research design in which data-gathering is administered repeatedly over an extended period of time. For example, we may survey a group of individuals about their dietary habits at age 20, retest them a decade later at age 30, and then again...
01:18Negative and Positive Feedback
Animal organs and organ systems constantly adjust to internal and external changes through a process called homeostasis ("steady state"). Examples of these changes include regulation of the level of glucose or calcium in the blood or internal responses to external temperatures. Homeostasis requires maintaining an internal dynamic equilibrium:
01:24Effects of feedback
Feedback in control systems plays a critical role in shaping various operational parameters, extending beyond simple error reduction to influence stability, bandwidth, gain, impedance, and sensitivity. Understanding these effects requires examining a basic feedback system characterized by defined input, output, error, and feedback signals.
Feedback significantly modifies the gain of a control system. The gain of a system without feedback is altered by a factor of one plus GH, where G represents...
Feedback significantly modifies the gain of a control system. The gain of a system without feedback is altered by a factor of one plus GH, where G represents...
01:29Self-Evaluation Maintenance Model
The Self-Evaluation Maintenance (SEM) model offers a psychological framework to understand how individuals’ self-esteem is influenced by the achievements of others, particularly those with whom they share close personal bonds. The SEM model operates when personal rather than social identity guides individuals. Central to this model is the notion that individuals have an inherent desire to preserve a favorable self-image, which is continuously shaped by interpersonal comparisons and...
01:26Longitudinal Studies
Longitudinal studies are also widely used in other medical and social science fields. For instance, in cardiovascular research, they can monitor patients' health over decades to identify risk factors for heart disease, such as high cholesterol or smoking, and evaluate the long-term effectiveness of preventive measures. Similarly, in mental health studies, researchers might follow individuals from adolescence into adulthood to understand the development and progression of conditions like...