Related Experiment Video
Updated: Oct 2, 2025
10:32
Development of a Virtual Reality Assessment of Everyday Living Skills
Published on: April 23, 2014
18.6K
Development of and Preliminary Validity Evidence for the EFeCT Feedback Scoring Tool
Shelley Ross1, Deena Hamza2, Rosslynn Zulla3
1is Professor, Department of Family Medicine, University of Alberta, Edmonton, AB, Canada.
Journal of Graduate Medical Education
|February 28, 2022
Summary
A new tool, the Evaluation of Feedback Captured Tool (EFeCT), reliably assesses the quality of narrative feedback. This tool is designed for use by clinical educators and non-experts, ensuring consistent scoring across different expertise levels.
Area of Science:
- Medical Education
- Assessment and Evaluation
Background:
- High-quality narrative feedback is crucial for learning and summative decision-making in medical education.
- Current methods for evaluating feedback quality are time-consuming and require expert judgment.
- There is a need for a validated tool to assess documented feedback quality efficiently.
Purpose of the Study:
- To develop and validate an evidence-based tool for evaluating the quality of documented narrative feedback.
- To create a scoring tool usable by both clinical educators and non-expert personnel.
- To ensure reliable and consistent assessment of feedback quality.
Main Methods:
- A literature review identified key elements of high-quality feedback.
- An expert consensus panel developed the scoring tool based on identified elements.
- Messick's construct validity framework guided the evidence collection during development and piloting (2013-2020).
Main Results:
- The Evaluation of Feedback Captured Tool (EFeCT) comprises 5 essential categories for high-quality feedback.
- Preliminary evidence supports the content, substantive, and consequential validity of EFeCT.
- Generalizability evidence demonstrated consistent interrater reliability (ICC range: 0.89-0.94) across multiple sessions and rater expertise levels.
Conclusions:
- The EFeCT shows preliminary validity as a tool for scoring documented feedback quality on assessment forms.
- Generalizability evidence indicates that EFeCT scores are comparable across raters irrespective of their expertise level.
- The EFeCT facilitates objective and reliable evaluation of narrative feedback.
More Related Videos
09:00Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education
Published on: August 16, 2024
939
09:16Use of a Video Scoring Anchor for Rapid Serial Assessment of Social Communication in Toddlers
Published on: March 14, 2018
10.4K
Related Concept Videos
01:24Sources of Self-Esteem II: Performance Feedback
9
Self-esteem is intricately tied to our perception of competence and our ability to exert control over our lives. One of the primary sources of this perception is performance feedback — the ongoing evaluation of our actions in terms of success and failure. According to Franks and Marolla (1976), people derive self-worth from experiencing themselves as causal agents, capable of achieving goals and overcoming obstacles. This process nurtures a critical component of self-esteem:...
9
01:29Self-Evaluation Maintenance Model
18
The Self-Evaluation Maintenance (SEM) model offers a psychological framework to understand how individuals’ self-esteem is influenced by the achievements of others, particularly those with whom they share close personal bonds. The SEM model operates when personal rather than social identity guides individuals. Central to this model is the notion that individuals have an inherent desire to preserve a favorable self-image, which is continuously shaped by interpersonal comparisons and...
18
01:24Effects of feedback
731
Feedback in control systems plays a critical role in shaping various operational parameters, extending beyond simple error reduction to influence stability, bandwidth, gain, impedance, and sensitivity. Understanding these effects requires examining a basic feedback system characterized by defined input, output, error, and feedback signals.
Feedback significantly modifies the gain of a control system. The gain of a system without feedback is altered by a factor of one plus GH, where G represents...
Feedback significantly modifies the gain of a control system. The gain of a system without feedback is altered by a factor of one plus GH, where G represents...
731
01:29Reliability and Validity
13.3K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
13.3K
03:00Self-Evaluation: Self-Enhancement and Self-Verification
5.5K
Social psychologists have documented that feeling good about ourselves and maintaining positive self-esteem is a powerful motivator of human behavior (Tavris & Aronson, 2008). In the United States, members of the predominant culture typically think very highly of themselves and view themselves as good people who are above average on many desirable traits (Ehrlinger, Gilovich, & Ross, 2005). Often, our behavior, attitudes, and beliefs are affected when we experience a threat to our...
5.5K
01:09Comparing Experimental Results: Student's t-Test
2.5K
The t-test is a statistical method used to compare the sample mean with a population mean or compare two means from two data sets. The test statistic is calculated from the standard deviation, mean, and number of measurements in the data set at a selected confidence interval and then compared to a table of critical values at this confidence level. If the test statistic is smaller than the critical value, the null hypothesis is accepted. In this case, we state that the difference between the...
2.5K