使用凯恩的有效性框架来检查基于模拟的评估中反的影响
Kathryn Hodwitz1,2, Sherryn Rambihar3,4, Gillian Nesbitt4,5
1Li Ka Shing Knowledge Institute, St. Michael's Hospital, Unity Health Toronto, Toronto, ON, Canada.
Advances in simulation (London, England)
|October 22, 2025
概括
这项研究使用凯恩框架验证了心声回声学能力评估工具 (ECAT),表明它有效地评估学习并改善了心声回声学模拟中的学员表现.
科学领域:
- 医学教育 医学教育
- 基于模拟的评估.
- 证据的有效性 证据的有效性
背景情况:
- 模拟越来越多地用于程序评估,但有效性证据往往缺乏.
- 凯恩的有效性框架提供了一个结构化的方法来评估评估的有效性.
- 心声回声学能力评估工具 (ECAT) 是为基于模拟的学习而开发的.
研究的目的:
- 将凯恩的有效性框架应用于ECAT.
- 评估ECAT作为学习评估的实用性.
- 专注于ECAT对促进实习生学习的影响.
主要方法:
- 实施了ECAT,有14名心脏病学学员和4名评估员.
- 收集模拟性能数据并进行评估后的采访.
- 使用定向内容和定量分析来生成有效性证据.
主要成果:
- ECAT分数准确地反映了学员的表现,并确定了学习机会.
- 高级互评级可靠性 (ICC = 0.913). 它们具有很高的可靠性.
- ECAT分数与心脏病学考试分数相关,并与诊断质量和经验有积极的关联.
结论:
- 一个有效性论证支持ECAT作为基于模拟的学习评估.
- 结果表明可以优化ECAT的领域.
- 这项研究说明了凯恩为教育工作者使用基于模拟的评估的框架.
更多相关视频
10:39Qualitative and Quantitative Validation of Tools with Rating Scales Aimed at Assessing the Quality of University Service-Learning
Published on: August 29, 2025
1.1K
08:33A Cross-Disciplinary and Multi-Modal Experimental Design for Studying Near-Real-Time Authentic Examination Experiences
Published on: September 4, 2019
7.4K
相关概念视频
Data Validation
6.3K
Data validation is an essential part of a comprehensive assessment. Validation is confirming or verifying and opening the door to gathering more assessment data as it clarifies vague or unclear data. The process of checking and verifying the collected information is called data validation. The primary purpose of data validation is to ensure data is as free from error, bias, and misinterpretation as possible.
Nursing assessment guides are generally based on holistic models rather than medical...
Nursing assessment guides are generally based on holistic models rather than medical...
6.3K
Sources of Self-Esteem II: Performance Feedback
186
Self-esteem is intricately tied to our perception of competence and our ability to exert control over our lives. One of the primary sources of this perception is performance feedback — the ongoing evaluation of our actions in terms of success and failure. According to Franks and Marolla (1976), people derive self-worth from experiencing themselves as causal agents, capable of achieving goals and overcoming obstacles. This process nurtures a critical component of self-esteem:...
186
Theory of Attribution II: Kelley's Covariation Theory
491
Attribution theory plays a crucial role in social psychology, helping to explain how individuals interpret the causes of behavior. One prominent model within this field is Harold Kelley's covariation theory, which provides a systematic approach to determining whether internal traits or external circumstances drive a person's actions. The model posits that individuals rely on three key types of information—consensus, consistency, and distinctiveness—to make these judgments.Consensus:...
491
Reliability and Validity
13.7K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
13.7K
Self-Evaluation Maintenance Model
272
The Self-Evaluation Maintenance (SEM) model offers a psychological framework to understand how individuals’ self-esteem is influenced by the achievements of others, particularly those with whom they share close personal bonds. The SEM model operates when personal rather than social identity guides individuals. Central to this model is the notion that individuals have an inherent desire to preserve a favorable self-image, which is continuously shaped by interpersonal comparisons and...
272
Effects of feedback
991
Feedback in control systems plays a critical role in shaping various operational parameters, extending beyond simple error reduction to influence stability, bandwidth, gain, impedance, and sensitivity. Understanding these effects requires examining a basic feedback system characterized by defined input, output, error, and feedback signals.
Feedback significantly modifies the gain of a control system. The gain of a system without feedback is altered by a factor of one plus GH, where G represents...
Feedback significantly modifies the gain of a control system. The gain of a system without feedback is altered by a factor of one plus GH, where G represents...
991
