评估临床能力:一个多特征多方法矩阵构造有效性研究
Andrea Vallevand1, David E Manthey2, Kim Askew2
1Wake Forest University School of Medicine, Winston-Salem, USA. avalleva@wakehealth.edu.
Advances in health sciences education : theory and practice
|August 2, 2023
概括
这项研究应用了先进的统计方法来评估医学学生的临床技能. 多特征多方法矩阵分析证明了这些评估的有效性,特别是对专业性的有效性.
科学领域:
- 医学教育 医学教育
- 心理测量 心理测量 心理测量
- 健康 专业 教育 卫生 专业 教育
背景情况:
- 医学教育越来越关注临床能力.
- 可信任的专业活动 (EPA) 为评估临床技能提供了一个框架.
- 目前的临床技能评估方法往往缺乏严格的验证.
研究的目的:
- 调查医学教育中临床技能评估的构造有效性.
- 应用多特律多方法矩阵分析来评估多种评估方法.
- 探索评估关键临床技能的可靠性和有效性.
主要方法:
- 运行了四个特征:专业性,数据收集,数据合成和数据交付.
- 使用三种方法评估特征:直接观察,基于工作场所的评估和客观的结构化临床检查.
- 采用多特征多方法矩阵分析来相互关联特征和方法.
主要成果:
- 在评估方法中,可靠性值从充分到良好不等.
- 大多数有效率系数在统计学上是显著的.
- 专业主义显示出最明显的收和分歧的有效性.
- 观察到一种实质性的方法效应,特别是在基于工作场所的评估中.
结论:
- 多特征多方法矩阵方法是评估医疗教育中临床技能等复杂构造的有价值,未得到充分利用的工具.
- 调查结果可以为教师发展提供信息,以提高临床评估的可靠性和有效性.
- 提高评估有效性对于确保医疗专业人员的临床能力至关重要.
相关概念视频
Multiple Comparison Tests
3.9K
Multiple comparison test, abbreviated as MCT, is a post hoc analysis generally performed after comparing multiple samples with one or more tests. An MCT will help identify a significantly different sample among multiple samples or a factor among multiple factors.
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
3.9K
Reliability and Validity
12.8K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
12.8K
Self-Report Tests of Personality
381
Self-report inventories are objective personality assessments that use multiple-choice items or numbered scales, typically ranging from 1 (strongly disagree) to 5 (strongly agree). They are often called Likert scales after Rensis Likert. These inventories are widely used due to their ease of administration and cost-effectiveness. One of the most prominent examples is the Minnesota Multiphasic Personality Inventory (MMPI), initially developed in the 1940s to assess abnormal personality traits.
381
Measures of Intelligence
7.6K
Psychologists measure intelligence by using standardized tests that produce a score known as the intelligence quotient or IQ. To understand IQ tests, it's important to recognize the key principles behind their construction: validity, reliability, and standardization.
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this;...
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this;...
7.6K
Wechsler's Contribution to Measures of Intelligence
1.5K
David Wechsler, a psychologist who worked with World War I veterans, developed a significant IQ test in 1939 called the Wechsler-Bellevue Intelligence Scale. This test was innovative because it combined several subtests that measured both verbal and nonverbal skills, reflecting Wechsler's belief that intelligence is a global capacity involving purposeful action, rational thinking, and effective interaction with the environment. This test later evolved into the Wechsler Adult Intelligence...
1.5K
Strategies for Assessing and Addressing Confounding
119
Confounding is a critical issue in epidemiological studies, often leading to misleading conclusions about associations between exposures and outcomes. It occurs when the relationship between the exposure and the outcome is mixed with the effects of other factors that influence the outcome. Given that, addressing confounding is of high importance for drawing accurate inferences in research.
Confounding can be addressed at both the design phase of a study and through analytical methods after data...
Confounding can be addressed at both the design phase of a study and through analytical methods after data...
119


