基于评估者类型和评估者与学生联系的频率的职务评估可靠性:一个概括性理论分析分析
概括
临床绩效评估 (CPAs) 当由日常与学生接触的住户完成时更可靠. 了解评估者特征可以提高医学教育评估系统的可靠性.
科学领域:
- 医学教育 医学教育
- 评估可靠性评估的可靠性
- 临床绩效评估 临床绩效评估
背景情况:
- 基于工作场所的评估 (WBA),包括临床绩效评估 (CPA),是医疗职员评估系统的关键组成部分.
- 跨职业的CPA可靠性的变化表明需要调查促成因素.
- 评估人员的特点,如学生接触的类型和频率,可能会影响评估可靠性.
研究的目的:
- 探索临床绩效评估 (CPA) 在医疗职员的可靠性.
- 检查评估者特征,特别是评估者类型 (居民与出席) 和评估者与学生联系频率 (每日与非每日) 对CPA可靠性的影响.
主要方法:
- 分析了来自五个职位的三年级医学学生的4062名CPA.
- 概括性分析包括职务人员,评估者类型和联系频率.
- 决策研究以确定可靠性为0.7 (D0.7) 所需的评估数量.
主要成果:
- 住院医生的评估比临床医生的评估更可靠 (φ=0.62) (φ=0.48).
- 那些每天接触的人的评估比那些不经常接触的人 (φ=0.31) 更可靠 (φ=0.63).
- 日常接触居民的可靠性最高 (φ=0.38).
结论:
- 评估者类型和学生接触频率显著影响CPA可靠性.
- 这些因素可以解释评估可靠性的职务间变化.
- 在评估系统设计中优化评估者特征可以提高可靠性和利益相关者的信任.
更多相关视频
09:00Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education
Published on: August 16, 2024
921
08:40Isokinetic Robotic Device to Improve Test-Retest and Inter-Rater Reliability for Stretch Reflex Measurements in Stroke Patients with Spasticity
Published on: June 12, 2019
7.6K
相关概念视频
02:16Surveys
15.4K
Often, psychologists develop surveys as a means of gathering data. Surveys are lists of questions to be answered by research participants, and can be delivered as paper-and-pencil questionnaires, administered electronically, or conducted verbally. Generally, the survey itself can be completed in a short time, and the ease of administering a survey makes it easy to collect data from a large number of people.
15.4K
01:29Reliability and Validity
13.2K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
13.2K
02:13The Representativeness Heuristic
16.2K
The representative heuristic describes a biased way of thinking, in which you unintentionally stereotype someone or something. For example, you may assume that your professors spend their free time reading books and engaging in intellectual conversation, because the idea of them spending their time playing volleyball or visiting an amusement park does not fit in with your stereotypes of professors.
16.2K
01:22Case Studies
12.1K
There are many research methods available to psychologists in their efforts to understand, describe, and explain behavior and the cognitive and biological processes that underlie it.
12.1K
02:30Naturalistic Observations
16.0K
If you want to understand how behavior occurs, one of the best ways to gain information is to simply observe the behavior in its natural context. However, people might change their behavior in unexpected ways if they know they are being observed. How do researchers obtain accurate information when people tend to hide their natural behavior? As an example, imagine that your professor asks everyone in your class to raise their hand if they always wash their hands after using the restroom. Chances...
16.0K
02:20Correlations
34.0K
Correlation means that there is a relationship between two or more variables (such as ice cream consumption and crime), but this relationship does not necessarily imply cause and effect. When two variables are correlated, it simply means that as one variable changes, so does the other. We can measure correlation by calculating a statistic known as a correlation coefficient. A correlation coefficient is a number from -1 to +1 that indicates the strength and direction of the relationship between...
34.0K