导师的相互评分可靠性 行为互动表格
B Tigges1, O Myers1, N Mickel1
1University of New Mexico Health Sciences Center, University of Oklahoma Health Sciences Center, University of New Mexico, Arizona State University.
The chronicle of mentoring & coaching
|January 8, 2024
概括
导师行为互动 (MBI) 标题显示,在学术环境中评估导师技能时,评级者之间的可靠性很好或很好. 这种观察工具可以通过互动的视频分析来评估导师培训的有效性.
科学领域:
- 医学教育 医学教育
- 心理学 心理学 心理学
- 社会科学 社会科学 社会科学
背景情况:
- 对导师行为技能的客观评估对于在学术环境中评估导师培训干预措施至关重要.
- 导师行为互动 (MBI) 标签是一个新的,内容有效的观察测量在单个导师-mentee互动期间的导师行为技能.
研究的目的:
- 评估MBI Rubric在视频录制的导师与导师的互动中应用时的评价者间可靠性 (IRR).
主要方法:
- 三位专家评价者同步评估了26个视频录制的导师与受训者的互动,使用MBI Rubric.
- 该MBI标题包括六个缩放项目 (第1部分) 和十个是/否项目 (第2部分).
- 评级人员在初始个人评分后,通过协商一致或多数投票解决分歧.
主要成果:
- 评价者之间的可靠性从好 (第1部分IRR=0.67) 到优秀 (第2部分IRR=0.83).
- 在初始得分 (第1部分) 中观察到拉特效应,但在第2部分没有.
- 评级人员的最终分数高于他们对两个部分的初始个人分数.
结论:
- MBI Rubric 证明了在单个交互中评估导师行为技能时的内容有效性和评级者之间的可靠性.
- 它可以与其他工具一起使用,以衡量导师培训的有效性.
- 限制包括潜在的上限效应和资源密集型管理;未来的研究将探索响应性和构建有效性.
更多相关视频
08:59The Other End of the Leash: An Experimental Test to Analyze How Owners Interact with Their Pet Dogs
Published on: October 13, 2017
17.7K
08:40Isokinetic Robotic Device to Improve Test-Retest and Inter-Rater Reliability for Stretch Reflex Measurements in Stroke Patients with Spasticity
Published on: June 12, 2019
7.5K
相关概念视频
01:29Reliability and Validity
12.7K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
12.7K
04:49Robbers Cave
14.3K
During the 1950s, the landmark Robbers Cave experiment demonstrated that when groups must compete with one another, intergroup conflict, hostility, and even violence may result. At the Oklahoman summer camp, two troops of boys—termed the Rattlers and the Eagles—took part in a week-long tournament. During this time, their negativity culminated in derogatory name-calling, fistfights, and even vandalism and destruction of property. However, this work also revealed that such tension...
14.3K
02:16Stereotype Content Model
14.7K
The Stereotype Content Model (SCM) was first proposed by Susan Fiske and her colleagues (Fiske, Cuddy, Glick & Xu, 2002; see also Fiske, 2012 and Fiske, 2017). The SCM specifies that when someone encounters a new group, they will stereotype them based on two metrics: warmth—or that group’s perceived intent, and how likely they are to provide help or inflict harm—and competence—or their ability to carry out that objective. Depending on the warmth-competence...
14.7K
01:22Self-Report Tests of Personality
353
Self-report inventories are objective personality assessments that use multiple-choice items or numbered scales, typically ranging from 1 (strongly disagree) to 5 (strongly agree). They are often called Likert scales after Rensis Likert. These inventories are widely used due to their ease of administration and cost-effectiveness. One of the most prominent examples is the Minnesota Multiphasic Personality Inventory (MMPI), initially developed in the 1940s to assess abnormal personality traits.
353
01:20Kendall's Coefficient of Concordance
340
Kendall's Coefficient of Concordance (W), also known as Kendall's W, is a non-parametric statistical measure used to assess the agreement or concordance between multiple raters or judges when they rank a set of items. It is often used when you have ordinal data (ranks) and you want to see if there is consistency or consensus among the raters. It is widely applied in research areas such as psychology, medicine, and social sciences, where multiple judges are asked to rank or rate subjects...
340
02:30Naturalistic Observations
15.4K
If you want to understand how behavior occurs, one of the best ways to gain information is to simply observe the behavior in its natural context. However, people might change their behavior in unexpected ways if they know they are being observed. How do researchers obtain accurate information when people tend to hide their natural behavior? As an example, imagine that your professor asks everyone in your class to raise their hand if they always wash their hands after using the restroom. Chances...
15.4K