在绩效评估中理解评级者认知:一种混合的IRTree方法
1National Cheng Kung University, Taiwan.
Applied psychological measurement
|April 17, 2025
概括
本研究引入了混合项目响应理论 (IRT) 模型,以区分评估中的专业和初学者评级者. 对评级者类型的核算提高了判断的有效性,并减少了绩效评估中的估计偏差.
科学领域:
- 教育测量教育的测量
- 心理测量 心理测量 心理测量
- 认知心理学 认知心理学
背景情况:
- 在评估中,人类评价者在准确判断评价者能力方面面临挑战.
- 雷特认知研究表明,个人偏好和非个人判断会影响评估的有效性.
- 现有的模型可能无法充分考虑评级者专业知识的异质性.
研究的目的:
- 引入一种新的基于IRTree的混合模型来进行评级者判断 (MIM-R).
- 在评估上下文中区分专业和初学者评级者.
- 提高评级者判断的有效性,减少估计偏差.
主要方法:
- 顺序应用理想点和主导项响应理论 (IRT) 模型.
- 基于IRTree的混合模型 (MIM-R) 的开发,以捕捉评分者的认知.
- 模拟研究来评估模型参数恢复和偏差.
主要成果:
- 在模拟中,MIM-R模型证明了其参数的满意恢复.
- 忽视评级人员的混合性质会导致偏见的估计,特别是在更多的新手评级人员中.
- 该模型成功地根据他们的判断过程识别了专业和初学者评级者.
结论:
- 考虑到评级机构的混合性质对于准确的评估有效性至关重要.
- MIM-R模型提供了一种强大的方法来分析评分者的认知和专业知识.
- 在创造力评估中的实证应用突出了MIM-R模型的实际含义.
相关概念视频
Stereotypes, Prejudice, and Discrimination
89.6K
Humans are very diverse and although we share many similarities, we also have many differences. The social groups we belong to help form our identities (Tajfel, 1974). These differences may be difficult for some people to reconcile, which may lead to prejudice toward people who are different. Prejudice is a negative attitude and feeling toward an individual based solely on one’s membership in a particular social group (Allport, 1954; Brown, 2010). Prejudice is common against people who...
89.6K
Response Surface Methodology
64
Response Surface Methodology (RSM) is a collection of statistical and mathematical techniques used to develop, improve, and optimize processes. It is particularly valuable when many input variables or factors potentially influence a response variable.
The process of RSM involves several key steps:
The process of RSM involves several key steps:
64
Rational Emotive Behavior Therapy
27
Cognitive-behavioral therapies (CBTs) are grounded in the belief that our thoughts profoundly influence our emotions and actions. Advocates of CBT emphasize three core assumptions: first, that cognitions are identifiable and measurable; second, that they are central to psychological functioning; and third, that irrational or maladaptive beliefs can be replaced with rational and adaptive ones. This transformative approach to therapy has paved the way for specific models such as Albert...
27
Triarchic Theory of Intelligence
5.4K
Robert Sternberg's triarchic theory of intelligence posits that intelligence is composed of three distinct but interrelated components: analytical, creative, and practical intelligence.
5.4K


