通过项目响应理论建模来增强内容有效性评估
Rodrigo Schames Kreitchmann1, Pablo Nájera2, Susana Sanz2
1Universidad Nacional de Educación a Distancia (Spain).
Psicothema
|April 25, 2024
概括
项目响应理论 (IRT) 通过提高项目相关性和预测因素负载来增强主题专家 (SME) 的评估. 与传统指数相比,这种方法提供了优越的有效性证据.
科学领域:
- 心理测量 心理测量 心理测量
- 教育测量教育的测量
- 评估的有效性 评估的有效性
背景情况:
- 确保评估的有效性依赖于严格的测试内容评估.
- 主题专家 (中小企业) 通常会评估项目相关性,代表性和适当性.
- 本研究介绍了小企业模型评估的项目响应理论 (IRT).
研究的目的:
- 将IRT纳入中小企业评估,以评估项目相关性和中小企业业绩.
- 为了比较基于IRT的有效性与传统的指数,如内容有效性指数和艾肯的V.
- 评估中小企业在识别特征特定项目和预测因子负载方面的准确性.
主要方法:
- 项目响应理论 (IRT) 应用于模拟中小企业评估.
- 估计了IRT衍生的中小企业参数 (歧视,门).
- 将IRT分数与内容有效性指数和预测准确性的艾肯V进行了比较.
主要成果:
- IRT得分准确地确定了认真度项目 (R2 = 0.57) 和预测的因子负载 (R2 = 0.45).
- IRT显示了增量有效性,解释了比传统指数多11-17%的差异.
- 在项目评估中,IRT有效地检测到中小企业的低于最佳的业绩.
结论:
- 使用IRT对中小企业评估进行建模,可以提高项目与预期结构的对齐.
- IRT可以更好地预测因子负载,加强内容有效性.
- 这种方法有助于开发更有效的测量仪器.
相关概念视频
Response Surface Methodology
127
Response Surface Methodology (RSM) is a collection of statistical and mathematical techniques used to develop, improve, and optimize processes. It is particularly valuable when many input variables or factors potentially influence a response variable.
The process of RSM involves several key steps:
The process of RSM involves several key steps:
127
Modeling in Therapy
71
Modeling, a key technique in therapy, uses observational learning to help clients acquire and practice new skills by watching therapists demonstrate desired behaviors. This approach, rooted in Albert Bandura's concept of vicarious learning, plays a significant role in therapeutic interventions for various psychological conditions, including social anxiety, ADHD, and depression.
Participant Modeling
Participant modeling involves therapists demonstrating calm and effective behaviors in...
Participant Modeling
Participant modeling involves therapists demonstrating calm and effective behaviors in...
71
Reliability and Validity
12.7K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
12.7K
Dose-Response Relationship: Overview
3.1K
Agonists can bind with and activate receptors, resulting in the formation of drug-receptor complexes. Once formed, these complexes catalyze many biochemical processes at the cellular level and subsequently induce a pharmacologic response. The degree of response is directly proportional to the fraction of activated receptors, which in turn, depends on the concentration of the drug at the receptor site as well as the sensitivity of the receptor. An increase in the administered dose contributes to...
3.1K
Goodness-of-Fit Test
3.3K
The goodness-of-fit test is a type of hypothesis test which determines whether the data "fits" a particular distribution. For example, one may suspect that some anonymous data may fit a binomial distribution. A chi-square test (meaning the distribution for the hypothesis test is chi-square) can be used to determine if there is a fit. The null and alternative hypotheses may be written in sentences or stated as equations or inequalities. The test statistic for a goodness-of-fit test is given as...
3.3K
Self-Evaluation: Self-Enhancement and Self-Verification
5.2K
Social psychologists have documented that feeling good about ourselves and maintaining positive self-esteem is a powerful motivator of human behavior (Tavris & Aronson, 2008). In the United States, members of the predominant culture typically think very highly of themselves and view themselves as good people who are above average on many desirable traits (Ehrlinger, Gilovich, & Ross, 2005). Often, our behavior, attitudes, and beliefs are affected when we experience a threat to our...
5.2K


