调整后的剩余值用于评估多阶段自适应测试的IRT模型中的条件独立性
Peter W van Rijn1, Usama S Ali2,3, Hyo Jeong Shin4
1ETS Global, Amsterdam, The Netherlands. pvanrijn@etsglobal.org.
Psychometrika
|November 6, 2023
概括
多阶段适应性测试 (MST) 数据由于路由而违反物品响应理论 (IRT) 假设. 为了在MST中准确的统计推断,需要调整的余量,正如PISA数据分析所显示的那样.
科学领域:
- 统计 统计 统计 统计
- 心理测量 心理测量 心理测量
- 教育测量教育的测量
背景情况:
- 项目响应理论 (IRT) 模型假设项目响应的条件独立性给定潜能.
- 多阶段适应性测试 (MST) 设计涉及路由决策,可能违反这一核心IRT假设.
- 这种违规行为引入了数据中的依赖性,影响了统计推理.
研究的目的:
- 调查MST中的路由对IRT模型条件独立性假设的影响.
- 评估一般化残留物对于分析MST数据的适当性.
- 建议和验证对MST数据的统计方法的调整.
主要方法:
- 通过使用逻辑线性模型的概念,研究了MST路由和数据模式之间的关系.
- 评估了一般化残余值在IRT.中对项目对频率的适用性.
- 通过模拟和真实数据分析,开发并测试针对特定MST设计的调整后残留物.
主要成果:
- 没有修改的MST数据不适合标准通用残留值.
- 对残余的调整是必要的,并且取决于MST路由的复杂性.
- 调整后的剩余值在模拟和真实数据应用中显示出令人满意的I型错误率.
结论:
- 在IRT中,有条件的独立性假设受到MST路由的挑战.
- 调整后的剩余值对于MST中有效的统计推理至关重要.
- 这些发现对解释像PISA这样的大规模评估的结果有影响.
相关概念视频
Introduction to Test of Independence
2.3K
In statistics, the term independence means that one can directly obtain the probability of any event involving both variables by multiplying their individual probabilities. Tests of independence are chi-square tests involving the use of a contingency table of observed (data) values.
The test statistic for a test of independence is similar to that of a goodness-of-fit test:
The test statistic for a test of independence is similar to that of a goodness-of-fit test:
2.3K
Assumptions of Survival Analysis
136
Survival models analyze the time until one or more events occur, such as death in biological organisms or failure in mechanical systems. These models are widely used across fields like medicine, biology, engineering, and public health to study time-to-event phenomena. To ensure accurate results, survival analysis relies on key assumptions and careful study design.
136
Friedman Two-way Analysis of Variance by Ranks
207
Friedman's Two-Way Analysis of Variance by Ranks is a nonparametric test designed to identify differences across multiple test attempts when traditional assumptions of normality and equal variances do not apply. Unlike conventional ANOVA, which requires normally distributed data with equal variances, Friedman's test is ideal for ordinal or non-normally distributed data, making it particularly useful for analyzing dependent samples, such as matched subjects over time or repeated measures...
207
Comparing the Survival Analysis of Two or More Groups
200
Survival analysis is a cornerstone of medical research, used to evaluate the time until an event of interest occurs, such as death, disease recurrence, or recovery. Unlike standard statistical methods, survival analysis is particularly adept at handling censored data—instances where the event has not occurred for some participants by the end of the study or remains unobserved. To address these unique challenges, specialized techniques like the Kaplan-Meier estimator, log-rank test, and...
200
Expected Frequencies in Goodness-of-Fit Tests
2.5K
A goodness-of-fit test is conducted to determine whether the observed frequency values are statistically similar to the frequencies expected for the dataset. Suppose the expected frequencies for a dataset are equal such as when predicting the frequency of any number appearing when casting a die. In that case, the expected frequency is the ratio of the total number of observations (n) to the number of categories (k).
2.5K
Hypothesis Test for Test of Independence
3.6K
The test of independence is a chi-square-based test used to determine whether two variables or factors are independent or dependent. This hypothesis test is used to examine the independence of the variables. One can construct two qualitative survey questions or experiments based on the variables in a contingency table. The goal is to see if the two variables are unrelated (independent) or related (dependent). The null and alternative hypotheses for this test are:
H0: The two variables (factors)...
H0: The two variables (factors)...
3.6K


