使用通用后勤回归方法来检测在认知诊断测试中的多组功能差异物品
Xiaojian Sun1,2, Shimeng Wang3, Lei Guo4
1School of Mathematics and Statistics, Southwest University, Chongqing, China.
Applied psychological measurement
|June 7, 2023
概括
不同的项目功能 (DIF) 损害了测试有效性. 本研究引入了通用后勤回归 (GLR) 方法来检测认知诊断评估中的多个组中的DIF,优于传统方法.
科学领域:
- 心理测量 心理测量 心理测量
- 教育测量教育的测量
- 认知诊断评估 (CDA) 是一种认知诊断评估.
背景情况:
- 不同项目功能 (DIF) 可以破坏评估的有效性和公平性.
- 现有的DIF检测方法主要集中在两组比较上,限制了它们在复杂的多组场景中的应用.
- 在多个组的认知诊断评估 (CDA) 中检测DIF仍然是一个研究不足的领域.
研究的目的:
- 研究通用后勤回归 (GLR) 方法在多组CDA设置中检测DIF的有效性.
- 为了比较基于GLR的沃尔德测试 (GLR-Wald) 和基于GLR的概率比测试 (GLR-LRT) 与普通的沃尔德测试的性能.
- 评估使用估计属性配置文件作为基于GLR的DIF检测中的匹配标准的影响.
主要方法:
- 使用通用后勤回归 (GLR) 来检测DIF项目.
- 在GLR框架内使用估计属性配置文件作为匹配标准.
- 进行了模拟研究,比较GLR-Wald,GLR-LRT和普通的Wald测试,并补充了真实数据分析.
主要成果:
- 在大多数模拟条件下,GLR-Wald和GLR-LRT都显示出与普通Wald测试相比,对I型错误率有更好的控制.
- GLR方法产生了更高的经验拒绝率,表明在检测DIF项目的能力比普通的沃尔德测试更大.
- 使用估计属性配置文件作为匹配标准,导致GLR-Wald和GLR-LRT的类型I错误率和经验拒绝率相似.
结论:
- GLR方法,特别是估计的属性配置文件,提供了一个强大的方法来检测多组CDA中的DIF.
- 基于GLR的测试 (Wald和LRT) 与多组环境中的普通Wald测试相比,为DIF检测提供了更好的准确性和功率.
- 这些发现支持GLR方法的应用,以提高多种群体认知诊断评估的有效性和公平性.
更多相关视频
相关概念视频
Test for Homogeneity
2.0K
The goodness–of–fit test can be used to decide whether a population fits a given distribution, but it will not suffice to decide whether two populations follow the same unknown distribution. A different test, called the test for homogeneity, can be used to conclude whether two populations have the same distribution. To calculate the test statistic for a test for homogeneity, follow the same procedure as with the test of independence. The hypotheses for the test for homogeneity can...
2.0K
Cochran's Q Test
437
Cochran's Q Test is a nonparametric statistical test used to determine if there are potential differences in the outcomes of three or more related groups on a binary (yes/no) or dichotomous outcome. It is essentially an extension of the McNemar Test, which is limited to two related samples - Cochran's Q test can handle three or more related samples, making it more versatile in scenarios where subjects are measured under multiple conditions. The test statistic follows a Chi-Square...
437
Friedman Two-way Analysis of Variance by Ranks
256
Friedman's Two-Way Analysis of Variance by Ranks is a nonparametric test designed to identify differences across multiple test attempts when traditional assumptions of normality and equal variances do not apply. Unlike conventional ANOVA, which requires normally distributed data with equal variances, Friedman's test is ideal for ordinal or non-normally distributed data, making it particularly useful for analyzing dependent samples, such as matched subjects over time or repeated measures...
256
Statistical Methods to Analyze Parametric Data: Student t-Test and Goodness-of-Fit Test
1.7K
In parametric statistics, two fundamental tests stand out for their utility and wide application: the Student's t-test and goodness-of-fit tests. These tests provide researchers with a robust method for drawing insights from data, testing hypotheses, and making informed decisions based on their findings.
The Student's t-test is a statistical test that examines if there is a statistically significant difference between the means of two groups. This test is instrumental when dealing with...
The Student's t-test is a statistical test that examines if there is a statistically significant difference between the means of two groups. This test is instrumental when dealing with...
1.7K
Goodness-of-Fit Test
3.6K
The goodness-of-fit test is a type of hypothesis test which determines whether the data "fits" a particular distribution. For example, one may suspect that some anonymous data may fit a binomial distribution. A chi-square test (meaning the distribution for the hypothesis test is chi-square) can be used to determine if there is a fit. The null and alternative hypotheses may be written in sentences or stated as equations or inequalities. The test statistic for a goodness-of-fit test is given as...
3.6K
Wald-Wolfowitz Runs Test I
685
The Wald-Wolfowitz test, also known as the runs test, is a nonparametric statistical test used to assess the randomness of a sequence of two different types of elements (e.g., positive/negative values, successes/failures). It examines whether the order of the elements in a sequence is random or if there is a pattern or trend present. This nonparametric test applies to any ordered data despite the population and sample data distribution, even if a higher sample size is available.
The test works...
The test works...
685


