关于差异物品运作的复杂来源:三种方法的比较
Haeju Lee1, Sijia Huang2, Dubravka Svetina Valdivia2
1The University of North Carolina at Greensboro, USA.
Educational and psychological measurement
|November 13, 2025
概括
本研究比较了三个差异物品功能 (DIF) 检测方法. 最少绝对收缩和选择操作员 (LASSO) 对复杂的DIF源表现有希望,在模拟中表现优于物流回归和概率比率测试.
科学领域:
- 心理测量 心理测量 心理测量
- 教育测量教育的测量
- 心理测量 心理测量
背景情况:
- 差异项目功能 (DIF) 是教育和心理测量的持续挑战.
- 复杂的DIF源,其中一个项目同时在多个变量中显示DIF,使检测复杂化.
- 现有的DIF检测方法,无论是基于非物品响应理论 (IRT) 的还是基于IRT的,在评估复杂的DIF场景时往往都不足.
研究的目的:
- 为了比较三个DIF检测方法的性能:逻辑回归 (LR),概率比测试 (LRT) 和最小绝对收缩和选择操作员 (LASSO) 正规化.
- 在由多个背景变量产生的复杂DIF条件下评估这些方法.
- 提供对多变量环境中影响DIF检测准确性的因素的见解.
主要方法:
- 进行了一项全面的模拟研究,以比较LR,LRT和LASSO.
- 进行实证数据分析以验证模拟结果.
- 该研究检查了不同条件下的方法的I型错误率和功率率.
主要成果:
- 在检测一个变量上的DIF时,LR,LRT和LASSO的性能受样本大小,DIF大小,其他变量的DIF大小以及变量间的相关性影响.
- LASSO规范化在多个背景变量中检测DIF方面表现出有希望的结果.
- 这些发现突出了多个背景变量和DIF检测之间的复杂相互作用.
结论:
- DIF检测方法的有效性受到DIF源和变量间关系的复杂性的重大影响.
- 拉索规范化为解决心理测量和教育测量的复杂DIF场景提供了一种可行的方法.
- 需要进一步的研究来探索局限性,并完善用于多变量环境的DIF检测策略.
相关概念视频
Friedman Two-way Analysis of Variance by Ranks
475
Friedman's Two-Way Analysis of Variance by Ranks is a nonparametric test designed to identify differences across multiple test attempts when traditional assumptions of normality and equal variances do not apply. Unlike conventional ANOVA, which requires normally distributed data with equal variances, Friedman's test is ideal for ordinal or non-normally distributed data, making it particularly useful for analyzing dependent samples, such as matched subjects over time or repeated measures...
475
One-Way ANOVA: Equal Sample Sizes
4.0K
One-Way ANOVA can be performed on three or more samples with equal or unequal sample sizes. When one-way ANOVA is performed on two datasets with samples of equal sizes, it can be easily observed that the computed F statistic is highly sensitive to the sample mean.
Different sample means can result in different values for the variance estimate: variance between samples. This is because the variance between samples is calculated as the product of the sample size and the variance between the...
Different sample means can result in different values for the variance estimate: variance between samples. This is because the variance between samples is calculated as the product of the sample size and the variance between the...
4.0K
Bonferroni Test
3.3K
The Bonferroni test is a statistical test named after Carlo Emilio Bonferroni, an Italian mathematician best known for Bonferroni inequalities. This statistical test is a type of multiple comparison test to determine which means are different than the rest. Bonferroni test can minimize the Type 1 error by reducing the significance level alpha, which otherwise increases with sample pairs.
The means of different samples are first paired in all possible combinations.
The null hypothesis of the...
The means of different samples are first paired in all possible combinations.
The null hypothesis of the...
3.3K
Identifying Statistically Significant Differences: The F-Test
3.0K
The F-test is used to compare two sample variances to each other or compare the sample variance to the population variance. It is used to decide whether an indeterminate error can explain the difference in their values. The underlying assumptions that allow the use of the F-test include the data set or sets are normally distributed, and the data sets are independent of each other. The test statistic F is calculated by dividing one variance by another. In other words, the square of one standard...
3.0K
One-Way ANOVA: Unequal Sample Sizes
6.6K
One-way ANOVA can be performed on three or more samples of unequal sizes. However, calculations get complicated when sample sizes are not always the same. So, while performing ANOVA with unequal samples size, the following equation is used:
6.6K
Multiple Comparison Tests
4.4K
Multiple comparison test, abbreviated as MCT, is a post hoc analysis generally performed after comparing multiple samples with one or more tests. An MCT will help identify a significantly different sample among multiple samples or a factor among multiple factors.
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
4.4K


