通过对物品的BIB采样评估道格拉斯-科恩IRT适合度的良性
John R Donoghue1, Adrienne Sgammato1
1Educational Testing Service, Princeton, NJ, USA.
Applied psychological measurement
|April 8, 2024
概括
这项研究适应了检测项目响应理论 (IRT) 项目不适合复杂测试设计的方法. 合并书籍方法有效地识别了平衡不完整块 (BIB) 设计中不合适的项目.
科学领域:
- 心理测量 心理测量 心理测量
- 教育测量教育的测量
- 统计建模 统计建模
背景情况:
- 项目响应理论 (IRT) 项目不适合检测方法通常假定固定的测试形式.
- 大规模评估经常使用复杂的设计,如平衡不完整块 (BIB) 设计.
- 现有的IRT不合适检测方法需要适应BIB设计.
研究的目的:
- 调查对Douglas and Cohen (2001) 评估BIB设计中的项目不合适的非参数方法的修改.
- 为了评估两个拟议的修改的性能:块总得分和集成的书籍得分.
- 确定分析BIB数据中IRT项目不合适的最有效方法.
主要方法:
- 研究了道格拉斯和科恩 (2001) 非参数方法的两个修改.
- 方法A:使用区块总得分进行不合适分析.
- 方法B:在BIB设计中将书籍级分数用于不合适分析.
主要成果:
- 区块级分数显示I型错误率膨胀,特别是在短区块 (5-10项) 中.
- 在大多数条件下,聚合书籍方法表明I型错误率接近名义水平.
- 集成的书籍方法有效地检测了不合适的项目,并且对一个区块内的其他不合适的项目存在具有稳定性.
结论:
- 聚合册子方法是检测BIB设计中的IRT项目不合适的可行和推方法.
- 不建议修改区块总分数,因为I型错误率过高.
- 道格拉斯和科恩程序对其他不合适物品的稳定性得到证实.
更多相关视频
05:33How to Calculate and Validate Inter-brain Synchronization in a fNIRS Hyperscanning Study
Published on: September 8, 2021
6.6K
09:00Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education
Published on: August 16, 2024
758
相关概念视频
01:16Goodness-of-Fit Test
3.3K
The goodness-of-fit test is a type of hypothesis test which determines whether the data "fits" a particular distribution. For example, one may suspect that some anonymous data may fit a binomial distribution. A chi-square test (meaning the distribution for the hypothesis test is chi-square) can be used to determine if there is a fit. The null and alternative hypotheses may be written in sentences or stated as equations or inequalities. The test statistic for a goodness-of-fit test is given as...
3.3K
01:19Expected Frequencies in Goodness-of-Fit Tests
2.5K
A goodness-of-fit test is conducted to determine whether the observed frequency values are statistically similar to the frequencies expected for the dataset. Suppose the expected frequencies for a dataset are equal such as when predicting the frequency of any number appearing when casting a die. In that case, the expected frequency is the ratio of the total number of observations (n) to the number of categories (k).
2.5K
01:09Statistical Methods to Analyze Parametric Data: Student t-Test and Goodness-of-Fit Test
1.6K
In parametric statistics, two fundamental tests stand out for their utility and wide application: the Student's t-test and goodness-of-fit tests. These tests provide researchers with a robust method for drawing insights from data, testing hypotheses, and making informed decisions based on their findings.
The Student's t-test is a statistical test that examines if there is a statistically significant difference between the means of two groups. This test is instrumental when dealing with...
The Student's t-test is a statistical test that examines if there is a statistically significant difference between the means of two groups. This test is instrumental when dealing with...
1.6K
01:23Test for Homogeneity
2.0K
The goodness–of–fit test can be used to decide whether a population fits a given distribution, but it will not suffice to decide whether two populations follow the same unknown distribution. A different test, called the test for homogeneity, can be used to conclude whether two populations have the same distribution. To calculate the test statistic for a test for homogeneity, follow the same procedure as with the test of independence. The hypotheses for the test for homogeneity can...
2.0K
01:02Quantifying and Rejecting Outliers: The Grubbs Test
1.6K
Sometimes, a data set can have a recorded numerical observation that greatly deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier. To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This...
1.6K
01:17Cochran's Q Test
312
Cochran's Q Test is a nonparametric statistical test used to determine if there are potential differences in the outcomes of three or more related groups on a binary (yes/no) or dichotomous outcome. It is essentially an extension of the McNemar Test, which is limited to two related samples - Cochran's Q test can handle three or more related samples, making it more versatile in scenarios where subjects are measured under multiple conditions. The test statistic follows a Chi-Square...
312