对于多选项的非参数CD-CAT:项目选择方法和Q-优化
Yu Wang1, Chia-Yi Chiu2, Hans Friedrich Köhn3
1University of Minnesota, Twin Cities, Minneapolis, Minnesota, USA.
概括
这项研究引入了选择多选项 (MC) 项目的新方法,用于用于认知诊断 (CD-CAT) 的计算机自适应测试. 这些方法提高了诊断准确度,特别是当校准样本有限时.
科学领域:
- 教育测量教育的测量
- 心理测量 心理测量 心理测量
- 认知科学 认知科学
背景情况:
- 用于认知诊断的计算机自适应测试 (CD-CAT) 通过量身定制的项目选择来提高估计效率和准确性.
- 现有的项目选择方法主要集中在二进制答案上,不太强调多选项 (MC) 项目.
- 詹森-香农差异 (JSD) 指数是MC项目的唯一现有方法,但需要大规模的校准样本.
研究的目的:
- 解决CD-CAT中现有的MC项目选择方法的局限性.
- 为MC项目提出新的项目选择算法,这些算法在有限的校准数据下是有效的.
- 为了提高CD-CAT的诊断准确性和效率,使用MC项目.
主要方法:
- 为MC项目 (MC-NPS) 提出了一种非参数项选择方法,使用一种新的歧视力度量.
- 开发了MC项目的Q-最佳程序,以改善CD-CAT的早期分类.
- 通过模拟研究评估拟议的算法.
主要成果:
- 对于MC项目,MC-NPS方法在项目选择方面表现出了有效性.
- 在CD-CAT的初始阶段,Q-最佳程序提高了分类准确性.
- 模拟研究证实了两种拟议算法的有效性和效率.
结论:
- 开发的MC-NPS和Q-optimal程序为CD-CAT中的MC项目选择提供了可行的解决方案,特别是在小或没有校准样本的情况下.
- 这些方法通过利用来自MC项目的更丰富的信息来提高CD-CAT的诊断能力.
- 这些发现有助于推进用于认知诊断的适应性测试领域.
相关概念视频
Cochran's Q Test
305
Cochran's Q Test is a nonparametric statistical test used to determine if there are potential differences in the outcomes of three or more related groups on a binary (yes/no) or dichotomous outcome. It is essentially an extension of the McNemar Test, which is limited to two related samples - Cochran's Q test can handle three or more related samples, making it more versatile in scenarios where subjects are measured under multiple conditions. The test statistic follows a Chi-Square...
305
Detection of Gross Error: The Q Test
6.1K
When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...
6.1K
Introduction to Nonparametric Statistics
709
Nonparametric statistics offer a powerful alternative to traditional parametric methods, useful when assumptions about the population distribution cannot be made. Unlike parametric tests, which require data to follow a specific distribution with well-defined parameters (such as the mean and standard deviation), nonparametric tests do not require such constraints. This makes them particularly valuable when dealing with small sample sizes, skewed data, or ordinal and categorical variables.
One of...
One of...
709
McNemar's Test
209
McNemar's Test is a nonparametric statistical test used to determine if there is a significant difference in proportions between two related groups when the outcome is binary (e.g., yes/no, success/failure). It is beneficial when we have paired data, such as pre-test/post-test designs, where the same subjects are measured under two different conditions. The test is named after the statistician Quinn McNemar, who introduced it in 1947. It is commonly used in situations where subjects are...
209
Multiple Comparison Tests
3.9K
Multiple comparison test, abbreviated as MCT, is a post hoc analysis generally performed after comparing multiple samples with one or more tests. An MCT will help identify a significantly different sample among multiple samples or a factor among multiple factors.
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
3.9K
Statistical Methods to Analyze Parametric Data: Student t-Test and Goodness-of-Fit Test
1.6K
In parametric statistics, two fundamental tests stand out for their utility and wide application: the Student's t-test and goodness-of-fit tests. These tests provide researchers with a robust method for drawing insights from data, testing hypotheses, and making informed decisions based on their findings.
The Student's t-test is a statistical test that examines if there is a statistically significant difference between the means of two groups. This test is instrumental when dealing with...
The Student's t-test is a statistical test that examines if there is a statistically significant difference between the means of two groups. This test is instrumental when dealing with...
1.6K


