在ASWB考试中评估测量不变性:监管研究建议提升股权资本
Matthew DeCarlo1, Gerald Bean2
1College of Education and Human Development, Saint Joseph's University, Philadelphia, Pennsylvania, USA.
Journal of evidence-based social work (2019)
|February 12, 2024
概括
这项研究使用模拟数据检查了社会工作执照考试中的测量不变性. 少量的差异性项目的功能有助于差异性测试功能,表明考试中的潜在偏差.
科学领域:
- 心理测量 心理测量 心理测量
- 社会工作 教育 社会工作 教育
- 测量不变性 测量不变性
背景情况:
- 来自少数群体的社会工作者在通过执照考试时面临差异.
- 执照考试对于专业实践至关重要.
- 了解考试公平性对于公平的职业机会至关重要.
研究的目的:
- 调查社会工作执照考试的测量等价性 (不变性).
- 模拟响应数据并分析差异物品功能 (DIF) 对整体测试性能的影响.
- 在许可证考试的背景下,评估项目级和测试级功能之间的关系.
主要方法:
- 模拟了15个多选题的答案数据.
- 使用R mirt包来适应一个2参数后勤 (2PL) 模型.
- 生成了五个项目展示DIF的数据,并分析了它们对测试和项目特征曲线的影响.
主要成果:
- 小数量的差异性物品的功能聚合到差异性测试的功能中.
- 发现DIF对测试功能的整体影响大小很小.
- 这一结果代表了对像ASWB考试这样的社会工作执照考试分析的潜在发现.
结论:
- 差异性测试功能是测量不变性研究的关键组成部分.
- 心理测量标准要求对项目级和测试级的测量不变性进行评估,以减轻偏差.
- 分析测试特征曲线有助于识别与内容无关的差异,例如不公平或不可靠的通过分数.
相关概念视频
One-Way ANOVA: Equal Sample Sizes
3.3K
One-Way ANOVA can be performed on three or more samples with equal or unequal sample sizes. When one-way ANOVA is performed on two datasets with samples of equal sizes, it can be easily observed that the computed F statistic is highly sensitive to the sample mean.
Different sample means can result in different values for the variance estimate: variance between samples. This is because the variance between samples is calculated as the product of the sample size and the variance between the...
Different sample means can result in different values for the variance estimate: variance between samples. This is because the variance between samples is calculated as the product of the sample size and the variance between the...
3.3K
One-Way ANOVA: Unequal Sample Sizes
5.8K
One-way ANOVA can be performed on three or more samples of unequal sizes. However, calculations get complicated when sample sizes are not always the same. So, while performing ANOVA with unequal samples size, the following equation is used:
5.8K
Reliability and Validity
12.7K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
12.7K
Measures of Intelligence
7.2K
Psychologists measure intelligence by using standardized tests that produce a score known as the intelligence quotient or IQ. To understand IQ tests, it's important to recognize the key principles behind their construction: validity, reliability, and standardization.
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this;...
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this;...
7.2K
Regression Toward the Mean
6.3K
Regression toward the mean (“RTM”) is a phenomenon in which extremely high or low values—for example, and individual’s blood pressure at a particular moment—appear closer to a group’s average upon remeasuring. Although this statistical peculiarity is the result of random error and chance, it has been problematic across various medical, scientific, financial and psychological applications. In particular, RTM, if not taken into account, can interfere when...
6.3K
Friedman Two-way Analysis of Variance by Ranks
196
Friedman's Two-Way Analysis of Variance by Ranks is a nonparametric test designed to identify differences across multiple test attempts when traditional assumptions of normality and equal variances do not apply. Unlike conventional ANOVA, which requires normally distributed data with equal variances, Friedman's test is ideal for ordinal or non-normally distributed data, making it particularly useful for analyzing dependent samples, such as matched subjects over time or repeated measures...
196


