在心理学科学中严重忽视测量不变性测试
Esther Maassen1, E Damiano D'Urso1, Marcel A L M van Assen1
1Department of Methodology and Statistics, Tilburg University.
Psychological methods
|December 26, 2023
概括
测量不变性 (MI) 测试对于心理学研究至关重要,但很少进行或报告. 大多数研究都在MI测试中失败,质疑心理构造中组对比的有效性.
科学领域:
- 心理学 心理学 心理学
- 心理测量 心理测量 心理测量
背景情况:
- 自我报告尺度对于比较跨群体或跨时间的潜在构造至关重要.
- 有意义的比较需要测量不变性 (MI) 测试.
研究的目的:
- 为了评估心理学的MI测试实践.
- 评估报告的MI结果的可复制性.
- 在现有数据上进行新的MI测试.
主要方法:
- 用开放数据对426篇心理学文章进行系统审查.
- 对929次MI测试的比较进行分析.
- 可复制性检查和新的MI测试.
主要成果:
- 只有4%的比较使用MI测试,报告不佳.
- 没有报告的MI测试是可重现的.
- 58%的新进行的MI测试失败了,只有26%达到标量不变.
- 当配置不变性失败时,因子结构差异很常见.
结论:
- 在心理研究中,MI测试是不常见的,并且执行得很差.
- 频繁的MI违规挑战了潜伏结构中的群体差异的解释.
- 提供了改善MI报告和可复制性的建议.
相关概念视频
Measures of Intelligence
7.3K
Psychologists measure intelligence by using standardized tests that produce a score known as the intelligence quotient or IQ. To understand IQ tests, it's important to recognize the key principles behind their construction: validity, reliability, and standardization.
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this;...
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this;...
7.3K
One-Way ANOVA: Equal Sample Sizes
3.3K
One-Way ANOVA can be performed on three or more samples with equal or unequal sample sizes. When one-way ANOVA is performed on two datasets with samples of equal sizes, it can be easily observed that the computed F statistic is highly sensitive to the sample mean.
Different sample means can result in different values for the variance estimate: variance between samples. This is because the variance between samples is calculated as the product of the sample size and the variance between the...
Different sample means can result in different values for the variance estimate: variance between samples. This is because the variance between samples is calculated as the product of the sample size and the variance between the...
3.3K
One-Way ANOVA: Unequal Sample Sizes
5.8K
One-way ANOVA can be performed on three or more samples of unequal sizes. However, calculations get complicated when sample sizes are not always the same. So, while performing ANOVA with unequal samples size, the following equation is used:
5.8K
Behrens–Fisher Test
81
The Behrens-Fisher test is a statistical method designed to address the Behrens-Fisher problem, which arises when comparing the means of two normally distributed populations with unequal variances. Unlike the Student's t-test, which assumes equal variances, the Behrens-Fisher test allows for mean comparison without this restrictive assumption. This flexibility makes it particularly valuable in scenarios where two independent samples exhibit normality but lack variance homogeneity.
This test...
This test...
81
Statistical Significance
20.1K
Once data is collected from both the experimental and the control groups, a statistical analysis is conducted to find out if there are meaningful differences between the two groups. A statistical analysis determines how likely any difference found is due to chance (and thus not meaningful). In psychology, group differences are considered meaningful, or significant, if the odds that these differences occurred by chance alone are 5 percent or less. Stated another way, if we repeated this...
20.1K
Regression Toward the Mean
6.3K
Regression toward the mean (“RTM”) is a phenomenon in which extremely high or low values—for example, and individual’s blood pressure at a particular moment—appear closer to a group’s average upon remeasuring. Although this statistical peculiarity is the result of random error and chance, it has been problematic across various medical, scientific, financial and psychological applications. In particular, RTM, if not taken into account, can interfere when...
6.3K


