你看到的不是你得到的:观察到的规模得分比较错误估计了真正的群体差异
Bjarne Schmalbach1, Ileana Schmalbach2, Jochen Hardt2
1Medical Psychology and Medical Sociology, University Medical Center of the Johannes Gutenberg-University, Mainz, Germany. schmalbb@uni-mainz.de.
Behavior research methods
|March 20, 2025
概括
使用隐性变量分析群体差异至关重要. 由于测量错误,观察到的分数往往误估了真实差异,影响了科恩等效应大小计算.
科学领域:
- 社会科学 社会科学 社会科学
- 心理学 心理学 心理学
- 量化心理学 量化心理学
背景情况:
- 隐性变量是社会科学中理解复杂结构的核心.
- 准确测量潜变量对于有效的组比较至关重要.
- 观察到的总分数是常用的,但可能会受到测量误差的影响.
研究的目的:
- 为了研究测量错误对观察到的总分数对估计小组平均差异的影响.
- 倡导在分析群体差异时使用潜变量方法.
- 量化观察到的差异误估了真实潜变量差异的程度.
主要方法:
- 使用了一个大型数据集 (N=999,033) 来自个性调查问卷的开放存储库.
- 效应大小比较 (科恩的d) 由观察到的总分数与隐性变量因子分数得出.
- 评估了效果大小差异与尺度可靠性 (麦当劳 ω) 之间的关系.
主要成果:
- 观察到的总得分在70个研究的案例中,在33个案例中显著错误地估计了真正的群体差异.
- 对效应大小的平均错误估计为25.0% (0.048个标准偏差).
- 效果大小差异的大小和尺度可靠性 (麦当劳的 ω) 之间没有发现显著的关系.
结论:
- 通常使用的观察总和得分可以导致潜在变量中群体差异的实质性误估.
- 研究人员应该优先考虑潜变量建模,以便更准确地分析组平均差异.
- 为应用研究人员提供实用建议,以提高他们的分析方法.
相关概念视频
00:54Ratio Level of Measurement
17.2K
The way a set of data is measured is called its level of measurement. Correct statistical procedures depend on a researcher being familiar with levels of measurement. For analysis, data are classified into four levels of measurement—nominal, ordinal, interval, and ratio.
A set of data measured using the ratio scale takes care of the ratio problem and provides complete information. Ratio scale data are like interval scale data, except they have a zero point and ratios can be calculated....
A set of data measured using the ratio scale takes care of the ratio problem and provides complete information. Ratio scale data are like interval scale data, except they have a zero point and ratios can be calculated....
17.2K
01:15One-Way ANOVA: Equal Sample Sizes
3.1K
One-Way ANOVA can be performed on three or more samples with equal or unequal sample sizes. When one-way ANOVA is performed on two datasets with samples of equal sizes, it can be easily observed that the computed F statistic is highly sensitive to the sample mean.
Different sample means can result in different values for the variance estimate: variance between samples. This is because the variance between samples is calculated as the product of the sample size and the variance between the...
Different sample means can result in different values for the variance estimate: variance between samples. This is because the variance between samples is calculated as the product of the sample size and the variance between the...
3.1K
01:19Testing a Claim about Standard Deviation
2.4K
A complete procedure to test a claim about population standard deviation or population variance is explained here.
The hypothesis testing for the claim of population standard deviation (or variance) requires the data and samples to be random and unbiased. The population distribution also must be normal. There is no specific requirement on the sample size as the estimation is based on the chi-square distribution.
As a first step, the hypothesis (null and alternative) concerning the claim about...
The hypothesis testing for the claim of population standard deviation (or variance) requires the data and samples to be random and unbiased. The population distribution also must be normal. There is no specific requirement on the sample size as the estimation is based on the chi-square distribution.
As a first step, the hypothesis (null and alternative) concerning the claim about...
2.4K
00:55Ordinal Level of Measurement
22.8K
The way a set of data is measured is called its level of measurement. Correct statistical procedures depend on a researcher being familiar with levels of measurement. For analysis, data are classified into four levels of measurement—nominal, ordinal, interval, and ratio.
Data measured using an ordinal scale are similar to nominal scale data, but there is one major difference. The ordinal scale data can be ordered. An example of ordinal scale data is a list of the top five national parks...
Data measured using an ordinal scale are similar to nominal scale data, but there is one major difference. The ordinal scale data can be ordered. An example of ordinal scale data is a list of the top five national parks...
22.8K
02:45Self-Discrepancy Theory
18.3K
One influential perspective on what motivates people's behavior is detailed in Tory Higgin's self-discrepancy theory (Higgins, 1987). He proposed that people hold disagreeing internal representations of themselves that lead to different emotional states.
18.3K
01:50Statistical Significance
20.1K
Once data is collected from both the experimental and the control groups, a statistical analysis is conducted to find out if there are meaningful differences between the two groups. A statistical analysis determines how likely any difference found is due to chance (and thus not meaningful). In psychology, group differences are considered meaningful, or significant, if the odds that these differences occurred by chance alone are 5 percent or less. Stated another way, if we repeated this...
20.1K