挑战N-启发式:效应大小,而不是样本大小,预测了心理学科学的可复制性
Xingyu Li1, Jiting Liu2, Weijia Gao3
1Graduate School of Education, Stanford University, Stanford, California, United States of America.
PloS one
|August 23, 2024
概括
在心理学中,N-Heuristic优先考虑大样本大小 (N),不能保证研究可重复性. 效果大小,而不是样本大小,是心理科学中成功复制的关键预测因素.
科学领域:
- 心理学科学 心理学科学
- 研究方法研究方法研究方法学
背景情况:
- "N-Heuristic"优先考虑大样本大小 (N) 来判断心理研究的可复制性.
- 这可能会激励快速的在线研究,可能会损害科学有效性.
- 样本大小本身并不能保证统计能力或可复制性.
研究的目的:
- 调查样本大小 (N) 与心理学研究可复制性的关系.
- 要确定样本大小或效果大小是复制成功的更好的预测指标.
- 将经验发现与心理学家对可复制性标准的看法进行比较.
主要方法:
- 从大规模复制试验中对307个原始复制研究对进行分析.
- 统计分析控制研究设计和研究领域.
- 对215名专业心理学家进行的调查,调查了判断可复制性的方法学标准.
主要成果:
- 原始研究样本大小没有预测复制概率 (rs = -0.02,p = 0.741).
- 效应大小是复制成功的重要预测因素 (rs = 0.21,p < 0.001),无论样本大小如何.
- 使用较大的N的研究调查了较小的影响 (rs = -0.49,p < 0.001).
- 心理学家认为样本大小是可复制性的最重要的标准.
结论:
- 样本大小是心理研究可复制性的不可靠指标.
- 效果大小是成功复制的一个更关键因素.
- 在判断可复制性时,优先考虑大样本大小需要谨慎.
相关概念视频
Statistical Significance
20.1K
Once data is collected from both the experimental and the control groups, a statistical analysis is conducted to find out if there are meaningful differences between the two groups. A statistical analysis determines how likely any difference found is due to chance (and thus not meaningful). In psychology, group differences are considered meaningful, or significant, if the odds that these differences occurred by chance alone are 5 percent or less. Stated another way, if we repeated this...
20.1K
The Scientific Method
59.3K
Research is what makes the difference between facts and opinions. Facts are observable realities, and opinions are personal judgments, conclusions, or attitudes that may or may not be accurate. In the scientific community, facts can be established only using evidence collected through empirical research.
59.3K
Psychology as a Science
683
Psychology, as a scientific discipline, aims to understand the mind and behavior through rigorous and systematic methods. The foundation of psychological research is evidence-based, relying heavily on the scientific method to derive and validate knowledge. This structured approach ensures that findings are reliable, valid, and applicable to broader contexts.
The scientific method in psychology involves six critical steps: making observations, formulating hypotheses, conducting tests, analyzing...
The scientific method in psychology involves six critical steps: making observations, formulating hypotheses, conducting tests, analyzing...
683
Cause and Effect
10.9K
While variables are sometimes correlated because one does cause the other, it could also be that some other factor, a confounding variable, is actually causing the systematic movement in our variables of interest. For instance, as sales in ice cream increase, so does the overall rate of crime. Is it possible that indulging in your favorite flavor of ice cream could send you on a crime spree? Or, after committing crime do you think you might decide to treat yourself to a cone?
10.9K
Regression Toward the Mean
6.3K
Regression toward the mean (“RTM”) is a phenomenon in which extremely high or low values—for example, and individual’s blood pressure at a particular moment—appear closer to a group’s average upon remeasuring. Although this statistical peculiarity is the result of random error and chance, it has been problematic across various medical, scientific, financial and psychological applications. In particular, RTM, if not taken into account, can interfere when...
6.3K
Social Proof
27.6K
Social proof is a form of persuasion based on comparison and conformity. People compare their behavior and actions to what others are doing and will change to conform to do what their peers do.
27.6K


