在社会科学中的可复制性
James W Moody1,2, Lisa A Keister1,2,3, Maria C Ramos4
1Department of Sociology, Duke University, Durham, North Carolina, USA.
Annual review of sociology
|June 7, 2023
概括
社会科学研究的可复制性是复杂的,在各学科之间存在各种问题和解决方案. 建议采用积极的,出版前的严格模型,而不是被动的,出版后的开放科学补救措施.
科学领域:
- 社会科学 社会科学 社会科学
- 研究方法研究方法研究方法学
- 学术出版学术出版公司
背景情况:
- 人们越来越担心社会科学中的经验研究的可重复性.
- 关于研究可重复性的大量和不断扩大的文献使得新研究人员难以掌握该领域.
- 需要对可重现性文献进行全面的概述,以确定核心主题和学科差异.
研究的目的:
- 通过使用文本建模,正式描述社会科学可重现性领域.
- 总结可重现性文献的广度,并确定其核心主题.
- 揭示可重现性研究中的学科差异和子主题的多样性.
主要方法:
- 从1947篇关于研究可重复性的文章中构建和分析文本网络.
- 正式文本建模的应用,以合成大量的学术文献.
- 对不同社会科学学科的可复制性出版物的比较分析.
主要成果:
- 识别了可重现性问题中的异质性,具有多个错误来源和解决策略.
- 揭示了跨社会科学学科的可重现性问题和方法的显著差异.
- 发现文献涉及到更广泛的可复制性挑战中的各种各样的子主题.
结论:
- 社会科学中的可复制性不是一个单一的问题;解决方案需要细微的,学科特定的方法.
- 呼吁像开放科学这样的被动补救措施可能是不足的,因为复制性问题的异质性质.
- 提出了一个替代模型,强调积极的,出版前的严格性,以更有效地提高研究可靠性.
相关概念视频
Social Proof
27.7K
Social proof is a form of persuasion based on comparison and conformity. People compare their behavior and actions to what others are doing and will change to conform to do what their peers do.
27.7K
The Scientific Method
59.6K
Research is what makes the difference between facts and opinions. Facts are observable realities, and opinions are personal judgments, conclusions, or attitudes that may or may not be accurate. In the scientific community, facts can be established only using evidence collected through empirical research.
59.6K
Naturalistic Observations
15.5K
If you want to understand how behavior occurs, one of the best ways to gain information is to simply observe the behavior in its natural context. However, people might change their behavior in unexpected ways if they know they are being observed. How do researchers obtain accurate information when people tend to hide their natural behavior? As an example, imagine that your professor asks everyone in your class to raise their hand if they always wash their hands after using the restroom. Chances...
15.5K
Psychology as a Science
768
Psychology, as a scientific discipline, aims to understand the mind and behavior through rigorous and systematic methods. The foundation of psychological research is evidence-based, relying heavily on the scientific method to derive and validate knowledge. This structured approach ensures that findings are reliable, valid, and applicable to broader contexts.
The scientific method in psychology involves six critical steps: making observations, formulating hypotheses, conducting tests, analyzing...
The scientific method in psychology involves six critical steps: making observations, formulating hypotheses, conducting tests, analyzing...
768
Regression Toward the Mean
6.3K
Regression toward the mean (“RTM”) is a phenomenon in which extremely high or low values—for example, and individual’s blood pressure at a particular moment—appear closer to a group’s average upon remeasuring. Although this statistical peculiarity is the result of random error and chance, it has been problematic across various medical, scientific, financial and psychological applications. In particular, RTM, if not taken into account, can interfere when...
6.3K
Surveys
14.9K
Often, psychologists develop surveys as a means of gathering data. Surveys are lists of questions to be answered by research participants, and can be delivered as paper-and-pencil questionnaires, administered electronically, or conducted verbally. Generally, the survey itself can be completed in a short time, and the ease of administering a survey makes it easy to collect data from a large number of people.
14.9K


