Related Experiment Video
Updated: Oct 12, 2025

Meta-analysis of Voxel-Based Neuroimaging Studies using Seed-based d Mapping with Permutation of Subject Images SDM-PSI
Published on: November 27, 2019
Psychologists update their beliefs about effect sizes after replication studies
Alex D McDiarmid1, Alexa M Tullett2, Cassie M Whitt3
1Department of Psychology, University of Alabama, Tuscaloosa, AL, USA. admcdiarmid@crimson.ua.edu.
Abstract:
Self-correction-a key feature distinguishing science from pseudoscience-requires that scientists update their beliefs in light of new evidence. However, people are often reluctant to change their beliefs. We examined belief updating in action by tracking research psychologists' beliefs in psychological effects before and after the completion of four large-scale replication projects. We found that psychologists did update their beliefs; they updated as much as they predicted they would, but not as much as our Bayesian model suggests they should if they trust the results. We found no evidence that psychologists became more critical of replications when it would have preserved their pre-existing beliefs. We also found no evidence that personal investment or lack of expertise discouraged belief updating, but people higher on intellectual humility updated their beliefs slightly more. Overall, our results suggest that replication studies can contribute to self-correction within psychology, but psychologists may underweight their evidentiary value.
More Related Videos
10:26Problem-Solving Before Instruction PS-I: A Protocol for Assessment and Intervention in Students with Different Abilities
Published on: September 11, 2021
07:59Using Practice Testing, Public Speaking, and Source Monitoring to Examine the Influences of Learning Strategies and Stress on Episodic Memory
Published on: June 14, 2019
Related Concept Videos
Regression Toward the Mean
Statistical Significance
Accuracy and Errors in Hypothesis Testing
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
The Scientific Method
Scientific Nature of Social Psychology
Social Proof