Related Experiment Video
Updated: May 21, 2025

Author Spotlight: A Novel Setup to Conduct Naturalistic Laboratory Experiments with Real Human Actors in Scenarios
Published on: August 4, 2023
The file drawer problem in social science survey experiments
Philip Moniz1, James N Druckman2, Jeremy Freese3
1Department of Political Science, Northeastern University, Boston, MA 02115.
Abstract:
The file drawer problem-often operationalized in terms of statistically significant results being published and statistically insignificant not being published-is widely documented in the social sciences. We extend Franco's et al. [Science 345, 1502-1505(2014)] seminal study of the file drawer problem in survey experiments submitted to the Time-sharing Experiments for the Social Sciences (TESS) data collection program. We examine projects begun after Franco et al. The updated period coincides with the contemporary open science movement. We find evidence of the problem, stemming from scholars opting to not write up insignificant results. However, that tendency is substantially smaller than it was in the prior decade. This suggests increased recognition of the importance of null results, even if the problem remains in the domain of survey experiments.
More Related Videos
Related Concept Videos
Surveys
Archival Research
Group Design
Naturalistic Observations
Longitudinal Research
Cross-Sectional Research

