Related Experiment Video
Updated: Mar 19, 2026

Post-Movie Subliminal Measurement PMSM, for Investigating Implicit Social Bias
Published on: February 29, 2020
Are Survey Respondents Lying about Their Support for Same-Sex Marriage? Lessons from a List Experiment
Jeffrey R Lax1, Justin H Phillips1, Alissa F Stollwerk1
1J effrey R. L ax is an associate professor of political science at Columbia University, New York, NY, USA. J ustin H. P hillips is an associate professor of political science at Columbia University, New York, NY, USA. A lissa F. S tollwerk is a doctoral candidate in the Department of Political Science at Columbia University, New York, NY, USA. The authors thank Peter Aronow, Adam Berinsky, Graeme Blair, Alex Coppock, Dan Corstange, Albert Fang, Adam Glynn, and Don Green for their helpful advice on this project.
Abstract:
Public opinion polls consistently show that a growing majority of Americans support same-sex marriage. Critics, however, raise the possibility that these polls are plagued by social desirability bias, and thereby may overstate public support for gay and lesbian rights. We test this proposition using a list experiment embedded in the 2013 Cooperative Congressional Election Study. List experiments afford respondents an anonymity that allows them to provide more truthful answers to potentially sensitive survey items. Our experiment finds no evidence that social desirability is affecting overall survey results. If there is social desirability in polling on same-sex marriage, it pushes in both directions. Indeed, our efforts provide new evidence that a national opinion majority favors same-sex marriage. To evaluate the robustness of our findings, we analyze a second list experiment, this one focusing on the inclusion of sexual orientation in employment nondiscrimination laws. Again, we find no overall evidence of bias.
Related Concept Videos
Surveys
Confirmation Biases
Survey Safety
Correspondence Bias
Testing a Claim about Population Proportion
There are two methods of testing a claim about a population proportion: (1) Using the sample proportion from the data where a binomial distribution is approximated to the normal distribution and (2) Using the binomial probabilities calculated from the data.
The first method uses normal distribution as an approximation to the binomial distribution. The requirements are as follows: sample size is large...
Social Proof

