Related Experiment Video
Updated: Oct 10, 2026

Combining Behavioral Endocrinology and Experimental Economics: Testosterone and Social Decision Making
Published on: March 2, 2011
Question wording and the house vote choice : some experimental evidence
J M Box-Steffensmeier1, G C Jacobson, J T Grant
1Department of Political Science, University of California, San Diego, La Jolla, CA, 92093-0521, USA. gjacobso@ucsd.edu
Abstract:
Since 1978, the vote reported for House incumbents in the American National Election Studies (NES) has been significantly higher than the actual incumbents' vote in the districts surveyed; in NES surveys before 1978, the reported vote was much closer to the actual vote. The prime suspect for the source of this bias is the new question format introduced in 1978 and used in all subsequent studies. We document the problem and review the results of several question-wording experiments that confirm the superior accuracy of a format that does not mention the candidates' names over the ballot format currently in use. We also find evidence that a modified version of the ballot format may reduce the pro-incumbent bias, so that improvement may be possible without a major interruption of the post-1978 NES times series.
Related Concept Videos
Hypothesis: Accept or Fail to Reject?
There are two ways to indicate that the null hypothesis is not rejected. 'Accept' the null hypothesis and 'fail to...
Null and Alternative Hypotheses
The null hypothesis, denoted by H0 is a statement of no difference between the variables—they are not related. This can often be considered the status quo. As a result if you cannot accept the null, it requires some action.
The alternative hypothesis, denoted by H1 or Ha, is a claim about the population that is...
Experimental Designs
Confirmation Biases
Randomized Experiments
Simple randomization
Simple...
Framing Effects

