Related Experiment Video
Updated: Oct 29, 2026

Online Explorative Study on the Learning Uses of Virtual Reality Among Early Adopters
Published on: November 22, 2019
The Usability of Ranked Choice Voting in Digital Ballot Formats
Kaitlyn M Stewart1, Philip Kortum1, Michael D Byrne1
1Department of Psychological Sciences, Rice University, Houston, TX, USA.
Abstract:
ObjectiveThree digital ranked choice voting ballots were investigated to assess the impact of formatting on usability.BackgroundRanked choice voting (RCV) is a ballot format that allows voters to rank candidate choices in order of preference. The design of the ballot has a notable impact on usability, and this remains a challenge for RCV.MethodThis experiment investigated the usability of three RCV electronic ballot formats (bubble grid, column, and hand-numbered). Completion times, errors, subjective usability ratings, and trust data were collected.ResultsThe three formats took subjects 50-70 seconds on average to vote for a single contest. The ballots also had high error rates, which ranged from 23-38%. The hand-numbered format had the worst performance, as it had the highest completion times, error rates, and the lowest subjective usability ratings.ConclusionThis research highlights usability issues with RCV digital ballots. The formats tested were inefficient and ineffective, and performed poorly in comparison to previously tested plurality digital ballots.ApplicationThis experiment raises concerns about the scalability of RCV to larger elections. Ballots with RCV take longer to vote on and have higher error rates, which should be taken into consideration by election administrators.
Related Concept Videos
Ranks
Randomized Experiments
Simple randomization
Simple...
Decision Making: P-value Method
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can have a...
Ordinal Level of Measurement
Data measured using an ordinal scale are similar to nominal scale data, but there is one major difference. The ordinal scale data can be ordered. An example of ordinal scale data is a list of the top five national parks in the...
Surveys
Random Sampling Method