Related Experiment Video
Updated: Jun 18, 2025

A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments
Published on: March 1, 2022
The wisdom of the crowd with partial rankings: A Bayesian approach implementing the Thurstone model in JAGS
Lauren E Montgomery1, Nora Bradford1, Michael D Lee2
1Department of Cognitive Sciences, University of California Irvine, Irvine, CA, 92697-5100, USA.
Abstract:
We develop a Bayesian method for aggregating partial ranking data using the Thurstone model. Our implementation is a JAGS graphical model that allows each individual to rank any subset of items, and provides an inference about the latent true ranking of the items and the relative expertise of each individual. We demonstrate the method by analyzing data from new experiments that collected partial ranking data. In one experiment, participants were assigned subsets of items to rank; in the other experiment, participants could choose how many and which items they ranked. We show that our method works effectively for both sorts of partial ranking in applications to US city populations and the chronology of US presidents. We discuss the potential of the method for studying the wisdom of the crowd and other research problems that require aggregating incomplete or partial rankings.
Related Concept Videos
Friedman Two-way Analysis of Variance by Ranks
Decision Making: P-value Method
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can...
Quantifying and Rejecting Outliers: The Grubbs Test
Randomized Experiments
Simple randomization
Simple...
One-Compartment Open Model: Wagner-Nelson and Loo Riegelman Method for ka Estimation
On...
Expected Frequencies in Goodness-of-Fit Tests

