Related Experiment Video
Updated: Dec 26, 2025

A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments
Published on: March 1, 2022
The aggregation paradox for statistical rankings and nonparametric tests
Haikady N Nagaraja1, Shane Sanders2
1The Ohio State University, Division of Biostatistics, College of Public Health, Columbus, OH, United States of America.
Abstract:
The relationship between social choice aggregation rules and non-parametric statistical tests has been established for several cases. An outstanding, general question at this intersection is whether there exists a non-parametric test that is consistent upon aggregation of data sets (not subject to Yule-Simpson Aggregation Paradox reversals for any ordinal data). Inconsistency has been shown for several non-parametric tests, where the property bears fundamentally upon robustness (ambiguity) of non-parametric test (social choice) results. Using the binomial(n, p = 0.5) random variable CDF, we prove that aggregation of r(≥2) constituent data sets-each rendering a qualitatively-equivalent sign test for matched pairs result-reinforces and strengthens constituent results (sign test consistency). Further, we prove that magnitude of sign test consistency strengthens in significance-level of constituent results (strong-form consistency). We then find preliminary evidence that sign test consistency is preserved for a generalized form of aggregation. Application data illustrate (in)consistency in non-parametric settings, and links with information aggregation mechanisms (as well as paradoxes thereof) are discussed.
Related Concept Videos
Ranks
Introduction to Nonparametric Statistics
One of...
Statistical Inference Techniques in Hypothesis Testing: Parametric Versus Nonparametric Data
Parametric statistics, as the name suggests, assumes that data follow a specific distribution, often a normal distribution. This assumption enables robust hypothesis testing and estimation. Parametric methods, like the Student's t-test or Goodness-of-fit test, are frequently employed in biostatistics due to their robustness. For instance,...
Wilcoxon Rank-Sum Test
Friedman Two-way Analysis of Variance by Ranks
Quantifying and Rejecting Outliers: The Grubbs Test

