Related Experiment Video
Updated: Jul 16, 2026

A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments
Published on: March 1, 2022
Correcting collection bias in comparative studies of diversity
Folgert Karsdorp1,2, Anne Kandler3, Mike Kestemont4
1Meertens Institute, Royal Netherlands Academy of Arts and Sciences , Amsterdam, The Netherlands.
None:
Comparative analyses of diversity in human populations often rely on historical, archival and observational data, which are systematically shaped by uneven documentation, preservation and research attention. Such collection bias can distort comparisons across populations, regions or time periods, obscuring genuine patterns of variation or generating spurious ones. Standard approaches that equalize sample size or sampling effort implicitly assume comparable sampling completeness, which is an assumption rarely satisfied in human and historical datasets. Here, we evaluate coverage-based standardization, adapted from ecological diversity estimation, as a general framework for comparative diversity analysis under biased and incomplete observation. Using population-level simulations, we show that coverage-based approaches reliably recover true diversity relationships across multiple, qualitatively distinct mechanisms of collection bias, whereas sample-size-based methods yield systematically distorted inferences. We illustrate the utility of this framework with an application to a large historical cultural dataset, where correcting for uneven documentation substantially refines inferred diversity patterns. By conditioning comparisons on sampling completeness rather than raw sample size, coverage-based standardization offers a principled and broadly applicable solution for comparative research in any domain where observation is biased, incomplete or historically contingent.
Related Concept Videos
Bias
In statistics, a sampling bias is created when a sample is collected from a population, and some members of the population are not as likely to be chosen as others (remember, each member...
Bias in Epidemiological Studies
Data Collection by Observations
An astronomer viewing the motion and brightness of stars in the sky and recording the data is an example of observational data collection. A botanist recording...
Surveys
Correspondence Bias
One-Way ANOVA: Equal Sample Sizes
Different sample means can result in different values for the variance estimate: variance between samples. This is because the variance between samples is calculated as the product of the sample size and the variance between the...