Related Experiment Video
Updated: May 9, 2026

Inverse Probability of Treatment Weighting (Propensity Score) using the Military Health System Data Repository and National Death Index
Published on: January 8, 2020
The Wikipedia Gender Gap Revisited: Characterizing Survey Response Bias with Propensity Score Estimation
Benjamin Mako Hill1, Aaron Shaw
1Massachusetts Institute of Technology, Cambridge, Massachusetts, United States of America ; Berkman Center for Internet & Society, Harvard University, Cambridge, Massachusetts, United States of America.
Abstract:
Opt-in surveys are the most widespread method used to study participation in online communities, but produce biased results in the absence of adjustments for non-response. A 2008 survey conducted by the Wikimedia Foundation and United Nations University at Maastricht is the source of a frequently cited statistic that less than 13% of Wikipedia contributors are female. However, the same study suggested that only 39.9% of Wikipedia readers in the US were female - a finding contradicted by a representative survey of American adults by the Pew Research Center conducted less than two months later. Combining these two datasets through an application and extension of a propensity score estimation technique used to model survey non-response bias, we construct revised estimates, contingent on explicit assumptions, for several of the Wikimedia Foundation and United Nations University at Maastricht claims about Wikipedia editors. We estimate that the proportion of female US adult editors was 27.5% higher than the original study reported (22.7%, versus 17.8%), and that the total proportion of female editors was 26.8% higher (16.1%, versus 12.7%).
Related Concept Videos
Bias in Epidemiological Studies
Motivational Bias
Stereotype Content Model
Bias
In statistics, a sampling bias is created when a sample is collected from a population, and some members of the population are not as likely to be chosen as others (remember, each member...
Correspondence Bias
The Ratio of X Chromosome to Autosomes
Normal male Drosophila has a ratio of one X chromosome to two sets of autosomes. In contrast, normal female Drosophila...