Related Experiment Video
Updated: May 28, 2025

Inverse Probability of Treatment Weighting Propensity Score using the Military Health System Data Repository and National Death Index
Published on: January 8, 2020
Addressing discretization-induced bias in demographic prediction
Evan Dong1, Aaron Schein2, Yixin Wang3
1Department of Computer Science, Cornell University, Ithaca, NY 14853, USA.
Discretizing demographic predictions, like race/ethnicity imputation, causes significant bias, undercounting minority groups. A new joint optimization method eliminates this bias without accuracy loss, crucial for fair data analysis.
Area of Science:
- Social Sciences
- Computer Science
- Political Science
Background:
- Demographic imputation is vital for auditing disparities and political targeting.
- Current methods often discretize continuous predictions, leading to potential bias.
Purpose of the Study:
- To investigate the phenomenon of discretization bias in demographic imputation.
- To introduce and evaluate a novel method for mitigating this bias.
Main Methods:
- Analysis of argmax labeling for race/ethnicity imputation using real-world data.
- Development and testing of a joint optimization approach with a data-driven threshold heuristic.
Main Results:
- Argmax labeling significantly undercounts Black voters (e.g., 28.2% in North Carolina).
- The proposed joint optimization method effectively eliminates discretization bias.
- Negligible individual-level accuracy loss was observed with the new method.
Conclusions:
- Discretization bias in demographic imputation has serious implications for downstream applications.
- Calibrated continuous models alone cannot resolve this bias; specialized methods are necessary.
- Researchers and practitioners must carefully consider the consequences of discretizing demographic predictions.
More Related Videos
Related Concept Videos
Strategies for Assessing and Addressing Confounding
Confounding can be addressed at both the design phase of a study and through analytical methods after data...
Bias in Epidemiological Studies
Confounding in Epidemiological Studies
Truncation in Survival Analysis
Left truncation occurs when individuals who experienced the event of interest before a certain time are not included in the study. This is often due to a "delayed entry" into the study where only those who survive until a certain entry point are...
Estimating Population Standard Deviation
Estimating Population Mean with Unknown Standard Deviation
William S. Gosset (1876–1937) of the...

