On criterion weighting to reduce adverse impact
Related Experiment Video
Updated: Nov 6, 2026

Inverse Probability of Treatment Weighting (Propensity Score) using the Military Health System Data Repository and National Death Index
Published on: January 8, 2020
Jinsoo Choi1, Daniel A Newman1
1Department of Psychology, University of Illinois Urbana-Champaign.
Abstract:
In research on adverse impact reduction (i.e., improving racial equality in hiring rates), one approach that is routinely mentioned in classic reviews is criterion weighting, or assigning more relative weight to contextual performance in the criterion measure. We revisit this recommendation, using an updated meta-analytic correlation matrix among predictors and criteria. Results show that, contrary to past beliefs, assigning more weight to contextual performance is typically unlikely to improve diversity and is also likely to harm criterion validity. Criterion weighting is also often outperformed by Pareto-optimal predictor weighting. Further, Pareto-optimal solutions show that, when holding criterion validity constant, assigning more criterion weight to contextual performance is likely to exacerbate rather than reduce adverse impact. We additionally offer a Global Pareto Frontier/outer envelope approach that simultaneously optimizes predictor weights and criterion weights to achieve the best adverse impact-criterion validity outcome pairs for a personnel selection system, and we identify circumstances needed for the joint optimization of predictor and criterion weights to outperform Pareto-optimal predictor weighting alone. (PsycInfo Database Record (c) 2026 APA, all rights reserved).
Related Concept Videos
Halo Effect
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast, controlled...
Weighted Mean
For example, consider the number of goals scored in the matches of a tournament. While computing the average number of goals scored in the tournament, it may be more important to...
Strategies for Assessing and Addressing Confounding
Confounding can be addressed at both the design phase of a study and through analytical methods after data...
Quantifying and Rejecting Outliers: The Grubbs Test
Confirmation Biases