Context is all you need: A causal framework for governing bias in clinical AI
Related Experiment Videos
Alon Gorenshtein1,2, Mahmud Omar1,3,4, Yiftach Barash5
1BRIDGE GenAI Lab, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, Massachusetts, United States of America.
Abstract:
Clinical AI systems can produce different recommendations when a patient's race, income, housing status, or gender identity changes, but a differential alone does not establish unjustified bias. What separates a clinically justified differential from an unjustified one is not its size or direction but its origin: whether the feature acts through a clinically justified pathway, or marks how patients of that group have been treated. That distinction is causal, and a model trained only to detect statistical association records that a feature carries information but never why. Existing evidence does not establish reliable recovery of this adjudication inside that model; we therefore argue for explicit causal and normative supervision, whether supplied by an external layer, built into training, or both. We set out a six-criterion rubric, four approaches to implementing it, and a two-sided evaluation reporting preserved clinical sensitivity alongside reduced bias.
Related Concept Videos
Bias in Epidemiological Studies
Bias
In statistics, a sampling bias is created when a sample is collected from a population, and some members of the population are not as likely to be chosen as others (remember, each member...
Strategies for Assessing and Addressing Confounding
Confounding can be addressed at both the design phase of a study and through analytical methods after data...
Patient-centered Care
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast, controlled...
Motivational Bias