Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Bias in Epidemiological Studies01:29

Bias in Epidemiological Studies

356
Biases can arise at various stages of research, from study design and data collection to analysis and interpretation. Recognizing and addressing these biases is essential to ensure the validity and reliability of epidemiological findings.Broadly speaking, biases in epidemiology fall into three main categories: selection bias, information bias, and confounding. A more detailed description of possible biases is:  
356
Issues And Trends In Healthcare Delivery System01:29

Issues And Trends In Healthcare Delivery System

5.7K
The issues and trends in healthcare delivery are constantly changing. The COVID-19 pandemic is one recent issue that wreaked havoc on healthcare systems, causing a shortage of healthcare workers, high demand for medicines and supplies, and increased medical expenditure due to a lack of insurance. Other issues include rising healthcare costs and care fragmentation.
Cost Containment
Payment for healthcare services has historically promoted adoption of costly and often unnecessary or inefficient...
5.7K
Bias01:22

Bias

4.3K
Bias refers to any tendency that prevents a question from being considered unprejudiced. In research, bias occurs when one outcome or answer is selected or encouraged over others in sampling or testing. Bias can occur during any research phase, including study design, data collection, analysis, and publication.
In statistics, a sampling bias is created when a sample is collected from a population, and some members of the population are not as likely to be chosen as others (remember, each member...
4.3K
The Availability Heuristic01:08

The Availability Heuristic

6.0K
A heuristic is a general problem-solving framework (Tversky & Kahneman, 1974). You can think of these as mental shortcuts that are used to solve problems. Different types of heuristics are used in different types of situations, and the impulse to use a heuristic occurs when one of five conditions is met (Pratkanis, 1989):
6.0K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

BAC quantification complements rather than competes with PREVENT in real-world cardiovascular risk assessment.

European heart journal·2026
Same author

Engaging students in an AI-driven RNA drug design research project through a crowd science-infused learning approach.

Journal of microbiology & biology education·2026
Same author

Enhancing Patient Understanding of Radiology Reports Through Large Language Model-Generated Summaries, Clickable Terms, and Artificial Intelligence Videos.

Journal of the American College of Radiology : JACR·2026
Same author

Review of breast arterial calcifications for cardiovascular disease risk prediction.

NPJ cardiovascular health·2026
Same author

CLEAR-AI: confounder-aware learning for equitable and accurate reasoning in AI for diagnosis.

Journal of medical imaging (Bellingham, Wash.)·2026
Same author

An Intensity-Based Cropping Approach for Fast, Interpretable, and Robust Localization of the Knee Joint in Radiographs.

Journal of imaging informatics in medicine·2026

Related Experiment Video

Updated: Jul 21, 2025

Author Spotlight: Advancing CBCT and Digital Dental Image Integration with AI-Assisted Digitization
05:49

Author Spotlight: Advancing CBCT and Digital Dental Image Integration with AI-Assisted Digitization

Published on: February 23, 2024

887

"Shortcuts" Causing Bias in Radiology Artificial Intelligence: Causes, Evaluation, and Mitigation.

Imon Banerjee1, Kamanasish Bhattacharjee2, John L Burns3

  • 1Department of Radiology, Mayo Clinic, Scottsdale, Arizona; School of Computing and Augmented Intelligence, Arizona State University, Tempe, Arizona.

Journal of the American College of Radiology : JACR
|July 28, 2023
PubMed
Summary

This article examines how artificial intelligence models in medical imaging often rely on irrelevant image features, known as shortcuts, rather than actual disease signs. These shortcuts lead to unfair diagnostic outcomes for different patient groups. The authors review how these biases emerge during model development and discuss strategies to identify and reduce them.

Keywords:
Artificial Intelligencemachine learningalgorithmic fairnessdiagnostic biasradiology informaticsspurious correlations

Frequently Asked Questions

More Related Videos

Machine Learning Algorithms for Early Detection of Bone Metastases in an Experimental Rat Model
07:15

Machine Learning Algorithms for Early Detection of Bone Metastases in an Experimental Rat Model

Published on: August 16, 2020

6.9K
Author Spotlight: Improving Radiation Therapy Access with Radiation Planning Assistant
05:18

Author Spotlight: Improving Radiation Therapy Access with Radiation Planning Assistant

Published on: October 6, 2023

1.4K

Related Experiment Videos

Last Updated: Jul 21, 2025

Author Spotlight: Advancing CBCT and Digital Dental Image Integration with AI-Assisted Digitization
05:49

Author Spotlight: Advancing CBCT and Digital Dental Image Integration with AI-Assisted Digitization

Published on: February 23, 2024

887
Machine Learning Algorithms for Early Detection of Bone Metastases in an Experimental Rat Model
07:15

Machine Learning Algorithms for Early Detection of Bone Metastases in an Experimental Rat Model

Published on: August 16, 2020

6.9K
Author Spotlight: Improving Radiation Therapy Access with Radiation Planning Assistant
05:18

Author Spotlight: Improving Radiation Therapy Access with Radiation Planning Assistant

Published on: October 6, 2023

1.4K

Area of Science:

  • Medical imaging informatics within shortcut learning research
  • Diagnostic radiology and clinical decision support systems

Background:

Medical imaging diagnostics frequently face challenges when automated systems fail to generalize across diverse patient populations. That uncertainty drove researchers to investigate why high-performing models often exhibit disparate outcomes in real-world clinical settings. Prior research has shown that these systems sometimes prioritize non-pathological image markers over clinically relevant findings. This gap motivated a deeper look into the phenomenon of shortcut learning within diagnostic algorithms. It was already known that models might inadvertently leverage protected attributes like age or sex to make predictions. However, the mechanisms linking these correlations to systemic unfairness remained poorly understood in medical contexts. No prior work had resolved how these spurious associations manifest across the entire development pipeline. This review addresses the urgent need to identify and rectify such hidden biases in automated diagnostic tools.

Purpose Of The Study:

The aim of this review is to analyze the causes, evaluation, and mitigation of bias stemming from shortcut learning in medical imaging artificial intelligence. This study addresses the gap between high-performing models and their inconsistent real-world performance across diverse patient groups. The authors seek to clarify how models inadvertently prioritize irrelevant image features over clinical pathology. They explore the tensions inherent in choosing appropriate fairness metrics for evaluating diagnostic systems. The investigation focuses on how protected attributes are detected and exploited by algorithms during the training process. The authors intend to provide a framework for understanding bias across the entire development pipeline. This work addresses the urgent need for robust strategies to ensure equitable patient outcomes. Finally, the study highlights the regulatory and ethical motivations for improving the fairness of automated diagnostic tools.

Main Methods:

This review approach synthesizes current literature regarding bias in automated diagnostic systems. The authors evaluate various phases of development, including data collection, model architecture design, and final inference. They categorize potential sources of error into data-centric, computational, and post-processing domains. The investigation focuses on identifying how spurious features influence predictive accuracy across different patient demographics. The authors examine existing toolkits designed to detect and reduce unfairness in algorithmic outputs. They compare strategies applied in general machine learning against those specifically adapted for clinical environments. The review process involves analyzing the effectiveness of preprocessing techniques versus recalibration methods. Finally, the authors assess the necessity of diverse research teams in addressing these complex systemic challenges.

Main Results:

Key findings from the literature demonstrate that artificial intelligence models frequently utilize spurious features instead of identifying true pathology. The authors report that these systems possess a remarkable ability to detect protected attributes like age, sex, and race. This capability often leads to biased diagnostic outcomes against historically underserved subgroups. The review indicates that shortcut learning can occur at multiple stages, including data, modeling, and inference phases. The authors note that current mitigation toolkits have primarily been tested in non-medical domains. They emphasize that these solutions require more rigorous evaluation before clinical implementation. The findings suggest that even when protected attributes are excluded from inputs, models still generate biased predictions based on learned correlations. The authors conclude that these biases result in the creation of nonprivileged subgroups within patient populations.

Conclusions:

The authors suggest that addressing shortcut learning requires a comprehensive evaluation of the entire model development pipeline. They propose that legal frameworks will increasingly penalize the deployment of biased diagnostic tools. Research teams must prioritize diverse perspectives to effectively identify and mitigate these systemic issues. The authors note that existing mitigation toolkits primarily originate from non-medical fields and require validation for clinical use. They emphasize that preprocessing, computational, and postprocessing strategies offer potential pathways for reducing unfair model outputs. The researchers conclude that understanding these hidden correlations is a prerequisite for equitable healthcare delivery. They highlight that current mitigation techniques remain in early stages of adoption for medical imaging applications. Finally, the authors advocate for rigorous, multi-faceted approaches to ensure that artificial intelligence serves all patient subgroups fairly.

The authors describe shortcut learning as a process where models utilize spurious features, such as radiographic markers or medical devices, rather than actual pathology to generate predictions. This reliance on irrelevant data leads to biased outcomes for specific patient subgroups.

Researchers identify data bias, modeling bias, and inference bias as the primary categories occurring during different phases of development. These stages represent distinct opportunities where unfair associations can be introduced into the system.

The authors state that these tools were largely designed for non-medical domains. Consequently, they propose that further evaluation is required to determine their effectiveness and safety within clinical radiology environments.

Data-centric solutions involve preprocessing techniques to address imbalances before training begins. These methods aim to remove spurious correlations from the input set to prevent the model from learning biased patterns.

The researchers observe that models can detect protected attributes like race, sex, and age even when these are not explicitly provided. This phenomenon often results in unfair diagnostic performance against historically underserved populations.

The authors argue that upcoming legal changes will mandate the detection and correction of biased models. They suggest that this regulatory pressure necessitates a shift toward more transparent and equitable development practices.