検索拡張生成(RAG)を用いた医療質問応答システムにおけるバイアスの評価と軽減
Yuelyu Ji1, Hang Zhang2, Yanshan Wang3,4,5
1Dept. of Information Science, University of Pittsburgh, Pittsburgh, PA, USA.
Abstract:
Medical Question-Answering (QA) systems based on Retrieval-Augmented Generation (RAG) are promising for clinical decision support due to their capability to integrate external knowledge, thus reducing inaccuracies inherent in standalone large language models (LLMs). However, these systems may unintentionally propagate biases associated with sensitive demographic attributes like race, gender, and socioeconomic factors. This study systematically evaluates demographic biases within medical RAG pipelines across multiple QA benchmarks, including MedQA, MedMCQA, MMLU, and EquityMedQA. We quantify disparities in retrieval consistency and answer correctness by generating and analyzing queries sensitive to demographic variations. We further implement and compare several bias mitigation strategies-including Chain-of-Thought reasoning, Counterfactual filtering, Adversarial prompt refinement, and Majority Vote aggregation-to address identified biases. Experimental results reveal significant demographic disparities, highlighting that Majority Vote aggregation improves accuracy and fairness metrics. Our findings underscore the critical need for explicitly fairness-aware retrieval methods and prompt engineering strategies to develop truly equitable medical QA systems.
関連する概念動画
The Availability Heuristic
Pharmacovigilance
This process, termed pharmacovigilance, aims to detect, evaluate, and minimize harmful effects related to medication use. The data collection for pharmacovigilance depends on spontaneous reporting systems, where healthcare professionals or patients voluntarily report suspected ADRs.
In some cases, there...
Health Information Technology and Healthcare Information System
Health Information Technology, commonly called HIT, integrates advanced information systems and technology in healthcare settings. Its primary functions include:
Methods of Documentation V: CBE
In CBE, healthcare professionals establish predefined standards of practice that define what constitutes...
Errors occurring during blood pressure monitoring
Several factors...
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...

