大型语言模型中的社会人口学偏见临床试验查
Shelly Soffer1,2, Mahmud Omar3,4, Orly Efros2,5
1Institute of Hematology, Davidoff Cancer Center, Rabin Medical Center; Petah Tikva, Israel.
medRxiv : the preprint server for health sciences
|December 3, 2025
概括
大型语言模型 (LLM) 在随机临床试验查中显示最小的偏差,当标准是固定的. 然而,在评估无家可归等因素时,它们反映了社会不平等,影响了坚持和资源判断.
科学领域:
- 临床研究中的人工智能
- 人工智能中的健康公平与偏见
- 随机临床试验设计和查
背景情况:
- 大型语言模型 (LLM) 越来越多地被用于随机临床试验 (RCT) 的查.
- 在LLM驱动的RCT查中,社会人口学偏差的潜力仍然是一个未被充分探索的领域.
- 了解跨不同患者群体的LLM行为对于公平的试验准入至关重要.
研究的目的:
- 调查临床试验资格的大型语言模型 (LLM) 选判断是否根据患者社会人口统计特征而有所不同.
- 评估这些差异,同时在评估的患者个人资料中保持一致的临床细节和资格标准.
- 为了确定可能在LLM辅助试验选中引入偏见的特定社会人口因素.
主要方法:
- 一项横截面研究评估了来自ClinicalTrials.gov.gov的II-III期RCT协议.
- 经过医生验证的临床图片创建了34个版本,包括对照和33个身份变体 (性别,种族,社会经济地位,无家可归等). ) 的情况.
- 九个当代的LLM评估了这些细节,使用利克特尺度评估资格和次要领域.
主要成果:
- 在大多数社会人口统计学变化中,LLM资格判断在很大程度上是稳定的.
- 无家可归是唯一一个明显超过资格判断偏见的微不足道门 (-0.121) 的因素.
- 二级领域显示社会经济梯度,无家可归性对坚持 (-0.595) 和资源 (-0.715) 有负面影响.
结论:
- 在LLM辅助试验选中的偏见是有条件的,模型在固定的标准内始终保持一致.
- 当在严格参数之外的数据上应用时,LLM可以继承和放大现有的社会不平等.
- 负责任的部署需要保持明确的界限,以确保人工智能在试验访问中加强公平,而不是延续偏见.
更多相关视频
07:31Implementation of a Real-Time Psychosis Risk Detection and Alerting System Based on Electronic Health Records using CogStack
Published on: May 15, 2020
7.5K
06:48Lexical Decision Task for Studying Written Word Recognition in Adults with and without Dementia or Mild Cognitive Impairment
Published on: June 25, 2019
9.7K
相关概念视频
Bias in Epidemiological Studies
1.2K
Biases can arise at various stages of research, from study design and data collection to analysis and interpretation. Recognizing and addressing these biases is essential to ensure the validity and reliability of epidemiological findings.Broadly speaking, biases in epidemiology fall into three main categories: selection bias, information bias, and confounding. A more detailed description of possible biases is:
1.2K
Clinical Trials
10.1K
Clinical trials are prospective experimental studies conducted on humans to determine the safety and efficacy of treatments, drugs, diet methods, and medical devices. Using statistics in clinical trials enables researchers to derive reasonable and accurate conclusions from the collected data, allowing them to make wise decisions in uncertain situations. In medical research, statistical methods are crucial for preventing errors and bias.
There are four phases in a clinical trial. A phase one...
There are four phases in a clinical trial. A phase one...
10.1K
Clinical Trials: Overview
4.5K
Clinical development focuses on how the drug will interact with the human body and encompasses four key phases of clinical trials, each serving a specific purpose in assessing the safety and effectiveness of new drugs. These phases overlap and build upon one another. Phase I involves a small group of healthy volunteers (typically 20-80 individuals) or, in cases where significant toxicity is expected, patients with the targeted disease, such as cancer or AIDS. The volunteers are tested for...
4.5K
Surveys
16.6K
Often, psychologists develop surveys as a means of gathering data. Surveys are lists of questions to be answered by research participants, and can be delivered as paper-and-pencil questionnaires, administered electronically, or conducted verbally. Generally, the survey itself can be completed in a short time, and the ease of administering a survey makes it easy to collect data from a large number of people.
16.6K
Study Designs in Epidemiology
850
Epidemiological study designs are fundamental tools for investigating the distribution, determinants, and control of health conditions in populations. They help researchers understand the relationships between exposures and outcomes, and they broadly fall into two categories: "observational" and "experimental" studies.
Observational studies are those where the researcher does not intervene but rather observes natural variations. They include cross-sectional, cohort, and...
Observational studies are those where the researcher does not intervene but rather observes natural variations. They include cross-sectional, cohort, and...
850
Confounding in Epidemiological Studies
555
Confounding in statistical epidemiology represents a pivotal challenge, referring to the distortion in the perceived relationship between an exposure and an outcome due to the presence of a third variable, known as a confounder. This variable is associated with both the exposure and the outcome but is not a direct link in their causal chain. Its presence can lead to erroneous interpretations of the exposure's effect, either exaggerating or underestimating the true association. This...
555
