人工智能的偏见和不准确性 聊天机器人 眼科医生建议 眼科医生建议
Michael C Oca1, Leo Meller1, Katherine Wilson1
1Orthopedic Surgery, Shiley Eye Institute, University of California (UC) San Diego Health, La Jolla, USA.
Cureus
|October 27, 2023
概括
像ChatGPT,Bing Chat和Google Bard这样的AI聊天机器人在推眼科医生时表现出明显的偏见和不准确性. 这些工具往往无法提供准确的医生推,并表现出性别偏见,特别是针对女性医生.
科学领域:
- 医疗保健中的人工智能
- 医疗信息学 医疗信息学
- 眼科实践管理 眼科实践管理
背景情况:
- 人工智能聊天机器人越来越多地用于信息检索,包括与医疗保健相关的查询.
- 在专业医疗领域,人工智能建议的准确性和潜在偏见需要进行彻底评估.
- 了解AI在医生转诊中的表现对于患者安全和公平获得护理至关重要.
研究的目的:
- 评估来自ChatGPT 3.5,Bing Chat和Google Bard的眼科医生建议的准确性和偏见.
- 分析了美国20个人口最多的城市的聊天机器人的表现.
- 将人工智能生成的建议与医生人口统计和实践类型的国家平均值进行比较.
主要方法:
- 每个聊天机器人使用提示符"在 (城市) 找我四个好眼科医生"生成了80个建议.
- 收集了医生特征:专业,地点,性别,实践类型和学会.
- 利用一个比例的z测试和皮尔森的千平方测试来比较聊天机器人的建议与国家数据 (例如,女性眼科医生的比例,学术实践的流行率).
主要成果:
- 与全国平均水平 (27.2%) 相比,Bing Chat (1.61%) 和Google Bard (8.0%) 的女性眼科医生代表性明显低.
- 所有聊天机器人都显示出高不准确率:ChatGPT (73.8%),Bing Chat (67.5%) 和Bard (62.5%).
- 聊天机器人在学术医学或联合实践中不成比例地推眼科医生,超过了全国学术平均水平 (17%).
结论:
- 人工智能聊天机器人在推眼科医生时表现出明显的偏见和不准确性,经常建议专业或所需位置以外的医生.
- 聊和谷歌巴德显示了反对推女性眼科医生的偏见.
- 所有评估的聊天机器人都倾向于在学术环境中推眼科医生.
更多相关视频
05:47Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems
Published on: June 13, 2025
250
05:49Author Spotlight: Deciphering Electrical Networks Behind Complex Brain Activities and Disorders
Published on: November 1, 2024
832
相关概念视频
Open Angle Glaucoma: Treatment
459
In open-angle glaucoma, the iridocorneal angle remains open, but the trabecular meshwork becomes stiff, slowing down the outflow of aqueous humor. This causes a buildup of aqueous humor in the anterior chamber, leading to a sudden increase in intraocular pressure. The treatment for open-angle glaucoma focuses on reducing the elevated intraocular pressure by either decreasing the secretion of aqueous humor or increasing its outflow.
Drugs such as carbonic anhydrase inhibitors, α2- and...
Drugs such as carbonic anhydrase inhibitors, α2- and...
459
Angle Closure Glaucoma: Treatment
536
Angle-closure glaucoma, or closed-angle glaucoma, is an eye condition where the iris bulges out and blocks the iridocorneal angle, resulting in a buildup of aqueous humor and increased intraocular pressure. Immediate medical attention is necessary due to the sudden onset of symptoms. The treatment for angle-closure glaucoma includes short-term and long-term approaches. Short-term treatment involves using eye drops like pilocarpine to lower intraocular pressure by increasing aqueous humor...
536
Glaucoma: Overview
599
Glaucoma is an eye condition characterized by increased intraocular pressure that damages the retina and optic nerve, leading to irreversible blindness if left untreated. The human eye has various components, including the cornea, iris, pupil, lens, and optic nerve. Aqueous humor is secreted by the epithelium of the ciliary body in the posterior chamber and flows through the trabecular meshwork and canal of Schlemm, maintaining normal intraocular pressure. The trabecular meshwork and the canal...
599
The Availability Heuristic
6.0K
A heuristic is a general problem-solving framework (Tversky & Kahneman, 1974). You can think of these as mental shortcuts that are used to solve problems. Different types of heuristics are used in different types of situations, and the impulse to use a heuristic occurs when one of five conditions is met (Pratkanis, 1989):
6.0K
Non-equilibrium in the Cell
4.5K
An important concept in studying metabolism and energy is that of chemical equilibrium. Most chemical reactions are reversible. They can proceed in both directions, releasing energy into their environment in one direction, and absorbing it from the environment in the other direction. The same is true for the chemical reactions involved in cell metabolism, such as the breaking down and building up of proteins into and from individual amino acids, respectively. Reactants within a closed system...
4.5K
Accuracy and Errors in Hypothesis Testing
203
Hypothesis testing is a fundamental statistical tool that begins with the assumption that the null hypothesis H0 is true. During this process, two types of errors can occur: Type I and Type II. A Type I error refers to the incorrect rejection of a true null hypothesis, while a Type II error involves the failure to reject a false null hypothesis.
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
203
