作为乳腺癌患者信息来源的生成人工智能:谨慎行事
Ko Un Park1,2,3, Stuart Lipsitz3,4, Laura S Dominici1,2,3
1Division of Breast Surgery, Department of Surgery, Brigham and Women's Hospital, Boston, Massachusetts, USA.
聊天GPT 3.5 在24%的时间里提供了不准确的乳腺癌信息,并且经常引用不存在的来源. 患者在使用此AI进行医疗指导时应谨慎使用.
科学领域:
- 医疗信息学 医疗信息学
- 医疗保健中的人工智能
- 在瘤学瘤学.
背景情况:
- 像ChatGPT 3.5这样的人工智能聊天机器人的扩散为获得健康信息提供了新的途径.
- 评估人工智能生成的医疗信息的可靠性对于患者安全至关重要.
研究的目的:
- 评估关于乳腺癌的ChatGPT 3.5反应的准确性,临床相关性和可读性.
- 确定ChatGPT 3.5.5提供的引用的一致性和可验证性.
主要方法:
- 对ChatGPT 3.5.5提出了关于乳腺癌的20个患者可能的问题.
- 通过使用利克特尺度来评估答案的准确性和临床一致性.
- 使用弗莱什金凯德尺度评估可读性,并核实参考文献.
主要成果:
- 聊天GPT 3.5 显示平均准确性 (1.88/4) 和临床一致性 (2.79/5) 较差.
- 响应可读性始终很差 (平均为37.9),与准确性没有相关性.
- 引用往往不准确或不存在 (41%),同行评审的引用只使用了一次.
结论:
- 聊天GPT 3.5经常提供不正确的乳腺癌信息和不可靠的参考资料.
- 建议患者保持谨慎,并与医疗保健专业人员核实从ChatGPT 3.5获得的信息.
更多相关视频
06:03Integrating Augmented Reality Tools in Breast Cancer Related Lymphedema Prognostication and Diagnosis
Published on: February 6, 2020
04:09Predicting Treatment Response to Image-Guided Therapies Using Machine Learning: An Example for Trans-Arterial Treatment of Hepatocellular Carcinoma
Published on: October 10, 2018
相关概念视频
Cancer Survival Analysis
Cancer Vaccines
Cancer vaccines come in two categories: preventive (prophylactic) and treatment (active). Preventive vaccines, such as the Human Papillomavirus (HPV) vaccine, protect against viruses that cause certain...
Cancer-Critical Genes II: Tumor Suppressor Genes
When the function of certain critical genes, especially those involved in cell cycle regulation and cell growth signaling cascades, gets disrupted, it upsets the cell cycle progression. Such cells with unchecked cell cycles start proliferating uncontrollably and eventually develop into tumors.
Such genes that act...
Combination Therapies and Personalized Medicine
The combination of the drug acetazolamide and sulforaphane is a good example of combination therapy to treat cancer. The cells in the interior of a large tumor often die due to the hypoxic and...
Cancer-Critical Genes I: Proto-oncogenes
When the function of certain critical genes, especially those involved in cell cycle regulation and cell growth signaling cascades, gets disrupted, it upsets the cell cycle progression. Such cells with unchecked cell cycles start proliferating uncontrollably and eventually develop into tumors.
Such genes that act...
Mouse Models of Cancer Study
The development of transgenic, knockout, and knock-in mice has led to an exponential increase in their use as model organisms in research,...
