一个多学科评估的ChatGPT的知识的氨基粉症:观察性研究研究
Ryan C King1, Jamil S Samaan2, Yee Hui Yeo2
1Division of Cardiology, Department of Medicine, University of California, Irvine Medical Center, Orange, CA, United States.
JMIR cardio
|April 19, 2024
概括
像ChatGPT这样的大型语言模型在提供准确的粉样化症信息方面表现有前途,但为了患者安全和公平获取,可读性需要改进.
科学领域:
- 人工智能在医学中的应用
- 医疗保健的自然语言处理.
- 患者教育 技术 技术
背景情况:
- 氨基粉症是一种罕见,复杂的多系统性疾病,需要多学科的护理.
- 高质量的患者教育对于管理罕见疾病,如粉样性粉症至关重要.
- 像ChatGPT这样的人工智能驱动的工具为可访问的健康信息传播提供了潜力.
研究的目的:
- 评估ChatGPT的准确性,可复制性和可读性,以回答有关粉样化症的问题.
- 评估ChatGPT的实用性,作为一个工具,在amyloidosis患者和提供者教育.
主要方法:
- 98个amyloidosis问题 (心脏病学,胃肠病学,神经病学) 被输入到ChatGPT-3.5和ChatGPT-4.
- 专家医生对答案的准确性和全面性进行了分级.
- 通过重新输入问题来测试可复制性;使用美国等级来评估可读性.
主要成果:
- 聊天GPT-4实现了95%的准确性和84%的全面性;聊天GPT-3.5实现了89%的准确性和79%的全面性.
- 这两种模型在心脏病学问题上表现最好,ChatGPT-4在胃肠病学方面表现更全面.
- 聊天GPT-4的响应平均为15.5美元的读数水平,超过了患者教育建议的水平.
结论:
- 大型语言模型 (LLM) 对粉样性疾病信息有希望,但需要提高可读性.
- 未来的研究应该专注于提高LLM的准确性,并根据适当的阅读水平量身定制响应.
- 必须解决道德方面的考虑和局限性,以便在患者教育中安全和公平地实施人工智能.
相关概念视频
03:03Amyloid Fibrils
Amyloid fibrils are aggregates of misfolded proteins. Under most circumstances, misfolded proteins are either refolded by chaperone proteins or degraded by the proteasome. However, in the case of a mutation or a disease, these proteins can accumulate to form large clusters and often further assemble to form elongated fibers, called fibrils.
Amyloid deposits were observed as early as 1639 in the liver and the spleen. In 1854, Rudolph Virchow performed iodine staining, normally used to...
Amyloid deposits were observed as early as 1639 in the liver and the spleen. In 1854, Rudolph Virchow performed iodine staining, normally used to...
01:26Alzheimer's Disease: Overview
Alzheimer's Disease (AD) is a continually advancing neurodegenerative disorder, distinguished by escalating memory loss, cognitive dysfunction, and dementia. The disease unfolds in three stages: preclinical, mild cognitive impairment (MCI), and dementia. Its onset is insidious, and the progression gradual, with the cause not well explained by other disorders.
The clinical diagnosis of AD hinges on the presence of memory and other cognitive impairments. Biomarkers, such as changes in Aβ and tau...
The clinical diagnosis of AD hinges on the presence of memory and other cognitive impairments. Biomarkers, such as changes in Aβ and tau...
01:27Atherosclerosis II: Clinical Manifestations and Diagnostic Tests
Atherosclerosis is a progressive disorder that leads to the thickening and narrowing of arterial walls due to plaque buildup. This condition can cause various symptoms depending on the arteries affected:Coronary Artery Disease (CAD): This condition affects the coronary arteries and may lead to chest pain (angina), shortness of breath (dyspnea), heart attacks, and other heart disease symptoms.Cerebrovascular Disease: This affects blood flow to the brain, causing transient ischemic attacks (TIAs)...