动脉样性心血管疾病患者健康沟通中的大型语言模型:试点跨部分比较分析
Pengfei Li1, Yinfei Xu1, Xiang Liu2
1Department of Emergency and Critical Care Medicine, The Affiliated Suzhou Hospital of Nanjing Medical University, Suzhou Municipal Hospital, Gusu School, Nanjing Medical University, Suzhou, Jiangsu, China.
JMIR medical informatics
|January 7, 2026
概括
与ChatGPT-4o和Gemini相比,DeepSeek R1在回答患者关于动脉样硬化心血管疾病 (ASCVD) 的问题方面表现出卓越的准确性和完整性. 然而,所有大型语言模型 (LLM) 都难以提供符合指南的治疗信息.
科学领域:
- 人工智能在医学中的应用
- 为了健康,自然语言处理
- 数字健康素养 数字健康素养
背景情况:
- 大型语言模型 (LLM) 显示了改善公众对诸如动脉样硬化心血管疾病 (ASCVD) 等慢性疾病的医疗信息获取的潜力.
- 在以患者为中心的多语言健康沟通中,LLM的有效性,特别是对于ASCVD,需要进一步研究.
研究的目的:
- 为了比较评估三个先进的LLM (DeepSeek R1,ChatGPT-4o,Gemini) 在生成ASCVD相关患者查询的响应方面的表现.
- 评估英语和中文的LLM表现,以准确性,完整性和可理解性来评估面向患者的ASCVD信息.
主要方法:
- 使用25个验证的ASCVD问题在五个领域 (定义,诊断,治疗,预防,生活方式) 进行横截面评估.
- 在默认设置下,通过将每个问题提交五次到每个LLM以英语和中文生成750个答案.
- 由三个盲目心脏病学家使用利克特尺度对答案进行独立评分,严格随机化和共识评分.
主要成果:
- 在这两种语言中,DeepSeek R1获得了最高的"良好响应"率 (96%),超过了ChatGPT-4o (84%) 和Gemini (48-68%).
- 在DeepSeek R1中,平均准确度和完整度得分优越 (P<.001).
- 所有模型在定义和诊断问题上的表现都比治疗/预防主题更好;没有一个可靠地提供了符合指南的治疗信息.
结论:
- DeepSeek R1 显示出强大的潜力,可以在多种语言中生成高质量的,面向患者的ASCVD信息,从而提高数字健康素养.
- 在提供符合指导方针的治疗信息方面存在关键限制,这表明对ASCVD的LLM使用应仅限于没有专家监督的低风险查询.
相关概念视频
Atherosclerosis III: Management
311
Management of atherosclerosis involves an integrated strategy encompassing pharmacological treatment, surgical interventions, lifestyle changes, and nutrition therapy to address the multifactorial nature of the disease.Pharmacological TherapyA cornerstone of atherosclerosis management is the use of pharmacological agents. Statins, such as atorvastatin, are pivotal in inhibiting HMG-CoA reductase, an enzyme that catalyzes an initial step in cholesterol synthesis in the liver. This reduction in...
311
Atherosclerosis IV: Nursing Management
357
Nursing management for a patient with arteriosclerosis involves a comprehensive approach focusing on lifestyle modification, disease monitoring, education, and symptomatic care. Here is an overview of effective nursing strategies:Assessment and Monitoring: Initial and ongoing assessments are crucial. Nurses must document the patient's medical history, including any hypertension, diabetes, hyperlipidemia, and other cardiovascular diseases. Assessments also cover family history and lifestyle...
357
Coronary Artery Disease IV: Preventive Measures
579
Effective preventive measures for coronary artery disease (CAD) focus on controlling modifiable risk factors, including cholesterol abnormalities and lifestyle changes.Cholesterol ManagementFirst, the Mediterranean diet and the American Heart Association advocate for maintaining low-density lipoprotein (LDL) cholesterol levels below 100 mg/dL, with a more stringent recommendation of below 70 mg/dL for individuals at high risk. LDL cholesterol, often termed "bad cholesterol," can lead to the...
579
Atherosclerosis II: Clinical Manifestations and Diagnostic Tests
452
Atherosclerosis is a progressive disorder that leads to the thickening and narrowing of arterial walls due to plaque buildup. This condition can cause various symptoms depending on the arteries affected:Coronary Artery Disease (CAD): This condition affects the coronary arteries and may lead to chest pain (angina), shortness of breath (dyspnea), heart attacks, and other heart disease symptoms.Cerebrovascular Disease: This affects blood flow to the brain, causing transient ischemic attacks (TIAs)...
452
Health Literacy
5.2K
Health literacy is an individual's or a community's capacity to comprehend, receive, read, and use relevant healthcare information and services. The World Health Organization (WHO, 2018) defines health literacy as the cognitive and social skills that determine the ability of individuals to gain access to, understand, and use information in ways that promote and maintain good health. As a result, the WHO helps individuals manage long-term health concerns, participate in preventative...
5.2K
Atherosclerosis I: Introduction
868
Atherosclerosis is a progressive disorder characterized by the buildup of plaques on the arterial inner wall, causing them to narrow and harden over time. These plaques comprise lipids, calcium, blood components, carbohydrates, and fibrous tissue. The process primarily affects the intima of large and medium-sized arteries, reducing blood flow in any artery.Etiology and risk factorsThe cause of atherosclerosis is multifactorial, involving a complex interplay among endothelial injury, lipid...
868


