通过检索增强代来提高糖尿病教育中大型语言模型的性能:比较研究
Dingqiao Wang1, Jiangbo Liang1, Jinguo Ye1
1State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangdong Provincial Key Laboratory of Ophthalmology and Visual Science, Guangdong Provincial Clinical Research Center for Ocular Diseases, GuangZhou, China.
Journal of medical Internet research
|July 24, 2024
概括
提取增强信息系统增强 (RISE) 框架改善了糖尿病调查的大型语言模型 (LLM). RISE提高了准确性,全面性和可理解性,有助于患者的自我管理.
科学领域:
- 人工智能在医学中的应用
- 临床信息学 临床信息学
- 自然语言处理自然语言处理.
背景情况:
- 大型语言模型 (LLM) 在处理临床数据方面表现有前途,但缺乏医学特异性,并可能产生错误.
- 糖尿病患者经常在网上寻找健康信息,强调需要可靠的来源.
- 提取增强信息系统 (RISE) 框架是为了解决这些局限性而开发的.
研究的目的:
- 评估RISE框架在提高LLM准确性和糖尿病相关患者查询安全性的有效性.
- 评估RISE对LLM答案的全面性和可理解性的影响.
主要方法:
- RISE框架涉及到查询重写,信息检索,总结和执行.
- 三个LLM (GPT-4,Claude 2,Bard) 在使用RISE和不使用RISE的情况下使用43个糖尿病问题进行了测试.
- 临床医生评估了准确性和全面性;患者评估了可理解性.
主要成果:
- RISE集成显著提高了LLM准确性,平均增加了12%的正确答案.
- 在测试的LLM中观察到特定的准确性增长:GPT-4 (+7%),Claude 2 (+19%),和Bard (+9%).
- RISE还提高了响应的全面性 (平均分数+0.44) 和可理解性 (平均分数+0.19).
结论:
- RISE框架大大提高了糖尿病调查的LLM性能,提高了准确性,全面性和可理解性.
- 这些进展支持RISE在患者教育和慢性疾病自我管理方面的潜力.
- 实施RISE可以帮助缓解医疗资源压力,提高公共卫生素养.
相关概念视频
Modeling in Therapy
61
Modeling, a key technique in therapy, uses observational learning to help clients acquire and practice new skills by watching therapists demonstrate desired behaviors. This approach, rooted in Albert Bandura's concept of vicarious learning, plays a significant role in therapeutic interventions for various psychological conditions, including social anxiety, ADHD, and depression.
Participant Modeling
Participant modeling involves therapists demonstrating calm and effective behaviors in...
Participant Modeling
Participant modeling involves therapists demonstrating calm and effective behaviors in...
61
Elaborative Rehearsals
83
Elaborative rehearsal is a crucial cognitive strategy that strengthens information encoding in long-term memory by making meaningful connections between new data and pre-existing knowledge. This approach contrasts with maintenance rehearsal, which involves simple repetition without delving into the significance of the information. While maintenance rehearsal might temporarily keep information active in short-term memory, it is less effective for long-term retention.
The effectiveness of...
The effectiveness of...
83


