推进健康指导:对大型语言模型和健康教练进行比较研究
Qi Chwen Ong1, Chin-Siang Ang2, Davidson Zun Yin Chee2
1Lee Kong Chian School of Medicine, Nanyang Technological University, 11 Mandalay Rd, 308232, Singapore; School of Public Health, Imperial College London, 90 Wood Ln, London W12 0BZ, United Kingdom.
Artificial intelligence in medicine
|October 25, 2024
概括
大型语言模型 (LLM) 在与睡眠有关的查询中显示了与人类健康教练相似的性能. 这项研究表明,LLM可以提高健康指导的可访问性和可扩展性.
科学领域:
- 医疗保健中的人工智能
- 数字健康干预措施 数字健康干预措施
- 自然语言处理自然语言处理.
背景情况:
- 大型语言模型 (LLM) 为自动化健康指导提供了机会,在可访问性,可扩展性和定制性方面提供了潜在的改进.
- LLM的零射击学习能力可以彻底改变个性化的健康支持.
研究的目的:
- 为了比较客户睡眠相关问题的答案质量,人类健康教练和恢复增强代 (RAG) 支持的LLM.
- 通过多个标准来评估响应质量,包括准确性,可读性,帮助性,同情力和潜在的危害性.
主要方法:
- 从试点研究中使用了100个客户问题答案对,LLM的答案是使用支持RAG的LLaMa-2-7b聊天模型生成的.
- 三个评价组 (专家,非专业用户,GPT-4) 通过单个答案质量评级和对对比来评估答案.
- 统计分析包括t测试,相关性和千平方测试;使用类内相关系数和百分比一致性来评估评估者之间的可靠性.
主要成果:
- 与人类教练相比,非专业用户认为LLM的响应显著更有帮助 (p < 0.05).
- 在所有评估组中,LLM答案在62.25%的总体评估中得到了青.
- 响应长度与准确性和同理心有正相关,但对可读性有负面影响.
结论:
- 支持检索增强生成 (RAG) 的LLM在评估领域的表现与人类健康教练相当.
- 这些发现支持开发先进的,自动化的健康指导系统,有可能在未来临床实施.
相关概念视频
Models of Health Promotion and Illness Prevention II
1.6K
The person's health status fluctuates continually, varying from being in good health to becoming ill and returning to being healthy. To understand the concept of illness prevention, there are two models. First, the health-illness continuum model is a graphic representation of an individual's wellness. It states that a person is considered healthy in the absence of physical disease and the presence of good emotional health.
The agent-host-environment model states that disease results...
The agent-host-environment model states that disease results...
1.6K
Models of Health Promotion and Illness Prevention I
2.0K
A model is a theoretical way to understand a concept or an idea. Models can overcome barriers to health regardless of diverse economic and cultural backgrounds. In addition, models make the task easier by providing different ways to approach complex issues. There are two major health promotion models: the health belief model and the health promotion model.
The health belief model (HBM) attempts to predict health-related behavior in specific belief patterns. According to the HBM, a person's...
The health belief model (HBM) attempts to predict health-related behavior in specific belief patterns. According to the HBM, a person's...
2.0K
Levels of Health Promotion and Illness Prevention
12.5K
Health promotion allows a person to control the determinants of health, resulting in an improved health status. It enhances the quality of life and reduces premature deaths. Health promotion and illness prevention programs help people make beneficial choices to reduce the risk of disease and disabilities. There are three health promotion and illness prevention levels: primary, secondary, and tertiary prevention.
In primary prevention, actions taken before disease onset prevent the disease from...
In primary prevention, actions taken before disease onset prevent the disease from...
12.5K
Health Literacy
4.0K
Health literacy is an individual's or a community's capacity to comprehend, receive, read, and use relevant healthcare information and services. The World Health Organization (WHO, 2018) defines health literacy as the cognitive and social skills that determine the ability of individuals to gain access to, understand, and use information in ways that promote and maintain good health. As a result, the WHO helps individuals manage long-term health concerns, participate in preventative...
4.0K
Concepts of Health and Illness
14.2K
Health is a condition of the body, mind, and spirit where an individual remains free from illness. Similarly, wellness is an active state, including living a lifestyle that promotes physical, mental, and emotional health. Physical health is critical for the overall well-being and can be affected by lifestyle, activity level, diet, and behavior. The highest attainable standard of health is a fundamental and universal human right. Consider Lisa, a fifteen-year-old born with congenital...
14.2K
Dimensions of Health and Illness
7.1K
The factors influencing the health-illness continuum can be internal or external and may or may not be under conscious control. They are related to the following eight human dimensions, and each dimension is interrelated to one other.
7.1K


