使用开源大型语言模型进行医疗保健定性访谈的诱导性主题分析:它与传统方法相比如何?
Walter S Mathis1, Sophia Zhao1, Nicholas Pratt1
1Department of Psychiatry, Yale University School of Medicine, New Haven, CT, USA.
Computer methods and programs in biomedicine
|July 27, 2024
概括
大型语言模型 (LLM) 在定性主题分析方面表现有前途,与人类编码者取得了中等到实质性的相似性. 这项研究验证了LLM用于分析现实世界的临床访谈数据.
科学领域:
- 医疗保健中的人工智能
- 定性研究方法论 定性研究方法论
背景情况:
- 大型语言模型 (LLM) 正在获得临床和研究应用的关注.
- 与人类编码者相比,在定性主题分析中LLM的实用性存在有限的分析.
- 没有发表的研究评估了LLM对现实世界受保护的健康信息的评估.
研究的目的:
- 将LLM绩效与标准的人类主题分析进行比较.
- 分析LLM在现实世界中的使用,在精神病学环境中进行半结构面试.
主要方法:
- 在本地硬件上使用了700亿参数的开源LLM.
- 采用先进的快速工程技术来生成主题.
- 应用了三种评估方法来量化LLM和人类分析之间的主题相似性.
主要成果:
- 由LLM产生的主题与人类产生的主题表现出中度至实质的相似性.
- 雅卡德相似系数范围从0.44到0.69.
- 这些结果表明,对LLM应用有前途的初步发现.
结论:
- 开源的LLM可以有效地从定性数据中生成强大的主题.
- 在主题分析中,LLM与人类产生的主题取得了相当大的相似性.
- 专题分析的LLM验证可以增强和民主化定性研究.
相关概念视频
Documentation in Long-Term and Home Healthcare Setting
876
Documentation in long-term care facilities and home healthcare settings is crucial for ensuring continuous, coordinated, and comprehensive care for patients. Each setting has its specific documentation processes and tools:
Long-Term Care Facilities
Long-Term Care Facilities
876
Methods of Documentation VI: Case Management Model
564
The case management model is a multidisciplinary approach that involves healthcare professionals from diverse disciplines, such as physicians, nurses, therapists, social workers, and pharmacists, working collaboratively to address the various needs of patients. Each healthcare professional brings unique expertise and perspectives, contributing to a more comprehensive understanding of the patient's condition and tailoring treatment plans accordingly.
For example, a patient with a chronic...
For example, a patient with a chronic...
564
Methods Of Healthcare Delivery System
3.2K
At the different levels of the healthcare system, we see varying methods of healthcare used. These methods include managed care systems, case management, and primary healthcare.
Managed Care System:
The managed care system is designed to control the cost while maintaining the quality of care. The patient's care from admission to discharge is planned by the primary care provider or the case manager, also known as the gatekeeper. In a managed care system, the number of care providers is...
Managed Care System:
The managed care system is designed to control the cost while maintaining the quality of care. The patient's care from admission to discharge is planned by the primary care provider or the case manager, also known as the gatekeeper. In a managed care system, the number of care providers is...
3.2K
Issues And Trends In Healthcare Delivery System
5.6K
The issues and trends in healthcare delivery are constantly changing. The COVID-19 pandemic is one recent issue that wreaked havoc on healthcare systems, causing a shortage of healthcare workers, high demand for medicines and supplies, and increased medical expenditure due to a lack of insurance. Other issues include rising healthcare costs and care fragmentation.
Cost Containment
Payment for healthcare services has historically promoted adoption of costly and often unnecessary or inefficient...
Cost Containment
Payment for healthcare services has historically promoted adoption of costly and often unnecessary or inefficient...
5.6K
Comparing the Survival Analysis of Two or More Groups
168
Survival analysis is a cornerstone of medical research, used to evaluate the time until an event of interest occurs, such as death, disease recurrence, or recovery. Unlike standard statistical methods, survival analysis is particularly adept at handling censored data—instances where the event has not occurred for some participants by the end of the study or remains unobserved. To address these unique challenges, specialized techniques like the Kaplan-Meier estimator, log-rank test, and...
168
Health Information Technology and Healthcare Information System
812
Health Information Technology (HIT)
Health Information Technology, commonly called HIT, integrates advanced information systems and technology in healthcare settings. Its primary functions include:
Health Information Technology, commonly called HIT, integrates advanced information systems and technology in healthcare settings. Its primary functions include:
812


