大型语言模型在产生罕见疾病差异诊断中使用关键临床特征的准确性
Cathy Shyr1, Rory J Tinker2, Paul A Harris1
1Department of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, TN, USA.
Studies in health technology and informatics
|August 8, 2025
概括
大型语言模型 (LLM) 可以帮助诊断罕见疾病. 聊天GPT-4o显示了最高的准确性,在与差异诊断的生物信息工具相结合时得到改善.
科学领域:
- 医疗信息学 医疗信息学
- 人工智能在医学中的应用
- 罕见疾病的诊断 罕见疾病的诊断
背景情况:
- 产生罕见疾病的差异诊断是具有挑战性和耗时的.
- 医生的专业知识严重影响诊断的准确性.
- 大型语言模型 (LLM) 在现实世界罕见疾病群体中的实用性尚未得到充分证实.
研究的目的:
- 在罕见疾病患者中评估LLMs (ChatGPT-4o,Llama 3.1-8B-Instruct) 和生物信息工具 (Exomiser) 的诊断准确性.
- 将这些工具的性能相互比较,并确定影响准确性的因素.
主要方法:
- 在424名罕见疾病患者中评估了ChatGPT-4o,Llama 3.1-8B-Instruct和Exomiser的诊断准确性.
- 利用了未诊断疾病网络的数据.
- 分析了患者因素,如症状发作的年龄,对诊断性能的影响.
主要成果:
- 聊天GPT-4o实现了最高的差异诊断准确率22.4%,超过了Exomiser (13.9%) 和Llama 3.1-8B-Instruct (11.6%).
- 症状发作的晚年与改善的ChatGPT-4o准确性相关.
- 结合ChatGPT-4o和Exomiser,与单个模型相比,准确度提高了30%.
结论:
- LLM,特别是ChatGPT-4o,在协助罕见疾病差异诊断方面表现有前途.
- 将LLM与既有生物信息学工具相结合,可以提高诊断准确度.
- 对将人工智能和生物信息学整合到罕见疾病诊断中进行进一步的研究是有必要的.
相关概念视频
Classification of Illness
7.9K
The meaning of illness is individualized to each person who experiences an alteration in health. In contrast, disease is a medical term indicating a pathological change in the structure and function of the body or mind. It is a condition that has specific symptoms and boundaries.
An illness is a response to a disease in which the person's level of functioning is changed compared with a previous level. The general classification of illness includes acute and chronic.
Acute illness is severe...
An illness is a response to a disease in which the person's level of functioning is changed compared with a previous level. The general classification of illness includes acute and chronic.
Acute illness is severe...
7.9K
Sensitivity, Specificity, and Predicted Value
664
In healthcare diagnostics, laboratory tests play a crucial role in identifying and diagnosing a wide range of medical conditions. However, interpreting test results is not always straightforward. An abnormal test result does not always confirm the presence of a disease, just as a normal result does not guarantee its absence. To assess the reliability of these diagnostic tools, healthcare practitioners rely on two key statistical indicators: sensitivity and specificity.
Sensitivity is the...
Sensitivity is the...
664
Documentation of Nursing Diagnosis
1.3K
The nurse documents nursing diagnoses and enters them into the patient record. The identified patient's nursing diagnosis is either written out with a plan of care or entered into the electronic health record.
In some settings, data-driven computerized decision support systems are in place, allowing for more accurate nursing diagnoses. The database within one of these systems includes diagnostic labels defining characteristics, activities, and indicators for nursing. A nurse enters...
In some settings, data-driven computerized decision support systems are in place, allowing for more accurate nursing diagnoses. The database within one of these systems includes diagnostic labels defining characteristics, activities, and indicators for nursing. A nurse enters...
1.3K
Improving Translational Accuracy
2.7K
2.7K


