评估大型语言模型在基于中国背景的现场流行病学调查中的潜力-江省,中国,2025年
Tao Zhang1, Qifeng Zhao2, Yaxin Dai3
1Department of Public Health Surveillance and Advisory, Zhejiang Provincial Center for Disease Control and Prevention, Hangzhou City, Zhejiang Province, China.
China CDC weekly
|October 16, 2025
概括
大型语言模型对现场流行病学有希望,但在专业知识和准确性方面存在困难. 它们不能取代人类专家,并且需要对公共卫生使用进行仔细的验证.
科学领域:
- 现场流行病学 现场流行病学
- 人工智能在公共卫生中的作用
- 临床应用LLMs的临床应用.
背景情况:
- 大型语言模型 (LLM) 在临床环境中显示出潜力.
- 它们在现场流行病学中的实用性,特别是在中国的环境中,是研究不足的.
研究的目的:
- 评估六个领先的LLM在现场流行病学方面的表现.
- 用江现场流行病学培训计划中的问题来评估LLM能力.
主要方法:
- 测试了六种LLM:ChatGPT-o4-mini-high,ChatGPT-4o,DeepSeek-R1,DeepSeek-V3,Qwen3-235B-A22B,以及Qwen2.5-Max. 这三种LLM都在进行测试.
- 绩效与考试问题进行了测量,包括多选题和基于案例的场景.
主要成果:
- 大多数LLM在多选题中得分低于75百分点,除了DeepSeek-V3.
- 在基于案例的问题上,LLM通常超过了第75个百分点.
- 在专业知识领域观察到显著的局限性,存在不准确或伪造引用的风险.
结论:
- 虽然LLM显示出支持流行病学调查的潜力,但不能取代人类的专业知识.
- 确保准确性和可靠性是实际实施的关键挑战.
- 未来的工作应侧重于验证的知识基础和公共卫生应用的监管框架.
相关概念视频
Steps in Outbreak Investigation
487
In the ever-evolving field of public health, statistical analysis serves as a cornerstone for understanding and managing disease outbreaks. By leveraging various statistical tools, health professionals can predict potential outbreaks, analyze ongoing situations, and devise effective responses to mitigate impact. For that to happen, there are a few possible stages of the analysis:
487
Statistical Methods for Analyzing Epidemiological Data
892
Epidemiological data primarily involves information on specific populations' occurrence, distribution, and determinants of health and diseases. This data is crucial for understanding disease patterns and impacts, aiding public health decision-making and disease prevention strategies. The analysis of epidemiological data employs various statistical methods to interpret health-related data effectively. Here are some commonly used methods:
892
Principles of Disease Surveillance
460
Disease surveillance is the systematic collection, analysis, and interpretation of health data essential to the planning, implementation, and evaluation of public health practice. This process integrates data dissemination to entities responsible for preventing and controlling disease, injury, and disability. Surveillance systems provide crucial information for action, helping public health authorities make informed decisions to manage and prevent outbreaks, ensure public safety, optimize...
460
Causality in Epidemiology
1.5K
Causality or causation is a fundamental concept in epidemiology, vital for understanding the relationships between various factors and health outcomes. Despite its importance, there's no single, universally accepted definition of causality within the discipline. Drawing from a systematic review, causality in epidemiology encompasses several definitions, including production, necessary and sufficient, sufficient-component, counterfactual, and probabilistic models. Each has its strengths and...
1.5K
Introduction to Epidemiology
1.7K
Epidemiology, known as the cornerstone of public health, involves studying the distribution and determinants of health-related events in defined populations and applying these insights to control health issues. This is essential for understanding how diseases spread, identifying populations at greater risk, and implementing measures to control or prevent outbreaks. Epidemiology addresses not only infectious diseases but also non-communicable conditions like cancer and cardiovascular disease,...
1.7K
Bias in Epidemiological Studies
1.3K
Biases can arise at various stages of research, from study design and data collection to analysis and interpretation. Recognizing and addressing these biases is essential to ensure the validity and reliability of epidemiological findings.Broadly speaking, biases in epidemiology fall into three main categories: selection bias, information bias, and confounding. A more detailed description of possible biases is:
1.3K

