开发和验证基于大型语言模型的医疗史培训系统:评估稳定性,人 - 人工智能一致性和透明度的前性多案例研究
Yang Liu1, Chujun Shi1, Liping Wu1
1Medical Simulation Center, Shantou University Medical College, No. 22 Xinling Road, Shantou, 515041, China, 86 754-88900459.
JMIR medical education
|August 29, 2025
概括
人工智能医疗历史记录培训和评估系统 (AMTES) 为医学学生提供一致,透明的反. 这种由人工智能驱动的工具表现出高准确性和稳定性,提高了史学模拟的临床技能.
科学领域:
- 医疗教育技术
- 医疗保健中的人工智能
- 临床技能培训
背景情况:
- 传统的医疗历史记录培训缺乏一致的反,标准化的评估,
- 人工智能 (AI) 驱动的模拟患者提供了一个潜在的解决方案,但人类-AI的一致性和评估稳定性需要进一步调查.
研究的目的:
- 使用DeepSeek-V2.5开发和验证基于人工智能的医疗历史记录培训和评估系统 (AMTES).
- 在不同临床场景中评估AMTES的稳定性,人与人工智能的一致性和透明度.
主要方法:
- 开发了对话质量和自动化评估的战略.
- 对31名医学学生进行了前性研究,评估了3个病例 (简单,中度,复杂).
- 进行了系统的基线比较,并使用替代的大型语言模型 (LLM) 测试了概括性.
主要成果:
- AMTES实现了高度的对话准确性 (97.9%-99.0%) 和上下文适当性 (>99%).
- 自动评估显示出异常稳定性 (CVs ≤1.2%) 和高的人类AI一致性 (ICCs > 0.923).
- 87%的学生认为AMTES有帮助,83%的学生愿意再次使用它.
结论:
- 通过真实的临床对话和一致的透明反,AMTES提供了重要的教育价值.
- 该系统可适应,并可在各种教育环境中进行医学史培训.
- 强大的用户认可支持AMTES作为一个有价值的培训工具的潜力.
相关概念视频
Data Validation
5.3K
Data validation is an essential part of a comprehensive assessment. Validation is confirming or verifying and opening the door to gathering more assessment data as it clarifies vague or unclear data. The process of checking and verifying the collected information is called data validation. The primary purpose of data validation is to ensure data is as free from error, bias, and misinterpretation as possible.
Nursing assessment guides are generally based on holistic models rather than medical...
Nursing assessment guides are generally based on holistic models rather than medical...
5.3K
Improving Translational Accuracy
2.7K
2.7K
Language Development
444
Children master language quickly and with relative ease, supported by both biological predisposition and reinforcement. B. F. Skinner (1957) proposed that language is learned through reinforcement, while Noam Chomsky (1965) argued that language acquisition mechanisms are biologically determined.
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
444
Methods of Documentation VI: Case Management Model
628
The case management model is a multidisciplinary approach that involves healthcare professionals from diverse disciplines, such as physicians, nurses, therapists, social workers, and pharmacists, working collaboratively to address the various needs of patients. Each healthcare professional brings unique expertise and perspectives, contributing to a more comprehensive understanding of the patient's condition and tailoring treatment plans accordingly.
For example, a patient with a chronic...
For example, a patient with a chronic...
628
Data Collection II
8.5K
The nursing history captures and records the patient's health status, so that a care plan evolves to meet the patient's individual needs. The nursing health history is a part of the initial assessment. A comprehensive history covers all health dimensions and plays a significant role in the assessment process. A comprehensive history includes the patient's biographical information, reasons for seeking health care, expectations, present and past health history, medications, and...
8.5K


