使用GPT-4.0,ERNIE Bot 4.0和GPT-4o进行医学许可证考试的评估
Luoyu Lian1, Xin Luo2, Kavimbi Chipusu3
1Department of Thoracic Surgery, Quanzhou First Hospital Affiliated to Fujian Medical University, Quanzhou 362000, China.
Bioengineering (Basel, Switzerland)
|January 28, 2026
概括
ERNIE Bot 4.0和GPT-4o在2023年中国医疗执照考试中表现出色,表现优于GPT-4.0.0. 这些先进的大型语言模型 (LLM) 显示了人工智能在医学教育和评估中的整合的前景.
科学领域:
- 人工智能在医学中的应用
- 医疗教育 技术 技术 医学教育
- 自然语言处理自然语言处理.
背景情况:
- 大型语言模型 (LLM) 在专业领域越来越多地被探索其潜力.
- 在高风险的专业考试中评估LLM绩效对于了解他们的能力至关重要.
- 中国医疗执照考试为人工智能在医疗保健教育中的严格测试案例.
研究的目的:
- 在2023年中国医疗执照考试中系统评估和比较三个高级LLM (GPT-4.0,ERNIE Bot 4.0,GPT-4o) 的表现.
- 分析这些LLM在医学执照考试的不同领域的准确性.
- 确定每个LLM的优点和局限性,以便在医学培训中潜在应用.
主要方法:
- 利用了来自2023年中国医学执照考试的600个标准化问题的数据集.
- 绩效分析主要集中在三个部分:基本医学综合,临床医学综合和人文与预防医学综合.
- 对每个LLM (GPT-4.0,ERNIE Bot 4.0,GPT-4o) 的准确度指标是根据考试的基准计算的.
主要成果:
- 与GPT-4.0.0相比,ERNIE Bot 4.0和GPT-4o都表现出了优越的性能.
- ERNIE Bot 4.0和GPT-4o的准确性得分超过了国家合格标志.
- 在这种特定的医疗执照考试背景下,GPT-4.0的表现较差.
结论:
- 像ERNIE Bot 4.0和GPT-4o这样的高级LLM显示出在医疗教育和评估中提供帮助的巨大潜力.
- 这些发现强调了需要进一步研究LLM在多语言医疗环境中的能力和局限性.
- 整合像LLM这样的AI工具可以为增强医疗培训和检查流程提供途径.
相关概念视频
Language
906
Language is a unique communication system that uses words and systematic rules to organize and transmit information. Unlike other forms of communication, which may involve postures, movements, odors, or vocalizations, language relies on symbols and grammar. This makes human communication distinct from that of other species, who also communicate but do not use language in the same way humans do.
Corballis and Suddendorf (2007) and Tomasello and Rakoczy (2003) highlight the role of language in...
Corballis and Suddendorf (2007) and Tomasello and Rakoczy (2003) highlight the role of language in...
906
Components of Language
809
Language, whether spoken, signed, or written, consists of specific components: lexicon and grammar. The lexicon is the vocabulary of a language, comprising its words. Grammar is the set of rules used to convey meaning through the lexicon. For example, English grammar adds “-ed” to most verbs to indicate past tense. Words are formed by combining phonemes, which are the basic sound units of a language. Different languages have different sets of phonemes (e.g., “ah” vs.
809
Language Development
894
Children master language quickly and with relative ease, supported by both biological predisposition and reinforcement. B. F. Skinner (1957) proposed that language is learned through reinforcement, while Noam Chomsky (1965) argued that language acquisition mechanisms are biologically determined.
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
894
Language and Cognition
763
Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.
763
Inhaled Medications
786
Inhaled medications are crucial for managing chronic obstructive pulmonary disease (COPD) and asthma. They are essential for effective treatment and control, ensuring optimal respiratory health and well-being. Inhaled medication delivers drugs directly to the lungs, providing a rapid onset of action and reducing systemic side effects compared to oral or injectable medications. Three primary types of inhalation devices are used to administer these medications: nebulizers, metered-dose inhalers...
786
Self-Evaluation Maintenance Model
290
The Self-Evaluation Maintenance (SEM) model offers a psychological framework to understand how individuals’ self-esteem is influenced by the achievements of others, particularly those with whom they share close personal bonds. The SEM model operates when personal rather than social identity guides individuals. Central to this model is the notion that individuals have an inherent desire to preserve a favorable self-image, which is continuously shaped by interpersonal comparisons and...
290


