在神经学板式问题上评估多个生成性大语言模型
Mohammad Almomani1, Vijaya Valaparla1, James Weatherhead2
1Department of Neurology, University of Texas Medical Branch (UTMB), Galveston, TX, United States.
Frontiers in digital health
|January 21, 2026
概括
像ChatGPT-5和ChatGPT-4o这样的新大型语言模型 (LLM) 在板式问题上优于神经病学居民. 虽然双子座2.5改进了,但LLM需要仔细整合作为教育工具.
科学领域:
- 人工智能在医学中的应用
- 神经学 教育 技术 技术 神经学 教育 技术
背景情况:
- 大型语言模型 (LLM) 在医学教育中的整合正在迅速发展.
- 与人类专家相比,评估LLM的表现对于了解其潜力和局限性至关重要.
研究的目的:
- 为了比较八个LLM与神经病学住院医生的表现,在董事会式的多选择题.
- 评估七个神经学子专业和两个认知水平 (布鲁姆分类) 的LLM绩效.
主要方法:
- 一项横截面比较研究评估了Bard,Claude,Gemini (v1,2.5) 和ChatGPT (3.5,4,4o,5) 在107个仅文本的神经学问题上.
- 问题由神经病学家根据认知水平进行分类;模型和居民在受控条件下回答项目.
- 结果包括准确性,信心准确性校准和代际扩展.
主要成果:
- 聊天GPT-5 (84.1%) 和聊天GPT-4o (81.3%) 显著超过了居民 (64.9%).
- 双子座2.5 (77.6%) 也超过了居民,比双子座v1 (39.3%) 显著改善.
- 在所有模型中,信心精度校准都很弱,代际缩放有所不同.
结论:
- 高级LLM,特别是ChatGPT-5和ChatGPT-4o,在神经学板式问题上表现优异,与居民相比.
- 双子座2.5显示显著的收益,但与不均的域扩展.
- 由于信心校准较弱,LLM应作为受监督的教育辅助程序使用,并进行持续验证.
相关概念视频
Parenting Styles
618
Diana Baumrind's four parenting styles — authoritarian, authoritative, neglectful, and permissive — each influence children's socio-emotional development differently.
Authoritarian Parenting
This style is strict and controlling, with little room for open dialogue. Authoritarian parents demand obedience and often enforce rules with minimal warmth. Children raised this way may lack social skills and initiative, usually comparing themselves to others unfavorably.
Authoritative...
Authoritarian Parenting
This style is strict and controlling, with little room for open dialogue. Authoritarian parents demand obedience and often enforce rules with minimal warmth. Children raised this way may lack social skills and initiative, usually comparing themselves to others unfavorably.
Authoritative...
618
Attachment Styles
398
Jeffrey Simpson's attachment theory suggests that early caregiver relationships shape lasting patterns of behavior and emotional regulation, known as attachment styles. These patterns are organized along two key dimensions: self-esteem and interpersonal trust. The intersection of these dimensions produces four primary attachment styles that typically persist throughout life and significantly influence how individuals form and maintain relationships.Secure Attachment StyleIndividuals with a...
398
Hazan and Shaver's Attachment Styles
438
Attachment theory, developed initially to explain infant–caregiver bonds, has been extended to illuminate patterns of intimacy in adult romantic relationships. Psychologists Cindy Hazan and Phillip Shaver proposed that the attachment styles observed in infancy form a framework for how individuals approach emotional closeness and conflict in adulthood. These attachment styles—secure, avoidant, and anxious—are linked to enduring patterns of behavior and emotional regulation in...
438
Language
892
Language is a unique communication system that uses words and systematic rules to organize and transmit information. Unlike other forms of communication, which may involve postures, movements, odors, or vocalizations, language relies on symbols and grammar. This makes human communication distinct from that of other species, who also communicate but do not use language in the same way humans do.
Corballis and Suddendorf (2007) and Tomasello and Rakoczy (2003) highlight the role of language in...
Corballis and Suddendorf (2007) and Tomasello and Rakoczy (2003) highlight the role of language in...
892
Components of Language
769
Language, whether spoken, signed, or written, consists of specific components: lexicon and grammar. The lexicon is the vocabulary of a language, comprising its words. Grammar is the set of rules used to convey meaning through the lexicon. For example, English grammar adds “-ed” to most verbs to indicate past tense. Words are formed by combining phonemes, which are the basic sound units of a language. Different languages have different sets of phonemes (e.g., “ah” vs.
769
Language Development
867
Children master language quickly and with relative ease, supported by both biological predisposition and reinforcement. B. F. Skinner (1957) proposed that language is learned through reinforcement, while Noam Chomsky (1965) argued that language acquisition mechanisms are biologically determined.
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
867


