在DIEP乳房重建之前,人工智能作为外科顾问. 这是一项对三种大型语言模型的盲目比较研究
Reza Tabrisi1,2, Johann Zdolsek1,2, Nathalie Mobargha3,4
1Department of Plastic and Reconstructive Surgery, Örebro University Hospital, Örebro, Sweden.
JPRAS open
|February 3, 2026
概括
大型语言模型 (LLM) 在DIEP乳房重建中为患者教育提供了明显的优势. 聊天GPT在准确度上,Copilot在信息性上,Gemini在可读性上,没有一个模型是普遍优越的.
科学领域:
- 医疗信息学 医疗信息学
- 医疗保健中的人工智能
- 整形外科教育教育 整形外科教育
背景情况:
- 大型语言模型 (LLM) 在临床环境中越来越多地被使用,但它们在患者教育中的有效性需要彻底评估.
- 对于LLM产生的内容的准确性和可读性,用于手术前咨询,特别是用于DIEP乳房重建,仍然不清楚.
研究的目的:
- 为了比较三个著名的LLM (ChatGPT,Gemini,Copilot) 在为DIEP乳房重建提供手术前咨询方面的表现.
- 用专家外科医生评估来评估LLM的准确性,信息性和可读性.
主要方法:
- 根据BREAST-Q框架分类的DIEP乳房重建的40个常见的手术前问题被提出给ChatGPT,Gemini和Copilot.
- 答案由八名经过董事会认证的整形外科医生在5分利克特级别上对准确性,信息性和可读性进行评估.
- 进一步的评估包括一般方面 (易用性,有问题的内容) 和信息特定方面 (相关性,阅读水平).
主要成果:
- 在LLMs中观察到显著的差异. 聊天GPT展示了最高的准确性 (p=0.019),而Copilot是最有信息的 (p=0.041).
- 聊天GPT和Copilot都产生了比双子座 (p<0.001) 更多可读的响应. 副驾驶员的问题陈述较少.
- 双子座在最简单的阅读水平上产生文本,但精度较低. 在准确性方面,评价者间的一致性很强 (κ=0.96),但在定性领域却很弱.
结论:
- 每个LLM都表现出独特的优势:ChatGPT为准确性,Copilot为信息性,Gemini为语言简单性.
- 没有一个LLM在所有评估领域中表现优于其他.
- 研究结果支持在乳房重建手术的患者教育中监督,特定任务的LLMs应用.
相关概念视频
02:07Blind Procedures
13.4K
Ideally, the people who observe and record the children’s behavior are unaware of who was assigned to the experimental or control group, in order to control for experimenter bias. Experimenter bias refers to the possibility that a researcher’s expectations might skew the results of the study. Remember, conducting an experiment requires a lot of planning, and the people involved in the research project have a vested interest in supporting their hypotheses. If the observers knew which...
13.4K
01:11Blinding
4.0K
Blinding is a commonly used method of not telling participants which treatment a subject is receiving. Blinding is a critical part of a randomized control trial or RCT. It reduces the bias that affects the results. In an RCT, blinding is used in the form of a placebo. A placebo effect occurs when untreated subjects falsely believe they have received the treatment and report improved symptoms. A placebo or a dummy treatment is administered to subjects to negate the bias caused by such an effect.
4.0K
01:16Language
913
Language is a unique communication system that uses words and systematic rules to organize and transmit information. Unlike other forms of communication, which may involve postures, movements, odors, or vocalizations, language relies on symbols and grammar. This makes human communication distinct from that of other species, who also communicate but do not use language in the same way humans do.
Corballis and Suddendorf (2007) and Tomasello and Rakoczy (2003) highlight the role of language in...
Corballis and Suddendorf (2007) and Tomasello and Rakoczy (2003) highlight the role of language in...
913
01:27Intelligence
8.6K
The term "intelligence" is complex because it refers to both behavior and individuals, and its interpretation varies across cultures. European Americans tend to link intelligence with reasoning and cognitive skills, while in Kenya, it is tied to responsible participation in family and social life. In Uganda, intelligence is seen as the ability to know the right actions and carry them out effectively, while the Iatmul people of Papua New Guinea associate it with the capacity to remember...
8.6K
01:24Components of Language
821
Language, whether spoken, signed, or written, consists of specific components: lexicon and grammar. The lexicon is the vocabulary of a language, comprising its words. Grammar is the set of rules used to convey meaning through the lexicon. For example, English grammar adds “-ed” to most verbs to indicate past tense. Words are formed by combining phonemes, which are the basic sound units of a language. Different languages have different sets of phonemes (e.g., “ah” vs.
821
01:22Language Development
912
Children master language quickly and with relative ease, supported by both biological predisposition and reinforcement. B. F. Skinner (1957) proposed that language is learned through reinforcement, while Noam Chomsky (1965) argued that language acquisition mechanisms are biologically determined.
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
912