聊天GPT在神经外科准备委员会中的教育局限性
Andrew Y Powers1, Martin G McCandless2, Philipp Taussky1
1Neurosurgery, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, USA.
Cureus
|May 21, 2024
概括
这项研究评估了聊天生成预训练变压器 (ChatGPT) 用于神经外科董事会考试准备. 聊天GPT 聊天 在GPT 聊天
科学领域:
- 医学教育 医学教育
- 人工智能在医学中的应用
- 神经外科 神经外科
背景情况:
- 神经外科住院医生需要为美国神经外科委员会 (ABNS) 的初级检查做好严格的准备.
- 正在探索利用人工智能的教育工具,以补充传统的学习方法.
研究的目的:
- 评估聊天生成预训练变压器 (ChatGPT) 的准确性和教育实用性,用于为ABNS初级考试做准备的神经外科住院医生.
- 为了比较ChatGPT的表现与神经外科知识评估中的人类表现.
主要方法:
- 来自神经外科医生大会 (CNS) 神经外科手术自我评估 (SANS) 问题库的非成像问题被使用.
- 评估了ChatGPT的准确性,并通过神经外科教师对其解释的一致性和洞察力进行了评估.
- 在各种神经外科子类别中对性能进行了比较.
主要成果:
- 聊天GPT的整体准确率为50.4%,低于ABNS考试的合格门.
- 性能因子类别而异,药理学准确度最高 (81.2%) 和血管 (32.9%) 最低.
- 聊天GPT的准确性与问题长度负相关,与解释一致性和洞察力积极相关.
结论:
- 聊天GPT展示了作为神经外科委员会准备教育工具的显著局限性.
- 目前的人工智能能力不足以让神经外科住院医生通过或有效地学习ABNS初级检查.
- 需要进一步发展,以加强人工智能在专业医学教育中的作用.
相关概念视频
Neural Regulation
Digestion begins with a cephalic phase that prepares the digestive system to receive food. When our brain processes visual or olfactory information about food, it triggers impulses in the cranial nerves innervating the salivary glands and stomach to prepare for food.
Functional Divisions of the Nervous System
The nervous system, responsible for sensing, integrating, and responding to various stimuli, is divided into the central nervous system (CNS) and the peripheral nervous system (PNS). The PNS has two functional divisions: the sensory or afferent division and the motor or efferent division.
The sensory division transmits information from sensory receptors in the body to the CNS. It provides the CNS with knowledge about somatic senses (such as tactile, thermal, pain, and proprioceptive sensations)...
The sensory division transmits information from sensory receptors in the body to the CNS. It provides the CNS with knowledge about somatic senses (such as tactile, thermal, pain, and proprioceptive sensations)...
Spinal Cord: Information Processing
The spinal cord is an integral hub for motor and sensory information that enables the brain to communicate with the peripheral nervous system (PNS). This communication consists of relaying sensory data and transmission of motor commands.
Sensory Information Processing
Sensory information processing begins at the sensory receptors located in the skin and other tissues, which detect somatic sensory stimuli such as touch, temperature, or pain. These receptors function as catalysts, initiating...
Sensory Information Processing
Sensory information processing begins at the sensory receptors located in the skin and other tissues, which detect somatic sensory stimuli such as touch, temperature, or pain. These receptors function as catalysts, initiating...
Higher Mental Functions of the Brain: Language
Language is a system of communication that allows the expression of thoughts, ideas, and feelings. The brain processes language in both hemispheres.
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
Neurons as Communicators of the Brain
Neurons, the fundamental units of the brain and nervous system, function as the primary transmitters of information throughout the body. Their ability to communicate through electrical and chemical signals is vital for every bodily function, from regulating the heartbeat to processing complex thoughts. Each neuron has three main components: the cell body (soma), dendrites, and an axon, each specialized to facilitate swift and efficient neural communication.
Cell Body
The cell body, also known...
Cell Body
The cell body, also known...
Gut-Brain Axis
The gut–brain axis is a bidirectional communication system that connects the gastrointestinal tract and the brain. This interaction is mediated through multiple pathways, including the vagus nerve, hormonal signals, immune responses, and chemical messengers produced by gut microbes.Microbial Contributions to Brain FunctionGut microbiota contributes significantly to brain function by producing neuroactive compounds. These include neuroactive compounds that influence neurotransmitters such as...


