与人类表现相比,ChatGPT的探索性分析用麻醉学口腔板检查:初步见解和影响
Samuel N Blacker1, Fei Chen1, Daniel Winecoff2
1From the Department of Anesthesiology.
Anesthesia and analgesia
|September 13, 2024
概括
像ChatGPT这样的人工智能 (AI) 聊天机器人可以生成与口腔董事会考试中的麻醉学研究员相似的答案. 然而,人类检查人员发现AI的反应漫长且不集中,尽管AI很少被误认为是人类. 进一步的AI培训可以提高性能.
科学领域:
- 医学教育 医学教育
- 人工智能在医学中的应用
- 麻醉学 麻醉学
背景情况:
- 聊天生成预训练变压器 (ChatGPT) 在各种高级考试中表现出熟练.
- 美国麻醉学会 (ABA) 标准化口腔检查 (SOE) 评估判断力和适应能力等关键能力.
- 在ABA SOE上ChatGPT的表现没有先前进行评估.
研究的目的:
- 评估ChatGPT在ABA标准化口腔检查 (SOE) 的表现.
- 将人工智能产生的反应与麻醉学研究员的反应进行比较.
- 评估检查员对人工智能产生的感知与人类产生的反应.
主要方法:
- 四名麻醉学研究员和ChatGPT对两个ABASOE样本做出了反应.
- 响应被转录,随机化,并使用语音复制器发声.
- 八名ABA考官对答案进行了评分,评估了主题和整体模块的分数.
主要成果:
- 麻醉学研究员在模块主题中获得更高的中位数 (P = .03).
- 在总体的全球模块分数中没有发现显著差异 (P = .17).
- 考官在95.83%的模块中正确识别了ChatGPT响应,而在41.67%的模块中,他们认为人类的响应是人工智能生成的.
结论:
- 聊天GPT可以生成SOE答案与模块评级可比于麻醉学研究员.
- 主观评估表明,由于长度和缺乏焦点,ChatGPT的答案较差.
- 未来的人工智能培训可以使人工智能响应与培训和考试准备的理想国有企业标准保持一致.
更多相关视频
06:28E-Patient Counseling Trial E-PACO: Computer Based Education versus Nurse Counseling for Patients to Prepare for Colonoscopy
Published on: August 1, 2019
8.3K
07:32Use of Galvanic Skin Responses, Salivary Biomarkers, and Self-reports to Assess Undergraduate Student Performance During a Laboratory Exam Activity
Published on: February 10, 2016
9.3K
相关概念视频
Stages of General Anesthesia
389
Various sedation levels offer significant advantages in facilitating procedural interventions for patients undergoing medical or invasive surgical procedures. These levels span from anxiolysis to general anesthesia, providing a spectrum of sedative effects to cater to specific patient needs. Anxiolysis reduces anxiety and is achieved through minimal sedation, enabling patients to remain awake and responsive while feeling more at ease during the procedure. This level can benefit minor...
389
General Anesthesia: Overview
198
Anesthesia is a medical procedure that uses drugs for CNS suppression to enable painless surgeries and procedures. The selection of anesthetics is influenced by their pharmacokinetic properties, side effects, and patient characteristics. Various types of anesthesia include general, local, regional, spinal, and inhalational.
General anesthesia induces unconsciousness in the whole body, while the others target specific areas or sensations. It is administered to minimize adverse effects, maintain...
General anesthesia induces unconsciousness in the whole body, while the others target specific areas or sensations. It is administered to minimize adverse effects, maintain...
198
