聊天GPT在放射技术专家和治疗师进入实践考试的表现
Ryan Duggan1, Kaitlyn M Tsuruda2
1School of Health Sciences, Dalhousie University, Halifax, Nova Scotia, Canada; Miramichi Regional Hospital, Horizon Health Network, New Brunswick, Canada.
Journal of medical imaging and radiation sciences
|May 26, 2024
概括
聊天GPT (GPT-4) 在加拿大医学辐射技术人员认证考试中取得了可变的成功,通过了MRI和放射治疗考试,但在放射技术方面遇到了困难. 它的反应在多次尝试中显示出高度一致性.
科学领域:
- 医疗教育中的人工智能
- 专业认证的大型语言模型 (LLM)
- 医学成像和辐射治疗评估
背景情况:
- 评估像ChatGPT (GPT-4) 这样的先进AI的能力对于理解其在专业发展中的潜在作用至关重要.
- 加拿大医学辐射技术人员协会 (CAMRT) 提供认证考试,作为专业能力的基准.
研究的目的:
- 评估ChatGPT (GPT-4) 在CAMRT管理的认证式考试中的熟练程度.
- 分析这些标准化考试的多次尝试中ChatGPT的性能一致性.
主要方法:
- 聊天GPT (GPT-4) 接受了CAMRT在放射技术,MRI,核医学和放射治疗方面的实践考试.
- 每次考试进行了五次,使用描述性统计数据分析绩效,并按学科和问题类型 (知识,应用,批判性思维) 分层.
- 使用Light's Kappa统计数据来测量反复尝试中答案的一致性.
主要成果:
- 在所有尝试中,ChatGPT在MRI (100%) 和放射治疗 (100%) 考试中都取得了合格分数 (≥65%).
- 放射技术 (20%的合格率) 和核医学 (60%的合格率) 的表现各不相同.
- 人工智能在以知识为基础的问题上表现出色,但在批判性思维问题上表现不佳;尝试中的响应协议相当大,几乎是完美的.
结论:
- 聊天GPT (GPT-4) 可以通过辐射技术人员和治疗师的认证式考试,尽管性能因学科而异.
- 人工智能在反复的考试尝试中表现出高的一致性.
- 未来关于AI在标准化测试中的表现的研究应该包括重复测量,以考虑响应的一致性.
关键词:
人工智能 (AI) 是一种人工智能.教育测量教育的测量磁共振成像技术 磁共振成像技术自然语言处理自然语言处理.核医学是一种核医学.放射学 放射学 放射学 放射学辐射疗法 辐射疗法教学教学 在教学教学.更多相关视频
08:34Proton Therapy Delivery and Its Clinical Application in Select Solid Tumor Malignancies
Published on: February 6, 2019
20.3K
09:07Multi-Tracer Studies of Brain Oxygen and Glucose Metabolism Using a Time-of-Flight Positron Emission Tomography-Computed Tomography Scanner
Published on: June 7, 2024
306
相关概念视频
01:13Radiological Investigation III: Pulmonary Angiogram and PET Scan
91
Radiological investigations are paramount in the diagnosis and management of various pulmonary diseases. Two essential investigations are the Pulmonary Angiogram and the Positron Emission Tomography (PET) Scan.
Pulmonary Angiogram
A Pulmonary Angiogram is an invasive procedure involving injecting a contrast medium through a catheter threaded into the pulmonary artery or the right side of the heart to visualize the pulmonary vasculature. Computed Tomography (CT) scans have mainly replaced this...
Pulmonary Angiogram
A Pulmonary Angiogram is an invasive procedure involving injecting a contrast medium through a catheter threaded into the pulmonary artery or the right side of the heart to visualize the pulmonary vasculature. Computed Tomography (CT) scans have mainly replaced this...
91
01:25Imaging Studies II: Positron Emission Tomography and Scintigraphy
107
Positron Emission Tomography (PET) is a medical imaging technique that provides crucial insights into the body's physiological functions at a molecular level. It is an indispensable resource for diagnosing, staging, and monitoring various illnesses, notably cancer, neurological disorders, and cardiovascular conditions.
Fundamental Principles of PET
Fundamental Principles of PET
107
01:25Pulmonary Function Tests
321
Pulmonary Function Tests (PFTs)
Pulmonary Function Tests are crucial diagnostic tools for assessing respiratory function, particularly in patients with chronic respiratory disorders. They comprehensively evaluate lung volumes, ventilatory function, breathing mechanics, diffusion, and gas exchange. These tests help diagnose pulmonary diseases and play a significant role in monitoring disease progression, evaluating disability, and assessing response to therapy.
PFTs involve using a spirometer, a...
Pulmonary Function Tests are crucial diagnostic tools for assessing respiratory function, particularly in patients with chronic respiratory disorders. They comprehensively evaluate lung volumes, ventilatory function, breathing mechanics, diffusion, and gas exchange. These tests help diagnose pulmonary diseases and play a significant role in monitoring disease progression, evaluating disability, and assessing response to therapy.
PFTs involve using a spirometer, a...
321
01:29Positron Emission Tomography
4.2K
Positron emission tomography (PET) is a medical imaging technique involving radiopharmaceuticals — substances that emit short-lived radiation. Although the first PET scanner was introduced in 1961, it took 15 more years before radiopharmaceuticals were combined with the technique and revolutionized its potential.
One of the main requirements of a PET scan is a positron-emitting radioisotope, which is produced in a cyclotron and then attached to a substance used by the part of the body...
One of the main requirements of a PET scan is a positron-emitting radioisotope, which is produced in a cyclotron and then attached to a substance used by the part of the body...
4.2K
01:30Radiological Investigation II: MRI and Ventilation Perfusion Scan
111
Description
Magnetic Resonance Imaging (MRI) and Ventilation Perfusion Scans are two radiological investigations that offer detailed diagnostic images of the body, particularly lung structures.
MRI
MRI uses magnetic fields and radiofrequency signals to distinguish between normal and abnormal tissues. This technology provides a more detailed diagnostic image than CT scans, enabling it to characterize pulmonary nodules, stage bronchogenic carcinoma, and evaluate inflammatory activity in...
Magnetic Resonance Imaging (MRI) and Ventilation Perfusion Scans are two radiological investigations that offer detailed diagnostic images of the body, particularly lung structures.
MRI
MRI uses magnetic fields and radiofrequency signals to distinguish between normal and abnormal tissues. This technology provides a more detailed diagnostic image than CT scans, enabling it to characterize pulmonary nodules, stage bronchogenic carcinoma, and evaluate inflammatory activity in...
111
01:30Radiological Investigation I: X-ray and CT
227
Radiological investigations, including X-rays and computed tomography (CT) scans, are critical for diagnosing and evaluating various medical conditions. These imaging techniques provide valuable insights into the body's internal structures, aiding in the detection of abnormalities, assessment of disease progression, and development of treatment strategies. This article delves into two primary radiological investigations, chest X-rays and CT scans, outlining their purpose, procedures, and...
227