在医学成像评估中ChatGPT-4.0o的性能:一个横截面研究
Elio Stefan Arruzza1, Carla Marie Evangelista2, Minh Chau3
1UniSA Allied Health & Human Performance, University of South Australia, Adelaide, SA, Australia
Journal of educational evaluation for health professions
|October 30, 2024
概括
在评估放射图像定位质量方面,ChatGPT-4.0o的准确性有限. 人工智能模型往往只提供部分正确的解决方案,突出了对专家放射学家培训的持续需求.
科学领域:
- 医疗成像医学成像
- 医疗保健中的人工智能
- 放射学 质量保证 质量保证
背景情况:
- 评估放射图像质量对于准确诊断至关重要.
- 人工智能 (AI) 工具越来越多地被用于医学应用.
- 像ChatGPT-4.0o这样的先进AI模型在专业医疗任务中的性能仍在调查中.
研究的目的:
- 评估ChatGPT-4.0o在识别和纠正放射图像中的定位错误方面的有效性.
- 将人工智能生成的评估与专家放射学家的评估进行比较.
主要方法:
- 使用人形幻影,创建了各种解剖区域 (膝盖,肘部,脚,手,骨盆,肩部) 的30张放射图像.
- 聊天GPT-4.0o被提示检测定位错误,提供理由,并建议改进.
- 一个由放射学家组成的小组使用15尺度的既定定位标准对AI的性能进行了评分.
主要成果:
- 聊天GPT-4.0o正确地识别了所有定位错误,并提供了准确的改进,只有20%的情况.
- 最常见的分数是3 (30%),表明部分错误识别和正确的改进建议.
- 聊天GPT-4.0o的平均性能得分为2.9,表明整体精度较低.
结论:
- 在评估放射定位质量方面,ChatGPT-4.0o的准确性有限.
- 目前的人工智能能力需要进一步开发,以便在放射性质量控制中可靠使用.
- 这项研究强调了全面的放射学教育和临床经验不可或缺的作用.
相关概念视频
01:29Positron Emission Tomography
4.0K
Positron emission tomography (PET) is a medical imaging technique involving radiopharmaceuticals — substances that emit short-lived radiation. Although the first PET scanner was introduced in 1961, it took 15 more years before radiopharmaceuticals were combined with the technique and revolutionized its potential.
One of the main requirements of a PET scan is a positron-emitting radioisotope, which is produced in a cyclotron and then attached to a substance used by the part of the body...
One of the main requirements of a PET scan is a positron-emitting radioisotope, which is produced in a cyclotron and then attached to a substance used by the part of the body...
4.0K
01:10Computed Tomography
4.3K
Tomography refers to imaging by sections. Computed tomography (CT) is a non-invasive imaging technique that uses computers to analyze several cross-sectional X-rays to reveal minute details about structures in the body.
The technique was invented in the 1970s and is based on the principle that as X-rays pass through the body, they are absorbed or reflected at different levels. In the technique, a patient lies on a motorized platform while a computerized axial tomography (CAT) scanner rotates...
The technique was invented in the 1970s and is based on the principle that as X-rays pass through the body, they are absorbed or reflected at different levels. In the technique, a patient lies on a motorized platform while a computerized axial tomography (CAT) scanner rotates...
4.3K