评估人工智能软件在追溯真实世界英国人口的胸部X射线上检测肺结节的性能
Ahmed Maiter1,2, Katherine Hocking2, Suzanne Matthews2,3
1School of Medicine and Population Health, The University of Sheffield, Sheffield, UK.
BMJ open
|November 8, 2023
概括
商业人工智能 (AI) 软件用于在胸部放射图上检测肺癌,在现实世界的英国研究中表现不佳. 人工智能工具的积极预测值很低,可能会导致不必要的患者调查,并限制临床使用.
科学领域:
- 医疗成像医学成像
- 医疗保健中的人工智能
- 在瘤学瘤学.
背景情况:
- 在胸部放射图上早期检测肺癌对于患者的治疗结果至关重要.
- 人工智能 (AI) 工具为提高诊断准确性和简化肺癌检测途径提供了潜力.
研究的目的:
- 为了评估商业上可用的基于人工智能的软件的实际性能,该软件旨在识别胸部X射线图上的癌症肺结节.
主要方法:
- 对来自英国初级保健机构的5722张胸部X射线进行了回顾性分析.
- 人工智能软件独立评估了放射图,并将输出与放射科医生报告和多学科团队癌症诊断进行了比较.
- 故障分析检查了X射线图上的软件标记位置,以了解差异.
主要成果:
- 与放射科医生报告相比,AI软件的灵敏度为54.5%,特异性为83.2%.
- 与癌症诊断相比,灵敏度为60.9%,特异性为83.3%,阳性预测值 (PPV) 低至5.6%.
- 错误阳性发生率很高,在69.9%的病例中,正常解剖被误认为异常.
结论:
- 人工智能软件在这个现实世界队列中表现明显不佳,可能是因为其训练数据缺乏概括性.
- 低PPV带来了过度调查的风险,阻碍了软件的临床翻译.
- 研究结果强调,人工智能工具需要在代表性数据集上进行培训和验证,以便在医学成像中有效实施.
相关概念视频
Radiological Investigation I: X-ray and CT
249
Radiological investigations, including X-rays and computed tomography (CT) scans, are critical for diagnosing and evaluating various medical conditions. These imaging techniques provide valuable insights into the body's internal structures, aiding in the detection of abnormalities, assessment of disease progression, and development of treatment strategies. This article delves into two primary radiological investigations, chest X-rays and CT scans, outlining their purpose, procedures, and...
249
Radiological Investigation III: Pulmonary Angiogram and PET Scan
97
Radiological investigations are paramount in the diagnosis and management of various pulmonary diseases. Two essential investigations are the Pulmonary Angiogram and the Positron Emission Tomography (PET) Scan.
Pulmonary Angiogram
A Pulmonary Angiogram is an invasive procedure involving injecting a contrast medium through a catheter threaded into the pulmonary artery or the right side of the heart to visualize the pulmonary vasculature. Computed Tomography (CT) scans have mainly replaced this...
Pulmonary Angiogram
A Pulmonary Angiogram is an invasive procedure involving injecting a contrast medium through a catheter threaded into the pulmonary artery or the right side of the heart to visualize the pulmonary vasculature. Computed Tomography (CT) scans have mainly replaced this...
97


