计算机辅助肺结节检测软件的现实世界评估 灵敏度和假阳性率
Raquelle El Alam1,2, Khushboo Jhala1,2, Mark M Hammer1,2
1Department of Radiology, Brigham and Women's Hospital.
Journal of thoracic imaging
|May 12, 2025
概括
结节检测软件在实际使用中显示出比最初报告的更高的假阳性率 (FPR). 然而,其检测恶性肺结节的灵敏度仍然与无助放射科医生的灵敏度相当.
科学领域:
- 放射学 放射学是一门学科.
- 医疗成像医学成像
- 人工智能在医学中的应用
背景情况:
- 结节检测软件旨在提高肺癌查准确度.
- 之前的研究报告了这种软件的低虚假阳性率 (FPR).
- 现实世界的验证对于评估超出受控环境的性能至关重要.
研究的目的:
- 在临床环境中评估ClearRead结节检测系统的实际假阳性率 (FPR).
- 为了比较软件的现实世界FPR与最初发布的FPR.
- 评估软件在检测恶性肺结节方面的灵敏度.
主要方法:
- 使用ClearRead软件分析了229张胸部CT扫描.
- 检测到的发现被一个胸部成像研究员分类.
- 假阳性率 (FPR) 计算并与文献值进行比较.
- 软件和无助放射科医生的恶性结节检测率被记录下来.
主要成果:
- 该软件平均每次扫描产生2.59个发现.
- 现实世界的FPR为1.36,明显高于公布的0.58 (P<0.0001).
- 考虑到小于6毫米的结节是错误的阳性,FPR增加到2.19.
- 软件检测到87%的恶性结节,类似于无助放射科医生 (93%).
结论:
- 在现实临床实践中,ClearRead结节检测系统的PFR比以前报告的要高得多.
- 尽管增加了FPR,但该软件在识别恶性肺结节时对放射科医生具有相似的灵敏度.
- 这些发现强调了需要在不同的临床环境中仔细验证人工智能工具的必要性.
相关概念视频
Sensitivity, Specificity, and Predicted Value
138
In healthcare diagnostics, laboratory tests play a crucial role in identifying and diagnosing a wide range of medical conditions. However, interpreting test results is not always straightforward. An abnormal test result does not always confirm the presence of a disease, just as a normal result does not guarantee its absence. To assess the reliability of these diagnostic tools, healthcare practitioners rely on two key statistical indicators: sensitivity and specificity.
Sensitivity is the...
Sensitivity is the...
138
Receiver Operating Characteristic Plot
65
A ROC (Receiver Operating Characteristic) plot is a graphical tool used to assess the performance of a binary classification model by illustrating the trade-off between sensitivity (true positive rate) and specificity (false positive rate). By plotting sensitivity against 1 - specificity across various threshold settings, the ROC curve shows how well the model distinguishes between classes, with a curve closer to the top-left corner indicating a more accurate model. The area under the ROC curve...
65
Radiological Investigation III: Pulmonary Angiogram and PET Scan
73
Radiological investigations are paramount in the diagnosis and management of various pulmonary diseases. Two essential investigations are the Pulmonary Angiogram and the Positron Emission Tomography (PET) Scan.
Pulmonary Angiogram
A Pulmonary Angiogram is an invasive procedure involving injecting a contrast medium through a catheter threaded into the pulmonary artery or the right side of the heart to visualize the pulmonary vasculature. Computed Tomography (CT) scans have mainly replaced this...
Pulmonary Angiogram
A Pulmonary Angiogram is an invasive procedure involving injecting a contrast medium through a catheter threaded into the pulmonary artery or the right side of the heart to visualize the pulmonary vasculature. Computed Tomography (CT) scans have mainly replaced this...
73


