在临床环境中实施人工智能算法:准确性悖论的案例研究
John A Scaringi1, Ryan A McTaggart1, Matthew D Alvin1
1Department of Diagnostic Imaging, Warren Alpert Medical School of Brown University, Providence, RI, USA.
European radiology
|December 31, 2024
概括
一个用于检测大血管阻塞 (LVO) 的人工智能算法被认为是不准确的,原因是错误发现率很高,尽管整体准确性很高. 了解疾病患病率是AI工具在临床实践中采用的关键.
科学领域:
- 医疗成像医学成像
- 人工智能在医学中的应用
- 脑中风的诊断 脑中风的诊断
背景情况:
- 大血管闭塞 (LVO) 卒中需要快速诊断和治疗.
- 图像扫描血管造影 (CTA) 对于检测LVO非常重要.
- 人工智能算法在提高中风检测效率方面表现有前途.
研究的目的:
- 评估AI算法在紧急情况下检测LVO的性能.
- 了解为什么该算法受到放射学家的不好评.
- 确定影响人工智能诊断工具感知精度的因素.
主要方法:
- 一个单一的三级医院在CTA上部署了LVO检测算法.
- 一个回顾性分析评估了算法的灵敏度,特异性和预测值.
- 性能指标与制造商数据和当地疾病流行率进行了比较.
主要成果:
- 该算法在LVO检测方面实现了100%的灵敏度和92%的特异性.
- 在当地观察到高错误发现率 (67%) 和低积极预测值 (33%).
- 这些结果与制造商数据相对比,归因于较低的局部LVO流行率 (4.1%与45.0-62.2%相比).
结论:
- 人工智能算法被认为是不准确的,原因是高错误发现率,尽管客观准确性.
- "准确性悖论" (一种基本利率谬误形式) 可能导致了误解.
- 基于本地疾病患病率的AI性能指标的呈现对于现实的期望和成功的临床整合至关重要.
更多相关视频
09:52Setting Up a Stroke Team Algorithm and Conducting Simulation-based Training in the Emergency Department - A Practical Guide
Published on: January 15, 2017
17.2K
06:32Author Spotlight: Automated Deep Brain Stimulation for Parkinson's Disease - Exploring the Possibilities and Challenges of Home Monitoring
Published on: July 14, 2023
1.2K
相关概念视频
Documentation of Nursing Diagnosis
1.2K
The nurse documents nursing diagnoses and enters them into the patient record. The identified patient's nursing diagnosis is either written out with a plan of care or entered into the electronic health record.
In some settings, data-driven computerized decision support systems are in place, allowing for more accurate nursing diagnoses. The database within one of these systems includes diagnostic labels defining characteristics, activities, and indicators for nursing. A nurse enters...
In some settings, data-driven computerized decision support systems are in place, allowing for more accurate nursing diagnoses. The database within one of these systems includes diagnostic labels defining characteristics, activities, and indicators for nursing. A nurse enters...
1.2K
Methods of Documentation VI: Case Management Model
564
The case management model is a multidisciplinary approach that involves healthcare professionals from diverse disciplines, such as physicians, nurses, therapists, social workers, and pharmacists, working collaboratively to address the various needs of patients. Each healthcare professional brings unique expertise and perspectives, contributing to a more comprehensive understanding of the patient's condition and tailoring treatment plans accordingly.
For example, a patient with a chronic...
For example, a patient with a chronic...
564
Case Studies
11.6K
There are many research methods available to psychologists in their efforts to understand, describe, and explain behavior and the cognitive and biological processes that underlie it.
11.6K
