相关实验视频

Updated: Jul 2, 2025

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Published on: December 6, 2024

一个评估临床人工智能系统的框架,没有基准真相注释

Dani Kiyasseh¹, Aaron Cohen^2,3, Chengsheng Jiang²

¹Cedars-Sinai Medical Center, Los Angeles, CA, USA. danikiy@hotmail.com.

Nature communications

|February 28, 2024

概括

一个名为SUDO的新框架在真实世界的数据上评估临床人工智能 (AI) 系统. SUDO有助于识别不可靠的AI预测,并评估算法偏差,而不需要基本真相标签.

科学领域:

医疗人工智能医疗人工智能
临床AI验证临床AI验证
算法偏差评估算法偏差评估

背景情况:

临床人工智能系统通常在保留数据上进行验证,这些数据可能不反映真实世界的数据分布.
估计人工智能在自然环境中的表现是具有挑战性的,因为分布的变化和缺乏基准真理注释.

研究的目的:

介绍SUDO,这是一个新的框架,用于评估AI系统在现实世界临床环境中遇到的数据.
展示SUDO在评估人工智能性能,选择模型和识别算法偏差而没有基本真相数据方面的实用性.

主要方法:

开发并应用SUDO框架来评估跨不同临床数据类型的AI系统.
实验包括人工智能系统用于皮肤学图像,组织病理学补丁和临床笔记.
苏多 (SUDO) 评估了人工智能性能和对"野外"数据的偏见.

主要成果:

在真实世界的临床数据中,SUDO有效地识别了不可靠的AI预测.
该框架有助于选择合适的AI模型进行部署.
SUDO 能够对在未见数据上运行的人工智能系统中的算法偏差进行评估.

结论:

SUDO提供了一种强大的方法来评估临床人工智能系统对野生数据的评估.
该框架支持在医学中开发可靠和道德的人工智能.
SUDO解决了临床应用当前人工智能验证实践中的关键局限性.

更多相关视频

Author Spotlight: Advancing CBCT and Digital Dental Image Integration with AI-Assisted Digitization

Author Spotlight: Advancing CBCT and Digital Dental Image Integration with AI-Assisted Digitization

Published on: February 23, 2024

TBase - an Integrated Electronic Health Record and Research Database for Kidney Transplant Recipients

TBase - an Integrated Electronic Health Record and Research Database for Kidney Transplant Recipients

Published on: April 13, 2021

相关概念视频

Nursing Clinical Information System

Nursing Clinical Information System

Nursing Clinical Information System (NCIS)
A Nursing Clinical Information System (NCIS) is a specialized type of healthcare information system tailored to meet the unique needs of nursing practice. It incorporates the principles of nursing informatics to streamline information management and improve the quality of care delivery.
Critical attributes of NCIS include:

Issues And Trends In Healthcare Delivery System

Issues And Trends In Healthcare Delivery System

The issues and trends in healthcare delivery are constantly changing. The COVID-19 pandemic is one recent issue that wreaked havoc on healthcare systems, causing a shortage of healthcare workers, high demand for medicines and supplies, and increased medical expenditure due to a lack of insurance. Other issues include rising healthcare costs and care fragmentation.
Cost Containment
Payment for healthcare services has historically promoted adoption of costly and often unnecessary or inefficient...