数据管道质量:为医疗保健中的数据驱动算法和人工智能开发和验证质量评估工具
Eris van Twist1, Brian van Winden2, Rogier de Jonge2
1Department of Neonatal and Pediatric Intensive Care, Division of Pediatric Intensive Care, Erasmus MC, Rotterdam, The Netherlands e.vantwist@erasmusmc.nl.
BMJ health & care informatics
|February 2, 2026
概括
一个名为DATA-CARE的新工具使得医疗保健算法的标准化质量评估成为可能. 它发现大多数研究的数据管道质量低至中等,阻碍了临床使用.
科学领域:
- 医疗保健技术评估 医疗保健技术评估
- 医疗信息学医学信息学
- 算法验证算法的验证.
背景情况:
- 数据驱动的算法在医疗保健中越来越多地使用.
- 缺少这些算法的标准化质量评估工具,特别是它们的数据管道.
- 现有的工具不能充分解决AI的细微差别和医疗保健中的观察性研究.
研究的目的:
- 开发和验证用于数据驱动医疗保健算法的标准化质量评估工具.
- 将评估工具集中在这些算法的关键数据管道上.
- 解决算法开发中可靠评估的需求.
主要方法:
- 开发了用于算法批判性评估和强有力的证据的数据评估工具 (DATA-CARE).
- DATA-CARE基于预测研究中的质量框架,并审查了10个现有工具.
- 该工具评估了五个领域:人口,数据,算法,结果和报告透明度,总分为75分.
- 验证涉及对儿科重症监护室算法的系统审查,有两个独立审查员和ICC分析.
主要成果:
- DATA-CARE显示了高的互评分协议 (93.5%) 和0.98.9的ICC.
- 在验证中,审查了31项研究,其中大多数显示质量低 (32.3%) 或中度 (41.9%).
- 只有25.8%的研究被评为高质量.
结论:
- 低到中等质量的研究的流行凸显了在临床实践中实施数据驱动算法的重大障碍.
- 关键问题包括数据采集/处理不良,验证不充分,报告不透明等.
- DATA-CARE提供了一种标准化,可靠的算法评估方法,填补了可重复性研究中的关键空白.
相关概念视频
Data Validation
1.8K
Method validation is a crucial process in analytical chemistry designed to confirm that a given method consistently produces reliable and high-quality results. This process is essential when a method is applied to different sample matrices or when procedural modifications are made, ensuring that the results meet acceptable standards across various applications.
Key parameters for method validation include:
Key parameters for method validation include:
1.8K
Data Validation
6.8K
Data validation is an essential part of a comprehensive assessment. Validation is confirming or verifying and opening the door to gathering more assessment data as it clarifies vague or unclear data. The process of checking and verifying the collected information is called data validation. The primary purpose of data validation is to ensure data is as free from error, bias, and misinterpretation as possible.
Nursing assessment guides are generally based on holistic models rather than medical...
Nursing assessment guides are generally based on holistic models rather than medical...
6.8K
Data Reporting and Recording
5.4K
Reporting and recording are crucial in data documentation. The timely, thorough, and accurate documentation of facts is essential when recording patient data. Failure to record findings during an assessment or interpretation of a problem will result in loss of information and make the patient document unreliable. The reader is left with general impressions if the information is not specific. A recording is documenting data of the individual's health information in a traceable, secure, and...
5.4K
Overview of Microsoft Excel as a Data Analysis Tool
1.6K
Microsoft Excel is a cornerstone tool for data analysis and statistical operations, offering a wide array of functionalities to manage, analyze, and visualize data efficiently. Recognized for its versatility, Excel facilitates the performance of basic to complex statistical operations, serving as an indispensable asset for analysts, researchers, and students alike. Excel's significance in data analysis emanates from its spreadsheet environment, where data can be organized in rows and...
1.6K
Quality Control
2.5K
Quality control is one of the three cyclical quality assurance activities that help keep a system under statistical control. Typical quality control activities include creating quality control charts, conducting proficiency testing, and documenting and archiving results.
Quality control helps track data, visualize trends, and identify variations, making it easier to detect deviations that may affect the accuracy of an analysis. One way to do this is by generating a quality control chart, which...
Quality control helps track data, visualize trends, and identify variations, making it easier to detect deviations that may affect the accuracy of an analysis. One way to do this is by generating a quality control chart, which...
2.5K
Quality Assurance
2.2K
Quality assurance is the overarching term used to describe the activities employed to ensure the proper performance of a system. These activities can be classified into three categories: quality control, quality assessment, and internal corrective measures. Typically, these activities work cyclically: quality control is performed before and during the analysis, while quality assessment occurs during and after the investigation. Internal corrective measures are implemented based on the findings...
2.2K


