在临床研究中评估人工智能的批判性评估工具:范围审查
Juan B Cabello1, Vicente Ruiz Garcia2, Miguel Torralba3
1Critical Appraisal Skills Program Spain, C/ Enriqueta Elizaizin, 2, E 5, 7C, Alicante, 03007, Spain, 34 619669243.
Journal of medical Internet research
|December 8, 2025
概括
该研究确定了46种评估人工智能 (AI) 在健康研究中的工具,报告指南是最常见的. 对人工智能研究的批判性评估需要解决公平性和偏见缓解问题,特别是对于聊天机器人.
科学领域:
- * * 卫生研究
- * 人工智能 (AI) 的人工智能
- * 临床决策能力
背景情况:
- * 预测性和生成性AI在健康研究中的使用越来越多.
- *人工智能研究中可能存在系统性错误,类似于传统的临床研究.
- * 需要关键评估工具来将AI证据转化为临床实践.
研究的目的:
- * 确定AI临床研究的现有关键评估工具.
- * 检查这些工具所涵盖的概念和领域.
- *使用人口概念背景 (PCC) 框架对研究问题进行框架.
主要方法:
- * 在医学和工程数据库 (MEDLINE,Embase,CINAHL,PsycINFO,IEEE) 进行搜索,截至2024年4月.
- *包括具有批判性评估工具的临床初级研究;不包括非人类研究.
- *遵守PRISMA-ScR和PRISMA-S指南;用于查使用Rayyan.
主要成果:
- *包括70个记录,确定了46个工具:26个报告指南,16个批判性评估工具,2个研究质量,2个偏见风险.
- *9篇论文集中在偏见分类或缓解上.
- *确定了15项聊天机器人评估研究/评论,显示了异质性.
结论:
- *报告工具占主导地位,其次是关键评估工具;偏见风险工具较少.
- * 批判性评估必须考虑AI特定的偏见,公平性和缓解策略.
- *聊天机器人评估是一个快速发展的领域,需要在设计,报告和评估方面取得紧急进展.
更多相关视频
12:18A Machine Learning Approach to Design an Efficient Selective Screening of Mild Cognitive Impairment
Published on: January 11, 2020
7.9K
06:11High-definition Transcranial Direct Current Stimulation over Right Dorsolateral Prefrontal Cortex to Enhance Metacognitive Sensitivity
Published on: September 26, 2025
768
相关概念视频
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
382
Biopharmaceutical studies constitute a vital field aiming to enhance drug delivery methods and refine therapeutic approaches, drawing upon diverse interdisciplinary knowledge. In research methodologies, the choice between controlled and non-controlled studies significantly influences the study's reliability and accuracy.
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
382
Issues And Trends In Healthcare Delivery System
6.1K
The issues and trends in healthcare delivery are constantly changing. The COVID-19 pandemic is one recent issue that wreaked havoc on healthcare systems, causing a shortage of healthcare workers, high demand for medicines and supplies, and increased medical expenditure due to a lack of insurance. Other issues include rising healthcare costs and care fragmentation.
Cost Containment
Payment for healthcare services has historically promoted adoption of costly and often unnecessary or inefficient...
Cost Containment
Payment for healthcare services has historically promoted adoption of costly and often unnecessary or inefficient...
6.1K
Clinical Trials
10.1K
Clinical trials are prospective experimental studies conducted on humans to determine the safety and efficacy of treatments, drugs, diet methods, and medical devices. Using statistics in clinical trials enables researchers to derive reasonable and accurate conclusions from the collected data, allowing them to make wise decisions in uncertain situations. In medical research, statistical methods are crucial for preventing errors and bias.
There are four phases in a clinical trial. A phase one...
There are four phases in a clinical trial. A phase one...
10.1K
Current Trends in Nursing II
3.3K
Trends in nursing are multifactorial and associated with changes in society, within the nursing profession, and in other professions. Notably, telehealth and remote nursing contribute to successful healthcare delivery for numerous patients and help reduce stress for nurses due to nursing shortages. Nurses can reach patients, monitor their conditions, and interact with them using computers, audio, visual accessories, and telephones—for example, remote patient monitoring systems. Likewise,...
3.3K
