在现有的人工智能报告准则中缺乏方法论严谨性和有限的生成人工智能覆盖范围:范围审查
Xufei Luo1, Bingyi Wang1, Qianling Shi2
1Evidence-Based Medicine Center, School of Basic Medical Sciences, Lanzhou University, Lanzhou, China; Research Unit of Evidence-Based Evaluation and Guidelines, Chinese Academy of Medical Sciences (2021RU017), School of Basic Medical Sciences, Lanzhou University, Lanzhou, China; World Health Organization Collaboration Center for Guideline Implementation and Knowledge Translation, Lanzhou, China; Institute of Health Data Science, Lanzhou University, Lanzhou, China; Key Laboratory of Evidence Based Medicine of Gansu Province, Lanzhou University, Lanzhou, China.
现有的医疗人工智能 (AI) 报告准则缺乏严格性,并且不充分涵盖诸如大语言模型 (LLM) 等生成性AI (GAI) 工具. 需要更新指南,以改善开发流程,并专注于新兴的人工智能技术.
科学领域:
- 医疗信息学 医疗信息学
- 医疗保健中的人工智能
- 卫生研究方法论 卫生研究方法论
背景情况:
- 报告准则对于医学中人工智能 (AI) 的透明和可重复的发展至关重要.
- 现有的指导方针可能无法充分解决新兴人工智能技术带来的独特挑战,例如生成人工智能 (GAI).
研究的目的:
- 系统地审查医学当前AI报告准则的开发方法,范围和局限性.
- 评估现有指南对生成性AI (GAI) 工具的适用性,包括大型语言模型 (LLM).
主要方法:
- 根据PRISMA扩展范围审查 (PRISMA-ScR) 进行了范围审查.
- 在五个数据库 (MEDLINE,EQUATOR网络,CNKI,FAIRsharing,谷歌学者) 进行了搜索,截至2024年12月31日.
- 数据的提取和分析是由两个独立的审查员进行的,其中的差异由第三名审查员解决.
主要成果:
- 确定了68条AI报告准则,其中只有7.4%专门针对GAI/LLMs.
- 方法严谨性是有限的:39.7%描述了开发过程,42.6%涉及多学科专家,33.8%遵循了EQUATOR的建议.
- 针对GAI的具体指南显示,覆盖范围和透明度不足,医疗成像等领域的重叠很大.
结论:
- 当前医学AI报告指南显示,AI的方法严谨性,冗余性和不充分的覆盖范围都不足.
- 未来的指导方针必须强调标准化的开发,多学科的投入,以及更广泛的范围,包括先进的AI技术,如LLMs.
相关概念视频
Non-equilibrium in the Cell
Ethics in Research
Guidelines for Writing Outcome
Patient outcomes reflect the patient's response to the goal rather than what the nurse aims to achieve. Terminology should be observable and measurable to avoid the reader's interpretation. The desired outcome should be realistic and achievable in the designated care timeframe. Expected outcomes should align with adjunctive therapies. The outcome should enhance care...
Systematic Error: Methodological and Sampling Errors
Sampling errors originate from improper sampling methods or the wrong sample population. These errors can be minimized by refining the sampling strategy. Defective instruments or faulty calibrations are the sources of instrumental...
Ethical Standards I
The Code of Ethics provisions outline the nurse's duty to the patient, the healthcare team, the profession, and society. The Code's fundamental principles include advocacy,...
Ethical Issues
Ethical Concerns in Healthcare:


