相关实验视频

Updated: May 3, 2026

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Published on: December 6, 2024

由大型语言模型驱动的聊天机器人的能力,以支持范围审查的选过程:可行性研究

Kim Nordmann¹, Michael Schaller¹, Stefanie Sauter¹

¹Bavarian Research Center for Digital Health and Social Care, Kempten University of Applied Sciences, Kempten 87437, Germany.

|January 12, 2026

概括

与Rayyan相比,ChatGPT 4.0显著提高了范围审查选效率,显示出高精度和工作负载节省. 人类监督对于验证人工智能驱动的文献评估流程至关重要.

科学领域:

信息科学信息科学信息科学
医疗信息学医疗信息学
医疗保健中的人工智能

背景情况:

越来越多的科学出版物需要有效的方法来进行文献评论.
标题和摘要选是系统和范围审查中的一个主要瓶.
现有的半自动化工具在范围审查选方面表现出有限的成功.

研究的目的:

评估ChatGPT 4.0在标题和摘要选中的性能,以进行范围审查.
将ChatGPT 4.0的效率和准确性与半自动化工具Rayyan进行比较.
评估大型语言模型在简化文献评估方面的潜力.

主要方法:

一项回顾性研究使用了对15307份摘要的人类选决策作为基准.
对ChatGPT的快速工程和对Rayyan的培训是在100个抽象集上进行的.
性能指标 (准确度,灵敏度,特异性) 使用 Stata. 进行计算.

主要成果:

聊天GPT 4.0 选了 15,306 个摘要,表现优于 Rayyan.
聊天GPT 4.0实现了68%的准确性,67%的特异性和88%-89%的灵敏性.
观察到99%的负预测值和11%的假负率,节省了64%的工作负载.

结论:

聊天GPT显示了提高范围审查选的初始阶段的巨大潜力.
人类监督对于验证人工智能辅助的文献评估至关重要.
需要进一步的研究来标准化AI选工具的提示和参数.

关键词:

聊天GPT 聊天在GPT 聊天人工智能的人工智能是人工智能.自动化自动化自动化自动化大型语言模型范围审查范围审查审查查检查查检查查检查查检查

更多相关视频

Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems

Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems

Published on: June 13, 2025

相关概念视频

Stereotype Content Model

Stereotype Content Model

The Stereotype Content Model (SCM) was first proposed by Susan Fiske and her colleagues (Fiske, Cuddy, Glick & Xu, 2002; see also Fiske, 2012 and Fiske, 2017). The SCM specifies that when someone encounters a new group, they will stereotype them based on two metrics: warmth—or that group’s perceived intent, and how likely they are to provide help or inflict harm—and competence—or their ability to carry out that objective. Depending on the warmth-competence...

Higher Mental Functions of the Brain: Language

Higher Mental Functions of the Brain: Language

Language is a system of communication that allows the expression of thoughts, ideas, and feelings. The brain processes language in both hemispheres.
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...

Language and Cognition

Language and Cognition

Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.

Automatic Processing and Automatic Social Behavior

Automatic Processing and Automatic Social Behavior

Automatic processing refers to the cognitive operations that occur without conscious intent or awareness, playing a fundamental role in shaping social cognition and behavior. These processes enable individuals to navigate complex social environments efficiently by relying on mental shortcuts and pre-existing knowledge structures known as schemas. One of the most influential mechanisms underlying automatic processing is priming, which subtly activates mental representations through exposure to...