在精神病学文献搜索中,ChatGPT和Bard在精神病学文献搜索中展示了自发的引用伪造
Alessia McGowan1, Yunlai Gui1, Matthew Dobbs1
1Icahn School of Medicine at Mount Sinai, New York, NY, USA.
Psychiatry research
|July 27, 2023
概括
像ChatGPT这样的大型语言模型可以产生不准确的引用,在测试中,35个中只有2个是真实的. 研究人员发现,这些人工智能生成的参考文献往往是伪造的或歪曲了现有研究,突出了需要验证的需要.
科学领域:
- 人工智能的人工智能
- 自然语言处理自然语言处理.
- 信息科学 信息科学 信息科学
背景情况:
- 像ChatGPT这样的大型语言模型 (LLM) 越来越多地用于信息检索.
- 评估LLM产生的内容的可靠性,特别是在学术环境中,至关重要.
- 引用准确性对于文献搜索和学术诚信至关重要.
研究的目的:
- 为了评估ChatGPT生成的参考文献的准确性,用于文学搜索.
- 为了比较ChatGPT和谷歌的Bard 2.0.0.的引用生成性能.
- 分析伪造引用的性质,并讨论潜在的原因和解决方案.
主要方法:
- 在2023年3月与ChatGPT进行交换,以生成引用.
- 重新测试了ChatGPT,并于2023年6月在英语,西班牙语和意大利语中测试了Bard 2.0.
- 分析生成引用的准确性和性质,将其分类为真实,类似或伪造的.
主要成果:
- 聊天GPT生成了35个引用;只有2个是准确的.
- 12个引用与真实手稿相似,但包含错误;21个是伪造的.
- 性能测试用英语,西班牙语和意大利语进行,并观察到跨语言的伪造.
结论:
- 像ChatGPT和Bard 2.0这样的对话式LLM产生了不可靠的,通常是伪造的引用.
- "幻觉"一词可能是人工智能产生的事实错误的错称.
- 来自LLM的输出,特别是用于学术目的,需要用户严格验证.
关键词:
人工智能的人工智能是人工智能.巴尔德巴尔德 巴尔德巴尔德是什么意思聊天GPT 聊天 在GPT 聊天引用 引用 引用 引用 引用制造工艺 制造工艺 制造工艺大型语言模型.语言学 语言学在文献搜索中搜索文献.自然语言处理自然语言处理.引用 引用 引用 引用更多相关视频
05:47Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems
Published on: June 13, 2025
296
07:31Implementation of a Real-Time Psychosis Risk Detection and Alerting System Based on Electronic Health Records using CogStack
Published on: May 15, 2020
7.1K
相关概念视频
Contemporary Psychology
609
Psychology explores human behavior and mental processes through various lenses, each offering unique insights. This overview examines key subfields, including biopsychology, evolutionary, developmental, personality, and social psychology, highlighting their approaches and contributions to understanding complex human behaviors.
Biopsychology
Biopsychology, also known as biological psychology or behavioral neuroscience, focuses on the biological underpinnings of behavior and mental processes. It...
Biopsychology
Biopsychology, also known as biological psychology or behavioral neuroscience, focuses on the biological underpinnings of behavior and mental processes. It...
609
Freudian Psychology
711
Sigmund Freud, an Austrian neurologist born in 1856, significantly influenced psychology through his exploration of the unconscious mind. His interest in patients suffering from hysteria and neurosis — conditions without apparent physical causes — led him to theorize the existence of an unconscious mind, a repository for feelings and urges beyond our awareness. Freud's innovative approach included techniques such as dream analysis, free association, and attention to slips of the...
711
Pharmacovigilance
891
Post-marketing surveillance is a critical component of pharmaceutical regulation, often uncovering unanticipated adverse drug reactions (ADRs) once a drug is widely used over an extended period.
This process, termed pharmacovigilance, aims to detect, evaluate, and minimize harmful effects related to medication use. The data collection for pharmacovigilance depends on spontaneous reporting systems, where healthcare professionals or patients voluntarily report suspected ADRs.
In some cases, there...
This process, termed pharmacovigilance, aims to detect, evaluate, and minimize harmful effects related to medication use. The data collection for pharmacovigilance depends on spontaneous reporting systems, where healthcare professionals or patients voluntarily report suspected ADRs.
In some cases, there...
891
Psychology as a Science
753
Psychology, as a scientific discipline, aims to understand the mind and behavior through rigorous and systematic methods. The foundation of psychological research is evidence-based, relying heavily on the scientific method to derive and validate knowledge. This structured approach ensures that findings are reliable, valid, and applicable to broader contexts.
The scientific method in psychology involves six critical steps: making observations, formulating hypotheses, conducting tests, analyzing...
The scientific method in psychology involves six critical steps: making observations, formulating hypotheses, conducting tests, analyzing...
753
Clinical Trials
6.9K
Clinical trials are prospective experimental studies conducted on humans to determine the safety and efficacy of treatments, drugs, diet methods, and medical devices. Using statistics in clinical trials enables researchers to derive reasonable and accurate conclusions from the collected data, allowing them to make wise decisions in uncertain situations. In medical research, statistical methods are crucial for preventing errors and bias.
There are four phases in a clinical trial. A phase one...
There are four phases in a clinical trial. A phase one...
6.9K
SBAR II: Application of SBAR
4.5K
SBAR is an effective communication tool used by healthcare professionals to communicate patient information accurately. SBAR stands for Situation, Background, Assessment, and Recommendation. For a better understanding, an example is given below.
SBAR Report from a Nurse to a Health Care Provider
S: "Hello, Dr. Smith. This is Jane, RN, from the Med Surg unit. I am calling to tell you about Ms. White in Room 210, who is experiencing increased pain and redness at her incision site. Her recent...
SBAR Report from a Nurse to a Health Care Provider
S: "Hello, Dr. Smith. This is Jane, RN, from the Med Surg unit. I am calling to tell you about Ms. White in Room 210, who is experiencing increased pain and redness at her incision site. Her recent...
4.5K
