MedVH:在医学背景下对大视觉语言模型的系统评估
Zishan Gu1,2, Jiayuan Chen1,2, Fenglin Liu3
1Department of Computer Science and Engineering, The Ohio State University, Columbus, Ohio 43210, USA.
概括
医疗大视觉语言模型 (LVLMs) 显示出高幻觉倾向,甚至比一般模型更高. 需要像MedVH这样的新评估框架来确保临床环境的可靠性.
科学领域:
- 人工智能
- 医疗信息学
- 计算机视觉
背景情况:
- 大视觉语言模型 (LVLM) 在自然图像和文本任务中表现出色.
- 在临床环境中对LVLM的强度不足.
- 现有的评估没有充分解决医疗特异性幻觉.
研究的目的:
- 介绍医学视觉幻觉测试 (MedVH) 的框架.
- 评估医疗和一般 LVLM 的幻觉倾向.
- 为未来可靠的医疗人工智能研究提供基础.
主要方法:
- 开发了一种新的医疗视觉幻觉评估框架.
- 包含六个任务:两个传统任务和四个新任务 (多选项VQA,长时间响应生成).
- 在各种LVLM中实验了六个评估指标.
主要成果:
- 医疗 LVLM 具有显著的幻觉易感性,通常超过一般模型.
- 尽管在标准的医疗任务中表现强,但特定领域的模型显示出更高的幻觉率.
- 这突显了有关专业医疗人工智能的可靠性.
结论:
- 医疗 LVLM 需要强有力的推理来防止幻觉并准确地整合医学知识.
- 在没有微调的情况下缓解幻觉.
- 在PhysioNet上提供MedVH数据集以进行进一步研究.
更多相关视频
相关概念视频
Positive Symptoms Schizophrenia: Hallucinations and Delusions
131
Schizophrenia is a complex psychiatric disorder characterized by a range of symptoms that significantly impact cognition, behavior, and emotional regulation. Among these, the positive symptoms stand out as they involve the addition or exaggeration of normal mental functions, deviating markedly from typical behavior and perception. Hallucinations and delusions are prominent positive symptoms, each profoundly affecting the individual's experience of reality.
Hallucinations
Hallucinations in...
Hallucinations
Hallucinations in...
131
Positive Symptoms of Schizophrenia: Hallucinations and Delusions
217
Schizophrenia is a complex mental health disorder that can manifest with various positive symptoms, including thought, movement, and behavior disorders. These symptoms significantly disrupt cognitive and motor functions, leading to profound effects on an individual's ability to engage with the world.
Thought Disorders
Disorganized and unusual thought processes mark thought disorders in schizophrenia. One key feature is disorganized speech, where an individual's conversation includes...
Thought Disorders
Disorganized and unusual thought processes mark thought disorders in schizophrenia. One key feature is disorganized speech, where an individual's conversation includes...
217
Hallucinogens and Psychedelics
284
Hallucinogens are psychoactive substances that profoundly alter perceptual experiences, generating unreal visual and sensory images. Often referred to as psychedelic drugs — a term derived from the Greek words "psyche" (mind) and "delos" (revealing) — these substances include marijuana and lysergic acid diethylamide (LSD), among others. These drugs vary in intensity and effects.
Marijuana, derived from the dried leaves and flowers of the hemp plant, contains...
Marijuana, derived from the dried leaves and flowers of the hemp plant, contains...
284


