大規模な言語モデルは,患者が提起する医学的な質問に対する不確実な答えを提供します
Rachel L Draelos1, Samina Afreen2, Barbara Blasko3
1Glass Box Medicine, Durham, NC, USA. rachel.draelos@glassboxmedicine.com.
NPJ digital medicine
|February 13, 2026
まとめ
人工知能のチャットボットから医療の助言を求める何百万人もの患者は,安全リスクに直面しています. ある研究では,チャットボットの安全性において大きな違いが認められ,一部のチャットボットが潜在的に有害な医療情報を提供していることが判明した.
科学分野:
- 医療における人工知能
- 医療情報工学 医療情報工学
- 患者の安全性についてです.
背景:
- 大型言語モデル (LLM) のチャットボットは,医療アドバイスのために患者によってますます使用されています.
- この広範な使用は,AIによって生成された健康情報の正確性と信頼性に関して,患者の安全性に関する重大な懸念を提起しています.
研究 の 目的:
- 公開されている4つの主要なLLMチャットボット (Claude, Gemini, GPT-4o, Llama-3.0/3.1-70B) の臨床安全性を比較する.
- 新しいデータセットと堅牢な評価フレームワークを使用して,医療アドバイスを求める質問に対するチャットボットの回答を評価します.
主な方法:
- 医者が率いるレッドチーム研究が行われました.
- HealthAdviceというデータセットが利用され,初等医療,内科,女性の健康,小児科の222件の患者からの医療質問が含まれていました.
- 合計888件のチャットボット応答を定量的かつ質的に分析した.
主要な成果:
- チャットボット応答の安全性において統計的に有意な差異が観察されました.
- 問題のある回答の割合は,21.6% (クロード) から43.2% (ラマ) であった.
- 不安全な反応は5% (クロード) から13% (GPT-4o,ラマ) であったが,定性分析では重篤な患者に害を与える可能性があることが明らかになった.
結論:
- 何百万もの患者が,一般に利用可能なAIチャットボットから不安全な医療アドバイスを受けている可能性があります.
- LLMベースの医療アドバイスツールの臨床安全性と信頼性を高めるために,さらなる研究開発が不可欠です.
さらに関連する動画
10:15Utilizing Repetitive Transcranial Magnetic Stimulation to Improve Language Function in Stroke Patients with Chronic Non-fluent Aphasia
Published on: July 2, 2013
18.4K
05:54MRI-guided Focused Ultrasound Thalamotomy for Patients with Medically-refractory Essential Tremor
Published on: December 13, 2017
14.9K
関連する概念動画
Language
924
Language is a unique communication system that uses words and systematic rules to organize and transmit information. Unlike other forms of communication, which may involve postures, movements, odors, or vocalizations, language relies on symbols and grammar. This makes human communication distinct from that of other species, who also communicate but do not use language in the same way humans do.
Corballis and Suddendorf (2007) and Tomasello and Rakoczy (2003) highlight the role of language in...
Corballis and Suddendorf (2007) and Tomasello and Rakoczy (2003) highlight the role of language in...
924
Components of Language
831
Language, whether spoken, signed, or written, consists of specific components: lexicon and grammar. The lexicon is the vocabulary of a language, comprising its words. Grammar is the set of rules used to convey meaning through the lexicon. For example, English grammar adds “-ed” to most verbs to indicate past tense. Words are formed by combining phonemes, which are the basic sound units of a language. Different languages have different sets of phonemes (e.g., “ah” vs.
831
Language Development
941
Children master language quickly and with relative ease, supported by both biological predisposition and reinforcement. B. F. Skinner (1957) proposed that language is learned through reinforcement, while Noam Chomsky (1965) argued that language acquisition mechanisms are biologically determined.
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
941
Language and Cognition
820
Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.
820
Inhaled Medications
840
Inhaled medications are crucial for managing chronic obstructive pulmonary disease (COPD) and asthma. They are essential for effective treatment and control, ensuring optimal respiratory health and well-being. Inhaled medication delivers drugs directly to the lungs, providing a rapid onset of action and reducing systemic side effects compared to oral or injectable medications. Three primary types of inhalation devices are used to administer these medications: nebulizers, metered-dose inhalers...
840
Higher Mental Functions of the Brain: Language
3.9K
Language is a system of communication that allows the expression of thoughts, ideas, and feelings. The brain processes language in both hemispheres.
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
3.9K
