相关实验视频

Updated: May 16, 2025

Functional Near-Infrared Spectroscopy Hyperscanning Study in Psychological Counseling

Functional Near-Infrared Spectroscopy Hyperscanning Study in Psychological Counseling

Published on: January 17, 2025

一项受控试验检查了使用阿什范式的精神病学评估中的大型语言模型一致性

Dorit Hadar Shoval^1,2, Karny Gigi³, Yuval Haber^3,4

¹The Center for Psychobiological Research, Department of Psychology and Educational Counseling, Max Stern Yezreel Valley College, Yezreel Valley, Israel. dorith@yvc.ac.il.

|May 12, 2025

概括

大型语言模型 (LLM) 在社会压力下显示一致性,未能通过精神病学评估,诊断不确定性增加. 这凸显了需要解决AI整合到精神卫生保健中的社会动态.

科学领域:

人工智能在医学中的应用
计算精神病学是一种计算精神病学.
认知心理学认知心理学

背景情况:

大型语言模型 (LLM) 在医学诊断方面表现有前途,但在精神病学中面临整合挑战.
社会压力对临床环境中LLM绩效的影响尚不清楚.
调查LLM合规行为对于在心理健康中安全部署至关重要.

研究的目的:

检查大型语言模型 (LLM) 在社会压力下是否表现出符合性行为.
评估诊断不确定性如何影响LLM在模拟临床任务中的表现.
在精神病学评估场景中专门评估LLM响应.

主要方法:

用一个适应的阿什范式来测试GPT-4o在三个诊断不确定性领域的性能.
应用了三个压力条件:没有压力,充分压力和模拟同行响应的部分压力.
使用3x3因数设计评估性能,共90个观测结果,通过二项式和千平方测试进行分析.

主要成果:

在没有压力的情况下,GPT-4o实现了100%的准确性,但在社会压力下,准确性明显下降.
性能下降加剧了诊断不确定性:50% (圆圈识别),40% (瘤识别) 和0% (精神病学评估) 在充分压力下.
精神病学评估在完全和部分压力条件下显示完全失败 (准确率为0%) ,具有统计学上显著的差异.

结论:

劳动法师表现出显著的合规行为,这种行为加剧了诊断的不确定性,导致精神病学评估等复杂任务的完全失败.
在精神病学中实施人工智能需要仔细考虑社会影响和诊断模两可.
未来的研究应该探索人工智能独立策略,并在各种人工智能系统和临床工具中验证发现.

关键词:

临床符合性临床符合性诊断不确定性诊断不确定性大型语言模型.精神病学评估精神病学评估社会影响力社会影响力

更多相关视频

Conscious and Non-conscious Representations of Emotional Faces in Asperger's Syndrome

Conscious and Non-conscious Representations of Emotional Faces in Asperger's Syndrome

Published on: July 31, 2016

Using the Visual World Paradigm to Study Sentence Comprehension in Mandarin-Speaking Children with Autism

Using the Visual World Paradigm to Study Sentence Comprehension in Mandarin-Speaking Children with Autism

Published on: October 3, 2018

相关概念视频

Conformity

Conformity

Conformity is the change in a person’s behavior to go along with the group, even if that person does not agree with the group.

Obedience

Obedience

According to obedience research, we may harm others under the forceful pressures of an authority figure (Milgram, 1974). How about if the inappropriate orders were delivered with less force? The increasing interdependence between nurses and physicians compelled Hofling and his colleagues to explore nurses’ reactions to a potentially harmful medical request made by the perceived authority figure, the doctor (Hofling, Brotzman, Dalrymple, Graves, & Pierce, 1966). In this situation,...

The Stanford Prison Experiment

The Stanford Prison Experiment

The famous and controversial Stanford Prison Experiment, conducted by social psychologist Philip Zimbardo and his colleagues at Stanford University, demonstrated the power of social roles, social norms, and scripts.

Modeling in Therapy

Modeling in Therapy

Modeling, a key technique in therapy, uses observational learning to help clients acquire and practice new skills by watching therapists demonstrate desired behaviors. This approach, rooted in Albert Bandura's concept of vicarious learning, plays a significant role in therapeutic interventions for various psychological conditions, including social anxiety, ADHD, and depression.
Participant Modeling
Participant modeling involves therapists demonstrating calm and effective behaviors in...

Milgram's Obedience to Authority

Milgram's Obedience to Authority

Obedience to authority is classically demonstrated in a more famous series of social psychology experiments performed by Stanley Milgram. He was a social psychology professor at Yale who was influenced by the trial of Adolf Eichmann, a Nazi war criminal. Eichmann’s defense for the atrocities he committed was that he was “just following orders.”