评估年轻人使用的生成性AI心理治疗聊天机器人:跨部门研究
Kunmi Sobowale1, Daniel Kevin Humphrey2, Sophia Yingruo Zhao3
1Department of Psychiatry and Biobehavioral Sciences, University of California, 760 Westwood Plaza, Suite 48-241, Los Angeles, CA, 90024, United States, 1 310-794-7035, 1 925-281-3270.
JMIR mental health
|December 10, 2025
概括
生成型人工智能聊天机器人提供可访问的心理健康支持,但由于治疗质量差和危机处理,对年轻人来说不安全. 标准化审计对于保护年轻用户至关重要.
科学领域:
- 数字心理健康数字心理健康
- 医疗保健中的人工智能
- 青少年心理健康 青少年心理健康
背景情况:
- 数以百万计的年轻人利用直接面向消费者的生成人工智能 (GenAI) 聊天机器人来支持心理健康.
- 这些人工智能聊天机器人的心理治疗质量仍未得到充分研究.
研究的目的:
- 为了全面评估和比较广泛使用的GenAI聊天机器人的心理治疗质量.
- 通过使用对话代理用于心理治疗评估II (CAPE-II) 框架来评估聊天机器人的性能.
主要方法:
- 一项涉及受过培训的评价者评估5个GenAI聊天机器人的横截面研究.
- 评级人员采用了年轻人的角色来模拟心理健康支持互动.
- 心理治疗评估II (CAPE-II) 的对话代理框架被用于质量评估.
主要成果:
- GenAI聊天机器人展示了高可访问性 (86.7%) 和避免有害的内容 (89%).
- 在治疗方法 (31%) 和风险评估 (39%) 中发现了重大缺陷.
- 聊天机器人表现出不良的危机处理,不透明的隐私政策和缺乏模型透明度,观察到具有统计学意义的质量差异.
结论:
- 直接面向消费者的GenAI聊天机器人对年轻人的心理健康构成不可接受的风险.
- 迫切需要进行改革,包括像CAPE-II这样的标准化质量审计.
- 调查结果为平台,监管机构和决策者提供了目标,以提高青少年在数字心理健康支持中的安全.
相关概念视频
Psychotherapy
452
Psychotherapy is a versatile, nonmedical approach aimed at helping individuals address emotional, behavioral, and interpersonal issues to enhance their overall well-being. It can involve one-on-one sessions, couples counseling, or small group discussions with a therapist. The therapeutic process includes various techniques such as open discussion, interpretation of thoughts and behaviors, active listening, positive reinforcement, and role modeling. Psychotherapy aims to support individuals in...
452
Cognitive Therapy
838
Cognitive therapy, pioneered by Aaron T. Beck in the 1960s, is a structured approach to addressing psychological distress by focusing on the influence of thoughts on emotions and behaviors. All cognitive therapies involve the basic assumption that human beings have control over their feelings, and that how individuals feel about something depends on how they think about it. Unlike psychoanalytic methods that delve into unconscious processes or humanistic approaches emphasizing...
838
Modeling in Therapy
364
Modeling, a key technique in therapy, uses observational learning to help clients acquire and practice new skills by watching therapists demonstrate desired behaviors. This approach, rooted in Albert Bandura's concept of vicarious learning, plays a significant role in therapeutic interventions for various psychological conditions, including social anxiety, ADHD, and depression.
Participant Modeling
Participant modeling involves therapists demonstrating calm and effective behaviors in...
Participant Modeling
Participant modeling involves therapists demonstrating calm and effective behaviors in...
364
Treatment Strategies for Psychological Disorders
657
Treatment approaches for psychological disorders fall into three main categories: psychological, biological, and sociocultural. Each approach targets different aspects of mental health, requiring varying levels of education and training.
Psychological therapies focus on modifying emotions, thoughts, and behaviors through talking, interpreting, listening, rewarding, challenging, and modeling. Clinical psychologists, counselors, and social workers commonly practice psychotherapy. Clinical...
Psychological therapies focus on modifying emotions, thoughts, and behaviors through talking, interpreting, listening, rewarding, challenging, and modeling. Clinical psychologists, counselors, and social workers commonly practice psychotherapy. Clinical...
657
Automatic Processing and Automatic Social Behavior
196
Automatic processing refers to the cognitive operations that occur without conscious intent or awareness, playing a fundamental role in shaping social cognition and behavior. These processes enable individuals to navigate complex social environments efficiently by relying on mental shortcuts and pre-existing knowledge structures known as schemas. One of the most influential mechanisms underlying automatic processing is priming, which subtly activates mental representations through exposure to...
196
Rational Emotive Behavior Therapy
325
Cognitive-behavioral therapies (CBTs) are grounded in the belief that our thoughts profoundly influence our emotions and actions. Advocates of CBT emphasize three core assumptions: first, that cognitions are identifiable and measurable; second, that they are central to psychological functioning; and third, that irrational or maladaptive beliefs can be replaced with rational and adaptive ones. This transformative approach to therapy has paved the way for specific models such as Albert...
325
