超越模拟:20,000次真实对话揭示了什么关于心理健康的人工智能安全
Research square
|February 6, 2026
概括
心理健康的大型语言模型 (LLM) 比一般人工智能更安全. 对2万次对话的生态审计显示,专门的AI避免了有害内容,并有效地提供了危机资源.
科学领域:
- 人工智能的人工智能
- 心理健康技术 心理健康技术
- 计算语言学 计算语言学
背景情况:
- 大型语言模型 (LLM) 在心理健康应用中越来越多地使用.
- 目前对LLM的安全评估通常使用有限的基于模拟的基准.
- 现实世界的语言数据对于准确的AI安全评估至关重要.
研究的目的:
- 与通用LLMs相比,评估专用精神健康AI的安全性.
- 在真实世界的用户互动中评估分层保护措施的有效性.
- 确定生态审计对AI安全估计的有用性.
主要方法:
- 复制了四个已发表的安全评估,用于一般用途和心理健康LLMs.
- 对20,000个真实用户对话的生态审计与专门构建的心理健康AI.
- 临床医生审查对话以确定自杀风险和非自杀自伤 (NSSI) 处理.
主要成果:
- 与一般的LLMs相比,专门构建的AI在自杀/NSSI,饮食障碍和物质使用基准中产生了明显更少的有害内容.
- 在真实用户数据中,在没有危机资源的情况下,确定了零自杀风险病例.
- 据估计,NSSI提到缺乏干预的低虚假阴性率为0.38%.
结论:
- 具有多层保护措施的专门构建的人工智能证明了心理健康应用程序的安全性得到改善.
- 生态审计为在现实场景中评估人工智能安全提供了有价值的方法.
- 这些发现支持开发和部署专门的AI来支持心理健康.
相关概念视频
Stress and Mental Health
954
Chronic stress profoundly affects mental health, significantly influencing mood, behavior, and overall quality of life. Research closely links chronic stress with mental health conditions such as depression, anxiety, and substance use disorders. Ongoing exposure to stress can lead to physiological and psychological changes, initiating a cycle of emotional distress and maladaptive coping mechanisms.
Individuals with depression often experience challenges in both their personal and professional...
Individuals with depression often experience challenges in both their personal and professional...
954
Gene Conversion
10.7K
Other than maintaining genome stability via DNA repair, homologous recombination plays an important role in diversifying the genome. In fact, the recombination of sequences forms the molecular basis of genomic evolution. Random and non-random permutations of genomic sequences create a library of new amalgamated sequences. These newly formed genomes can determine the fitness and survival of cells. In bacteria, homologous and non-homologous types of recombination lead to the evolution of new...
10.7K
Gene Conversion
3.1K
3.1K
Survey Safety
410
Surveying near highways, rough terrain, or power lines involves significant risks. Working along highways is particularly dangerous and requires the use of warning signs and flagmen. It is safest to avoid working directly on roads and use offsets whenever possible. When highway work is unavoidable, it must follow all safety guidelines. Surveyors should wear bright clothing, such as orange reflective vests, to ensure visibility to motorists, coworkers, and hunters. In construction zones, wearing...
410
Conversion of Units
36.8K
Sometimes, there is a need to convert from one unit to another one. For instance, reading a cookbook in which quantities are expressed in units of liters or ounces may require conversion of quantities to cups. Or, when looking up directions on how to get to a location, we may be interested to know how many miles we are going to walk. In this case, we would have to convert units of feet or meters to miles.
The first step in the unit conversion is to list the given units and the units required...
The first step in the unit conversion is to list the given units and the units required...
36.8K
Higher Mental Functions of the Brain: Language
3.9K
Language is a system of communication that allows the expression of thoughts, ideas, and feelings. The brain processes language in both hemispheres.
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
3.9K


