探索轻量级大语言模型对基于人工智能的心理健康咨询任务的潜力:一项新的比较研究
Ritesh Maurya1, Nikhil Rajput2, M G Diviit2
1Department of Computer Science and Engineering, Madan Mohan Malaviya University of Technology, Gorakhpur, 273010, India.
Scientific reports
|July 2, 2025
概括
轻量级的大型语言模型 (LLM) 显示了自动化心理健康咨询的前景. 该BART基础变体在产生同情反应方面表现出卓越的性能,使其适用于资源有限的设备.
科学领域:
- 人工智能的人工智能
- 自然语言处理自然语言处理.
- 计算语言学 计算语言学
背景情况:
- 基于变压器的大型语言模型 (LLM) 具有先进的文本生成功能.
- 使用LLM的自动心理健康顾问可以提供同情的支持,解决耻辱感.
- 大型LLM在低资源或边缘设备上带来了部署挑战.
研究的目的:
- 分析轻量级LLM用于自动心理健康咨询的有效性.
- 评估开源的轻量级LLM,包括T5小,BART基础,FLAN-T5小和GODEL基础.
- 通过使用各种数据集,评估心理健康咨询任务的模型性能.
主要方法:
- 微调轻量级的开源LLM:谷歌的T5-small,BART基础,FLAN-T5-small和微软的GODEL基础.
- 在自动化心理健康咨询任务中使用多样化,公开可用的数据集.
- 基于关键指标评估模型:红色-1,红色-2,红色-L,蓝色.
主要成果:
- 在所有评估的指标上,BART基础变种的表现优于其他模型 (红色-1:0.4727,红色-2:0.2665,红色-L:0.3554,蓝色:25.3993).
- 与其他模型相比,BART基产生了更多的同情和情感支持的反应.
- 轻量级的LLM显示出心理健康应用的巨大潜力.
结论:
- 轻量级的LLM对于开发自动化心理健康咨询系统是有效的.
- 巴特基是同情和支持精神健康的人工智能解决方案的强有力的候选人.
- 建议进一步探索轻量级的LLM,以推进可访问的心理健康护理.
相关概念视频
01:26Modeling in Therapy
153
Modeling, a key technique in therapy, uses observational learning to help clients acquire and practice new skills by watching therapists demonstrate desired behaviors. This approach, rooted in Albert Bandura's concept of vicarious learning, plays a significant role in therapeutic interventions for various psychological conditions, including social anxiety, ADHD, and depression.
Participant Modeling
Participant modeling involves therapists demonstrating calm and effective behaviors in...
Participant Modeling
Participant modeling involves therapists demonstrating calm and effective behaviors in...
153
01:27Language and Cognition
456
Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.
456
01:24Treatment Strategies for Psychological Disorders
285
Treatment approaches for psychological disorders fall into three main categories: psychological, biological, and sociocultural. Each approach targets different aspects of mental health, requiring varying levels of education and training.
Psychological therapies focus on modifying emotions, thoughts, and behaviors through talking, interpreting, listening, rewarding, challenging, and modeling. Clinical psychologists, counselors, and social workers commonly practice psychotherapy. Clinical...
Psychological therapies focus on modifying emotions, thoughts, and behaviors through talking, interpreting, listening, rewarding, challenging, and modeling. Clinical psychologists, counselors, and social workers commonly practice psychotherapy. Clinical...
285
01:20Introduction to Cognitive Psychology
1.0K
Cognitive psychology is the field of psychology dedicated to examining how people think. It attempts to explain how and why we think the way we do by studying the interactions among human thinking, emotion, creativity, language, and problem-solving, as well as other cognitive processes. Cognitive psychology studies how information is processed and manipulated in remembering, thinking, and knowing.
This field emerged in the mid-20th century, following a period dominated by behaviorism, which...
This field emerged in the mid-20th century, following a period dominated by behaviorism, which...
1.0K
01:25Cognitive Therapy
364
Cognitive therapy, pioneered by Aaron T. Beck in the 1960s, is a structured approach to addressing psychological distress by focusing on the influence of thoughts on emotions and behaviors. All cognitive therapies involve the basic assumption that human beings have control over their feelings, and that how individuals feel about something depends on how they think about it. Unlike psychoanalytic methods that delve into unconscious processes or humanistic approaches emphasizing...
364
02:16Stereotype Content Model
14.9K
The Stereotype Content Model (SCM) was first proposed by Susan Fiske and her colleagues (Fiske, Cuddy, Glick & Xu, 2002; see also Fiske, 2012 and Fiske, 2017). The SCM specifies that when someone encounters a new group, they will stereotype them based on two metrics: warmth—or that group’s perceived intent, and how likely they are to provide help or inflict harm—and competence—or their ability to carry out that objective. Depending on the warmth-competence...
14.9K