精神RoBERTa-Caps:用于心理健康分类的囊增强型变压器模型
Faheem Ahmad Wagay1, Jahiruddin1, Yasir Altaf2
1Jamia Millia Islamia University, New Delhi 10025, India.
MethodsX
|July 24, 2025
概括
本研究介绍了一种轻量级的混合模型,用于从社交媒体文本中检测精神疾病,平衡准确性和计算效率. 这种新的方法提高了心理健康监测系统的实时可用性.
科学领域:
- 自然语言处理 (NLP) 是一种自然语言处理.
- 计算精神病学是一种计算精神病学.
- 机器学习 机器学习
背景情况:
- 像RoBERTa这样的大型语言模型 (LLM) 在NLP任务中表现出色,包括精神疾病检测.
- 在资源有限的环境中,LLM的高计算需求限制了实时应用.
研究的目的:
- 开发一个计算高效的混合模型用于精神疾病检测.
- 为了平衡模型性能,可解释性和计算效率.
- 通过使用社交媒体数据实现实时心理健康监测.
主要方法:
- 整合一个6层的RoBERTa编码器与一个囊网络架构.
- 使用动态路由来生成类囊输出.
- 使用局部可解释的模型不可知解释 (LIME) 来实现模型的可解释性.
主要成果:
- 混合模型在基准心理健康数据集上实现了高准确度.
- 与传统的LLM相比,推断时间显著减少.
- LIME提供了对特征贡献和模型决策的透明见解.
结论:
- 拟议的轻量级模型为有效的精神疾病检测提供了一种实际解决方案.
- 混合架构增强了心理健康系统中现实世界的部署能力.
- 该方法支持可解释的人工智能用于心理健康预测.
相关概念视频
Classification of Illness
8.0K
The meaning of illness is individualized to each person who experiences an alteration in health. In contrast, disease is a medical term indicating a pathological change in the structure and function of the body or mind. It is a condition that has specific symptoms and boundaries.
An illness is a response to a disease in which the person's level of functioning is changed compared with a previous level. The general classification of illness includes acute and chronic.
Acute illness is severe...
An illness is a response to a disease in which the person's level of functioning is changed compared with a previous level. The general classification of illness includes acute and chronic.
Acute illness is severe...
8.0K
Modeling in Therapy
149
Modeling, a key technique in therapy, uses observational learning to help clients acquire and practice new skills by watching therapists demonstrate desired behaviors. This approach, rooted in Albert Bandura's concept of vicarious learning, plays a significant role in therapeutic interventions for various psychological conditions, including social anxiety, ADHD, and depression.
Participant Modeling
Participant modeling involves therapists demonstrating calm and effective behaviors in...
Participant Modeling
Participant modeling involves therapists demonstrating calm and effective behaviors in...
149
Classification of Neurotransmitters
3.6K
Neurotransmitters play a crucial role in the communication between neurons in the autonomic nervous system. Neurons in the autonomic nervous system can be cholinergic or adrenergic depending on the neurotransmitters synthesized. Cholinergic neurons use acetylcholine as their primary neurotransmitter. This includes all the preganglionic fibers of the sympathetic and pre- and postganglionic fibers of the parasympathetic nervous systems. In addition, neurons of the somatic nervous system also use...
3.6K


