MentalQLM:一种基于指令调和双LoRA模块的轻量级大语言模型,用于心理健康护理
IEEE journal of biomedical and health informatics
|August 1, 2025
概括
一个新的轻量级大语言模型 (LLM),MentalQLM,提供了高效的精神障碍诊断. 使用双重低级调整 (LoRA),它以更少的资源实现了高精度,提高了心理健康护理的可访问性.
科学领域:
- 人工智能的人工智能
- 计算精神病学是一种计算精神病学.
- 自然语言处理自然语言处理.
背景情况:
- 精神疾病带来了重大的医疗保健挑战和社会影响.
- 大型语言模型 (LLM) 提供了改善心理健康护理的潜力.
- 目前的LLM方法由于大量的数据集和模型,造成了高的计算成本.
研究的目的:
- 开发一种新的,轻量级的LLM,用于有效诊断精神障碍.
- 为了降低与LLM相关的计算成本,为心理健康护理微调LLM.
- 为了提高LLM在复杂的多类心理健康分类任务上的表现.
主要方法:
- 拟议的MentalQLM是一种轻量级的LLM,采用双重低级适应 (LoRA) 策略.
- 根据困惑性和多样性分析实施了数据集修剪.
- 采用了两阶段的微调过程,包括两个LoRA模块和一个密集层增强.
主要成果:
- 拥有50亿个参数的MentalQLM在精神障碍诊断上获得了0.778加权F1得分.
- 在基准数据集上表现优于MentaLLaMA-Chat-13B的3.2%和GPT-4的17.7%.
- 与现有最先进的模型相比,显著降低了资源需求.
结论:
- MentalQLM为精神卫生保健应用提供了具有成本效益和效率的解决方案.
- 开发的模型特别适用于计算受限制的环境.
- 这种方法为推进人工智能在心理健康诊断方面提供了一个有希望的方向.
相关概念视频
Modeling in Therapy
149
Modeling, a key technique in therapy, uses observational learning to help clients acquire and practice new skills by watching therapists demonstrate desired behaviors. This approach, rooted in Albert Bandura's concept of vicarious learning, plays a significant role in therapeutic interventions for various psychological conditions, including social anxiety, ADHD, and depression.
Participant Modeling
Participant modeling involves therapists demonstrating calm and effective behaviors in...
Participant Modeling
Participant modeling involves therapists demonstrating calm and effective behaviors in...
149
Multi-input and Multi-variable systems
150
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
In the absence...
150
RL Circuits
2.6K
An RL circuit consists of a resistor and an inductor and may have a source of emf connected to it. The inductor in the circuit helps to prevent rapid changes in current, which can be helpful if a steady current is required but the external source has a fluctuating emf. Consider an open RL circuit connected to a source of constant emf. As soon as the circuit is closed, the current begins to increase at a rate that depends only on the value of the inductance in the circuit. The greater the...
2.6K
Cognitive Learning
526
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
526
Ampere-Maxwell's Law: Problem-Solving
756
A parallel-plate capacitor with capacitance C, whose plates have area A and separation distance d, is connected to a resistor R and a battery of voltage V. The current starts to flow at t = 0. What is the displacement current between the capacitor plates at time t? From the properties of the capacitor, what is the corresponding real current?
To solve the problem, we can use the equations from the analysis of an RC circuit and Maxwell's version of Ampère's law.
For the first part of...
To solve the problem, we can use the equations from the analysis of an RC circuit and Maxwell's version of Ampère's law.
For the first part of...
756
Higher Mental Functions of Brain: Learning and Memory
969
Memory is one of the most vital higher mental functions of the brain. Memory is closely related to learning because it enables us to retain information and experiences from our past to use them in our present life. It also helps us to remember facts, events, and skills, such as riding a bike or swimming. There are two types of memory — declarative memory, which involves memorizing facts or events, and procedural memory, which enables us to remember how to do something like writing or...
969


