DPA-2:作为多任务学习器的大型原子模型
Duo Zhang1,2,3, Xinzijian Liu1,2, Xiangyu Zhang4,5
1AI for Science Institute, Beijing 100080, P. R. China.
概括
我们使用大型原子模型 (LAM) 进行原子建模的新框架. 这些在各个学科中预先训练的人工智能模型可以有效地微调各种任务,加速分子和材料模拟.
科学领域:
- 计算化学和材料科学
- 在科学模型中使用人工智能.
背景情况:
- 人工智能 (AI) 正在彻底改变原子模型,模拟和设计.
- 人工智能驱动的潜在能源模型能够进行准确的大规模模拟.
- 目前的模型生成是人工智能在该领域广泛应用的瓶.
研究的目的:
- 提出一个以模型为中心的生态系统,以实现高效和多功能分子建模.
- 将DPA-2架构作为大型原子模型 (LAM) 的原型.
主要方法:
- 作为大型原子模型 (LAM) 开发了DPA-2架构.
- 使用多任务方法对各种化学和材料系统进行预先训练的DPA-2.
- 评估了DPA-2在各种下游任务中的通用化能力.
主要成果:
- 与传统的单任务预训练相比,DPA-2显示出更高的概括性.
- 提出的以模型为中心的方法简化了各种应用的模型生成.
- 在大规模,长时间的模拟中实现了高精度.
结论:
- DPA-2架构和以模型为中心的生态系统为分子建模提供了一个新的框架.
- 这种方法加速了人工智能在材料和分子模拟中的发展和应用.
- 能够为特定的科学任务高效地微调和蒸预训练模型.
相关概念视频
Associative Learning
572
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
572
Observational Learning
311
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
311
Purposive Learning
206
E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a...
206
Cognitive Learning
517
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
517
Multi-input and Multi-variable systems
149
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
In the absence...
149
Machines: Problem Solving II
367
Machines are complex structures consisting of movable, pin-connected multi-force members that work together to transmit forces. Consider a lifting tong carrying a 100 kg load. It comprises movable sections DAF and CBG linked together with member AB.
367


