对分子性质预测的知识蒸:一个可扩展性分析.
Rahul Sheshanarayana1, Fengqi You1,2,3,4
1College of Engineering, Cornell University, Ithaca, NY, 14853, USA.
Advanced science (Weinheim, Baden-Wurttemberg, Germany)
|April 9, 2025
概括
知识蒸 (KD) 有效地压缩了用于分子性质预测的复杂模型. 这种技术提高了效率和准确性,使得较小的模型能够在化学信息学和材料科学中实现卓越的性能.
科学领域:
- 计算化学的计算化学
- 机器学习 机器学习
- 材料科学 材料科学 材料科学
背景情况:
- 知识蒸 (KD) 是一种模型压缩技术.
- 图形神经网络 (GNN) 用于分子属性预测.
- 在分子建模中降低计算成本至关重要.
研究的目的:
- 调查KD在分子性质预测中的有效性.
- 评估跨领域特定和跨领域任务的KD.
- 使用最先进的GNN:SchNet,DimeNet++和Tensor.Net,这些GNN可以使用.
主要方法:
- 应用KD到QM9数据集用于量子力学属性.
- 使用ESOL (logS) 和FreeSolv (ΔGhyd) 数据集进行跨领域评估.
- 分析了学生-老师模型对齐使用等号相似性.
主要成果:
- 在QM9上,KD提高了回归性能,而DimeNet++学生模型显示了高达90%的R2改进.
- 较小的学生模型实现了可比或更好的R2收益,缩小了2倍的尺寸.
- 跨域 KD 增强了 ESOL 和 FreeSolv 的预测 (SchNet ≈65% 的 logS 获取).
- 嵌入分析显示了显著的学生-教师对齐.
结论:
- KD是一种强大的策略,用于增强分子表示学习.
- 在分子性质预测中,KD提高了效率和预测性能.
- 这些发现对化学信息学,材料科学和药物发现有影响.
更多相关视频
10:21Author Spotlight: Streamlining Protein Target Prediction and Validation via Molecular Docking and CETSA
Published on: February 23, 2024
2.4K
06:50Author Spotlight: A Computational Approach to Decipher Amino Acid Preferences in Multispecific Protein-Protein Interactions
Published on: January 26, 2024
1.8K
相关概念视频
Predicting Molecular Geometry
34.2K
VSEPR Theory for Determination of Electron Pair Geometries
34.2K
Polymers: Molecular Weight Distribution
3.3K
For any given polymer, the weight average molecular weight (Mw) is higher than, if not equal to, the number average molecular weight (Mn). The only situation in which the weight average molecular weight and the number average molecular weight are equal is when a polymer consists only of chains with equal molecular weight. However, this never happens in a synthetic polymer, since it is difficult to control the polymerization process up to a molecular level with accuracy to a hundred percent.
3.3K
Distillation: Vapor–Liquid Equilibria
2.7K
Distillation is a separation technique that takes advantage of the boiling point properties of disparate elements in a mixture. To perform distillation, we begin by heating a miscible mixture of two liquids with a significant difference in boiling points (at least 20°C). As the solution heats up and reaches the bubble point of the more volatile component, some molecules of the more volatile component transition into the gas phase and travel upward into the condenser, which is a glass tube...
2.7K
Molecular Geometry and Dipole Moments
12.7K
The VSEPR theory can be used to determine the electron pair geometries and molecular structures as follows:
12.7K
Polymers: Defining Molecular Weight
2.8K
Unlike small molecules with definite molecular weights, polymers are a mixture of individual polymer chains of varying lengths, each with a unique molecular weight. So, the molecular weight of a polymer is expressed as an average value based on the average size of the polymer chains. The two most common forms of averages used for polymers are the number average molecular weight and weight average molecular weight.
The number average molecular weight (Mn) is the summation of the number...
The number average molecular weight (Mn) is the summation of the number...
2.8K
Predicting Reaction Outcomes
8.3K
Kinetics describes the rate and path by which a reaction occurs. In contrast, thermodynamics deals with state functions and describes the properties, behavior, and components of a system. It is not concerned with the path taken by the process and cannot address the rate at which a reaction occurs. Although it does provide information about what can happen during a reaction process, it does not describe the detailed steps of what appears on an atomic or a molecular level. On the other hand,...
8.3K
