BartSmiles:用于分子表示的生成面具语言模型
Gayane Chilingaryan1, Hovhannes Tamoyan1, Ani Tevosyan1,2
1YerevaNN, Charents str. 20, 0025 Yerevan, Armenia.
Journal of chemical information and modeling
|July 26, 2024
概括
我们开发了BARTSmiles,一种用于分子表示的新的自我监督策略. 这种方法显著提高了各种任务的性能,在分子机器学习中创造了新的最先进的结果.
科学领域:
- 计算化学是一种计算化学.
- 机器学习 机器学习
- 生物信息学是一种生物信息学.
背景情况:
- 自主监督学习 (SSL) 对于开发有效的分子表征至关重要.
- 生成型面具语言模型 (MLM) 显示出分子数据的前景.
- 对于分子而言,现有的SSL策略存在局限性.
研究的目的:
- 开发一个强大的自我监督的战略,用于使用生成的MLM分子表示.
- 训练和评估BARTSmiles,一个类似BART的模型,用于分子任务.
- 为了证明下游应用程序的学习表示的有效性.
主要方法:
- 进行了深度切除,以完善自我监督的预训策略.
- 训练有素的BARTSmiles使用一个数量级比以前的方法更多的计算.
- 评估BARTSmiles在各种任务上进行了评估:分类,回归和生成.
主要成果:
- 巴特斯米尔斯的表现始终优于现有的自我监督代表.
- 在八个基准任务上取得了新的最先进的表现.
- 证明BART目标隐含地编码下游任务信息.
- 展示了BARTSmiles中的特定神经元能够高精度地预测分子性质.
- 应用可解释性方法来识别化学相关的亚结构.
结论:
- 提出的自我监督策略和BARTSmiles模型代表了分子表示学习的重大进步.
- BARTSmiles为各种分子预测和生成任务提供了一种强大而通用的工具.
- 该模型的可解释性提供了宝贵的化学见解,有助于科学发现.
相关概念视频
02:00Molecular Models
38.2K
Physical models representing molecular architectures of chemical compounds play essential roles in understanding chemistry. The use of molecular models makes it easier to visualize the structures and shapes of atoms and molecules.
38.2K
02:27Predicting Molecular Geometry
34.2K
VSEPR Theory for Determination of Electron Pair Geometries
34.2K
02:06Newman Projections
16.7K
Different notations are used to represent the three-dimensional structure of molecules on two-dimensional surfaces. One of the most commonly used representations is the dash-wedge formula. The dashed wedges, solid wedges, and the plane lines indicate the groups situated behind the plane, coming out of the plane, and in the plane, respectively.
The organic molecules rotate across the single bonds leading to numerous temporary three-dimensional structures of varying energy known as...
The organic molecules rotate across the single bonds leading to numerous temporary three-dimensional structures of varying energy known as...
16.7K
02:18Fischer Projections
13.1K
Learning to draw Fischer projections of molecules and understanding their relevance plays a crucial role in the visual depiction of organic molecules. A Fischer projection is a two-dimensional projection on a planar surface to simplify the three-dimensional wedge–dash representation of molecules. This is especially helpful in the case of molecules with multiple chiral centers that can be difficult to draw. Here, all the bonds of interest are represented as horizontal or vertical lines.
13.1K
03:51Molecular Orbital Theory II
19.1K
Molecular Orbital Energy Diagrams
19.1K
02:35Molecular Orbital Theory I
31.9K
Overview of Molecular Orbital Theory
31.9K