推动药物发现分子性质预测的边界,使用多任务学习BERT增强SMILES计数
Xiao-Chen Zhang1,2,3, Cheng-Kun Wu3, Jia-Cai Yi3
1Xiangya School of Pharmaceutical Sciences, Central South University, Changsha 410013, Hunan, P. R. China.
Research (Washington, D.C.)
|September 17, 2024
概括
本研究介绍了MTL-BERT,这是一种深度学习模型,通过使用大型未标记数据集和多任务学习来改善分子性质预测. 它克服了数据稀缺性,以便更好地预测药物发现.
科学领域:
- 计算化学是一种计算化学.
- 人工智能在药物发现中的作用
- 机器学习用于药理学.
背景情况:
- 准确预测小分子药理学特性对于药物发现至关重要.
- 传统方法依赖于手工制作的描述符,需要专家知识并限制可扩展性.
- 现有的深度学习模型在数据稀缺和特定任务信息共享方面扎,导致概括不佳.
研究的目的:
- 开发一种新的多任务学习框架,MTL-BERT,解决数据稀缺问题,提高分子性质预测中的概括性.
- 利用大规模的预训练和多任务学习来提高深度学习模型的预测性能.
- 通过利用注意力机制来识别关键分子特征来提高模型的解释性.
主要方法:
- 提出了一种新的多任务学习BERT (变压器的双向编码器表示) 框架 (MTL-BERT).
- 员工进行了大规模的自我监督的未标记数据预培训,以从SMILES字符串 (简化分子输入线输入规范) 中获取上下文信息.
- 利用多任务学习来同时对多个下游任务进行微调,并使用SMILES列举来增强数据.
主要成果:
- 在最少的微调后,MTL-BERT在60个分子数据集上取得了比最先进的方法显著更好的性能.
- 该框架有效地缓解了预测分子性质所固有的数据稀缺问题.
- 在MTL-BERT中的注意力机制提供了对SMILES基本特征的洞察力,用于财产预测,提高了可解释性.
结论:
- MTL-BERT为预测分子性质提供了一种强大而可通用的方法,其性能优于现有的方法.
- 预训练,多任务学习和SMILES计数的结合有效地解决了化学信息学中的数据限制.
- 该模型的可解释性特性为了解药物发现中的结构-活性关系提供了有价值的见解.
相关概念视频
Drug Discovery: Overview
7.6K
Drug discovery is a multifaceted process involving extensive screening, testing, and optimization of lead compounds to identify potential new drugs for therapeutic use. It combines several approaches, including screening large numbers of natural products, chemical modification of known active molecules, identification of new drug targets, and rational design based on biological mechanisms and drug-receptor structure. These approaches are carried out in both academic research laboratories and...
7.6K
Mechanistic Models: Compartment Models in Individual and Population Analysis
33
Mechanistic models are utilized in individual analysis using single-source data, but imperfections arise due to data collection errors, preventing perfect prediction of observed data. The mathematical equation involves known values (Xi), observed concentrations (Ci), measurement errors (εi), model parameters (ϕj), and the related function (ƒi) for i number of values. Different least-squares metrics quantify differences between predicted and observed values. The ordinary least...
33
Structure-Activity Relationships and Drug Design
677
Drug design is a dynamic field that involves discovering and developing new medications based on specific biological targets. This process heavily relies on structure-activity relationships (SAR) and quantitative structure-activity relationships (QSAR) to guide the design and optimization of efficient drugs.
SAR studies the intricate relationship between a drug's chemical structure and biological activity. It focuses on understanding how modifications to a drug's structure can influence...
SAR studies the intricate relationship between a drug's chemical structure and biological activity. It focuses on understanding how modifications to a drug's structure can influence...
677
Multicompartment Models: Overview
113
Multicompartment models are mathematical constructs that depict how drugs are distributed and eliminated within the body. They segment the body into several compartments, symbolizing various physiological or anatomical areas connected through drug transfer processes such as absorption, metabolism, distribution, and elimination.
These models offer a more comprehensive representation of drug behavior in the body than one-compartment models. They accommodate the complexity of drug distribution,...
These models offer a more comprehensive representation of drug behavior in the body than one-compartment models. They accommodate the complexity of drug distribution,...
113
Analysis of Population Pharmacokinetic Data
240
Analysis of population pharmacokinetic data involves studying the behavior of drugs within diverse populations to understand their pharmacokinetic parameters. Traditional pharmacokinetic methods typically involve collecting samples from a few individuals and estimating these parameters. While these methods are commonly used, they have limitations in capturing the variability in drug response among individuals or heterogeneous populations. Population pharmacokinetics is employed to address these...
240
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
45
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
45


