机器学习工作流程超出线性模型在低数据制度
David Dalmau1, Matthew S Sigman2, Juan V Alegre-Requena1
1Departamento de Química Inorgánica, Instituto de Síntesis Química y Catálisis Homogénea (ISQCH), CSIC-Universidad de Zaragoza C/Pedro Cerbuna 12 50009 Zaragoza Spain jv.alegre@csic.es.
Chemical science
|April 17, 2025
概括
自动非线性机器学习模型现在在数据有限的化学研究中与线性回归竞争. 这些新的工作流程提高了可解释性和预测准确性,即使是小数据集.
科学领域:
- 计算化学计算化学
- 机器学习在化学中的应用
背景情况:
- 数据驱动的方法和机器学习加速化学发现和可持续性.
- 非线性模型对于大数据集具有强大作用,但由于可解释性和过度匹配的担忧,在低数据场景中面临怀疑.
- 传统上,在数据有限的情况下,线性回归因其简单性和稳定性而受到青.
研究的目的:
- 在数据有限的化学研究中引入非线性机器学习模型的自动化工作流.
- 解决在非线性模型应用中的过拟合性和可解释性的挑战.
- 为了证明非线性模型的性能与传统的线性回归在低数据的制度.
主要方法:
- 开发具有贝叶斯超参数优化的自动化工作流程.
- 整合一个客观的功能,以减轻在插值和外推两者的过拟合.
- 在八个不同的化学数据集上进行基准测试,大小从18到44个数据点不等.
主要成果:
- 适当调整和调整的非线性模型在小型化学数据集上表现得与线性回归相当或比线性回归更好.
- 解释性评估证实,非线性模型有效地捕捉化学关系.
- De novo预测证明了开发的非线性工作流的预测能力.
结论:
- 自动化的非线性工作流可以克服数据有限的化学研究中的传统限制.
- 非线性模型,当适当优化时,为线性回归提供了一个可行的和强大的替代方案.
- 这些工具增强了化学家处理稀疏数据问题的能力,补充了现有的线性方法.
相关概念视频
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
34
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
34
Mechanistic Models: Compartment Models in Individual and Population Analysis
19
Mechanistic models are utilized in individual analysis using single-source data, but imperfections arise due to data collection errors, preventing perfect prediction of observed data. The mathematical equation involves known values (Xi), observed concentrations (Ci), measurement errors (εi), model parameters (ϕj), and the related function (ƒi) for i number of values. Different least-squares metrics quantify differences between predicted and observed values. The ordinary least...
19
Model Approaches for Pharmacokinetic Data: Distributed Parameter Models
48
Pharmacokinetic models are mathematical constructs that represent and predict the time course of drug concentrations in the body, providing meaningful pharmacokinetic parameters. These models are categorized into compartment, physiological, and distributed parameter models.
The distributed parameter models are specifically designed to account for variations and differences in some drug classes. This model is particularly useful for assessing regional concentrations of anticancer or...
The distributed parameter models are specifically designed to account for variations and differences in some drug classes. This model is particularly useful for assessing regional concentrations of anticancer or...
48
Clearance Models: Noncompartmental Models
29
Clearance is a pharmacokinetic parameter traditionally defined by compartment models, signifying the rate at which a drug is expelled from the body. However, a noncompartmental model offers an alternative method for assessing clearance, primarily employing empirical data obtained after administering a single drug dose.
The noncompartmental approach capitalizes on extensive sampling data, correlating the volume of distribution to systemic exposure and the administered dosage. This method enables...
The noncompartmental approach capitalizes on extensive sampling data, correlating the volume of distribution to systemic exposure and the administered dosage. This method enables...
29
Multi-input and Multi-variable systems
91
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
In the absence...
91
Survival Tree
44
Survival trees are a non-parametric method used in survival analysis to model the relationship between a set of covariates and the time until an event of interest occurs, often referred to as the "time-to-event" or "survival time." This method is particularly useful when dealing with censored data, where the event has not occurred for some individuals by the end of the study period, or when the exact time of the event is unknown.
Building a Survival Tree
Constructing a...
Building a Survival Tree
Constructing a...
44


