在数据有限的设置中评估机器学习方法选择的元模拟方法
Mostafa Alwash1, Ghadi S Al Hajj2, Ivar Grytten2
1Department of Informatics, Faculty of Mathematics and Natural Sciences, University of Oslo, Oslo, Norway. malwash@gmail.com.
Scientific reports
|November 19, 2025
概括
为医学选择机器学习方法是很困难的,因为数据集很小. 模拟校准使用结构学习器来创建合成数据,以便更好地进行基准测试,改善医疗保健中的模型选择和可靠性.
科学领域:
- 机器学习 机器学习
- 医疗信息学 医疗信息学
- 计算生物学 计算生物学
背景情况:
- 选择适合的机器学习 (ML) 方法用于专门的任务,特别是在医学中,数据有限,异质和不完整,这是一个挑战.
- 使用小观测样本的传统基准测试可能不反映真正的数据生成过程 (DGP),从而导致实际上ML模型的概括性较差.
研究的目的:
- 引入SimCalibration,这是一个用于ML方法的大规模基准测试的元模拟框架.
- 通过从有限的数据中推断近似的GDP并生成合成数据集,使ML方法选择策略的系统评估成为可能.
主要方法:
- 利用结构学习者 (SL) 来从观察数据中推断近似的数据生成过程 (DGP).
- 在模拟环境中生成合成数据集,用于对ML方法进行基准测试.
- 从观测数据中以定向非循环图 (DAG) 的形式估计因果关系,特别是对于罕见疾病研究.
主要成果:
- 结构性学习者在产生代表性模拟以进行基准测试的能力上有所不同.
- 使用基于SL的模拟进行基准测试,与传统验证方法相比,可以减少性能估计差异.
- 基于SL的方法可以产生ML方法排名,这些排名更准确地反映了真正的相对性能,而不是来自有限数据集的排名.
结论:
- SimCalibration为医学等数据稀缺领域提供了一个强大的基于模拟的基准测试方法.
- 这一框架提高了ML模型选择的可靠性,降低了关键医疗保健应用中普遍性差的风险.
- 该方法为医疗环境中预测模型决策背后的假设提供了更大的透明度.
相关概念视频
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
267
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
267
Mechanistic Models: Compartment Models in Individual and Population Analysis
230
Mechanistic models are utilized in individual analysis using single-source data, but imperfections arise due to data collection errors, preventing perfect prediction of observed data. The mathematical equation involves known values (Xi), observed concentrations (Ci), measurement errors (εi), model parameters (ϕj), and the related function (ƒi) for i number of values. Different least-squares metrics quantify differences between predicted and observed values. The ordinary least...
230
Kaplan-Meier Approach
541
The Kaplan-Meier estimator is a non-parametric method used to estimate the survival function from time-to-event data. In medical research, it is frequently employed to measure the proportion of patients surviving for a certain period after treatment. This estimator is fundamental in analyzing time-to-event data, making it indispensable in clinical trials, epidemiological studies, and reliability engineering. By estimating survival probabilities, researchers can evaluate treatment effectiveness,...
541
Data Validation
557
Method validation is a crucial process in analytical chemistry designed to confirm that a given method consistently produces reliable and high-quality results. This process is essential when a method is applied to different sample matrices or when procedural modifications are made, ensuring that the results meet acceptable standards across various applications.
Key parameters for method validation include:
Key parameters for method validation include:
557
Pharmacokinetic Models: Comparison and Selection Criterion
314
Physiological and compartmental models are valuable tools used in studying biological systems. These models rely on differential equations to maintain mass balance within the system, ensuring an accurate representation of the dynamic processes at play.
Physiological models take a detailed approach by considering specific molecular processes. They can predict drug distribution, metabolism, and elimination changes, providing a comprehensive understanding of how drugs interact with the body.
Physiological models take a detailed approach by considering specific molecular processes. They can predict drug distribution, metabolism, and elimination changes, providing a comprehensive understanding of how drugs interact with the body.
314


