超级缩放器:用于选择缩放技术的超级学习框架
IEEE transactions on neural networks and learning systems
|February 26, 2024
概括
选择正确的数据缩放技术对于机器学习模型性能至关重要. 超级缩放器使用超级学习自动选择任何给定的数据集和分类器的最佳缩放技术.
科学领域:
- 机器学习 机器学习
- 数据预处理数据预处理
- 超级学习 (Meta-Learning) 是一种学习方式.
背景情况:
- 数据集缩放或规范化是机器学习管道中的关键预处理步骤.
- 选择最佳缩放技术 (ST) 取决于数据集和分类器,没有一个ST可以普遍优于其他.
- 通过试错的方式手动选择最好的ST通常是不可行的,因为计算成本.
研究的目的:
- 引入Meta-scaler,这是一种利用meta-learning (MtL) 来自动选择最佳缩放技术的新方法.
- 开发元模型,学习数据集元特征与不同ST下的分类器的性能之间的关系.
主要方法:
- 从数据集中提取的元特征.
- 训练有素的元模型预测给定数据集和分类算法的最佳ST.
- 通过使用5个ST对12个基础分类器和300个数据集进行Meta-scaler性能评估.
主要成果:
- 超标调量器成功识别了最佳的ST,导致12个基本模型中的10个与固定ST选择相比,在统计学上显著地提高了性能.
- 拟议的方法表现出优越的性能,超过现有的最先进的MTL方法用于ST选择.
- 实验结果验证了Meta-scaler方法的可行性和有效性.
结论:
- 超级扩展器为选择最合适的数据扩展技术提供了有效的自动化解决方案,提高了机器学习模型的性能.
- 超级学习框架为人工ST选择提供了一个可扩展和高效的替代方案.
- 这项研究强调了适应性ST选择对于优化分类任务的重要性.
相关概念视频
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
54
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
54
Response Surface Methodology
130
Response Surface Methodology (RSM) is a collection of statistical and mathematical techniques used to develop, improve, and optimize processes. It is particularly valuable when many input variables or factors potentially influence a response variable.
The process of RSM involves several key steps:
The process of RSM involves several key steps:
130
Survival Tree
85
Survival trees are a non-parametric method used in survival analysis to model the relationship between a set of covariates and the time until an event of interest occurs, often referred to as the "time-to-event" or "survival time." This method is particularly useful when dealing with censored data, where the event has not occurred for some individuals by the end of the study period, or when the exact time of the event is unknown.
Building a Survival Tree
Constructing a...
Building a Survival Tree
Constructing a...
85
Modeling and Similitude
267
Scaled modeling is a fundamental technique in engineering, enabling the study of large and complex systems by creating smaller, manageable replicas that recreate critical characteristics of the original. In hydrology and civil infrastructure, for example, scaled models of dams help analyze water flow, turbulence, and pressure. This method allows for accurate predictions of real-world behavior within a controlled environment, significantly reducing the cost and time involved in full-scale...
267
Typical Model Studies
359
Fluid mechanics model studies often utilize scaled-down systems to predict fluid behavior in full-scale environments, such as river flows, dam spillways, and structures interacting with open surfaces. Maintaining Froude number similarity in river models is crucial, as it replicates surface flow features like wave patterns and velocities.
359
Multiple Comparison Tests
3.9K
Multiple comparison test, abbreviated as MCT, is a post hoc analysis generally performed after comparing multiple samples with one or more tests. An MCT will help identify a significantly different sample among multiple samples or a factor among multiple factors.
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
3.9K


