通过解决方案路径为半监督支持向量机进行全球模型选择
IEEE transactions on neural networks and learning systems
|February 9, 2024
概括
半监督的支持向量机器 (S3VMs) 利用未标记的数据来提高准确性. 一种新的方法,Solution Paths of S3VM (SPS3VM),有效地搜索超参数,减少计算时间并改善S3VMs的模型选择.
科学领域:
- 机器学习 机器学习
- 人工智能的人工智能
- 优化优化 优化优化
背景情况:
- 半监督支持矢量机器 (S3VMs) 使用丰富的未标记数据来提高对传统支持矢量机器 (SVMs) 的概括精度.
- 有效的超参数选择对于最佳的S3VM性能至关重要.
- 半监督学习的模型选择仍然是一个重大挑战,现有的方法往往是计算密集的.
研究的目的:
- 为了解决S3VM中超参数优化的计算需求.
- 引入一种新的算法,以高效地追踪跨超参数范围的S3VM解决方案.
- 在S3VM中提供计算效率高,有效的模型选择方法.
主要方法:
- 提出S3VM (SPS3VM) 的解决方案路径,这是一个新的算法,用于跟踪非凸 S3VM 关于超参数的解决方案.
- 使用增量和减量学习来更新解决方案并满足Karush-Kuhn-Tucker (KKT) 条件.
- 利用模型函数的断片线性和错误路径计算,在所有候选超参数中识别出具有最小交叉验证 (CV) 错误的模型.
主要成果:
- SPS3VM是第一个针对半监督学习模型固有的非凸优化问题的解决方案路径算法.
- 该算法提供有限收分析和计算复杂性评估.
- 实验结果表明,SPS3VM可以在全球范围内搜索超参数 (规范化和坡道损失),并与网格搜索相比显著减少计算时间,同时保持可比或改进的泛化性能.
结论:
- 在S3VM中,SPS3VM提供了一种高效和有效的方法来优化S3VM中的超参数和模型选择.
- 这种方法比传统的网格搜索方法节省了大量的计算成本.
- 这项工作推进了半监督学习领域,为非凸式优化问题提供了可扩展的解决路径算法.
更多相关视频
相关概念视频
Machines: Problem Solving II
310
Machines are complex structures consisting of movable, pin-connected multi-force members that work together to transmit forces. Consider a lifting tong carrying a 100 kg load. It comprises movable sections DAF and CBG linked together with member AB.
310
Machines: Problem Solving I
324
A toggle clamp is a mechanical device commonly used for holding and clamping objects in various applications, such as woodworking, metalworking, and assembly operations. Consider a toggle clamp subjected to a force of 200 N at the handle. The vertical clamping force can be calculated, provided the dimensions of the toggle clamp are known.
The toggle clamp system is a machine structure consisting of movable, pin-connected multi-force members that form a stabilized system to transmit forces. The...
The toggle clamp system is a machine structure consisting of movable, pin-connected multi-force members that form a stabilized system to transmit forces. The...
324
Normal and Tangetial Components: Problem Solving
180
Consider a man with a mass of 70 kg seated in a chair connected to a pin support through a member BC. If the man maintains an upright position, the task is to determine the horizontal and vertical reactions of the chair on the man when the member makes a 45° angle with the horizontal. At this moment, the man has a speed of 5 m/s, increasing at a rate of 1 m/s².
180
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
54
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
54
Statically Indeterminate Problem Solving
378
Statically indeterminate problems are those where statics alone can not determine the internal forces or reactions. Consider a structure comprising two cylindrical rods made of steel and brass. These rods are joined at point B and restrained by rigid supports at points A and C. Now, the reactions at points A and C and the deflection at point B are to be determined. This rod structure is classified as statically indeterminate as the structure has more supports than are necessary for maintaining...
378
Multi-input and Multi-variable systems
106
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
In the absence...
106


