解决LINEX软支向量机器的非平滑优化算法
Soufiane Lyaqini1, Aissam Hadri2, Lekbir Afraites3
1LAMSAD LAB, Hassan first University, Morocco.
ISA transactions
|July 27, 2024
概括
本研究引入了一种新的成本敏感的支持矢量机 (SVM) 模型,使用LINEX损失函数来提高不平衡数据集的性能,证明了增强的噪声稳定性和准确性.
科学领域:
- 机器学习 机器学习
- 人工智能的人工智能
- 数据科学数据科学数据科学
背景情况:
- 支持矢量机器 (SVM) 是基本的机器学习算法.
- 类不平衡的数据集对传统的SVM构成重大挑战,导致有偏见的模型.
- 噪音数据和重叠类进一步使SVM模型训练和性能复杂化.
研究的目的:
- 提出一种新的成本敏感的SVM模型,旨在有效处理类不平衡的数据集.
- 将不对称的LINEX损失函数与软边际SVM集成,以提高稳定性.
- 在有噪音数据或重叠类的场景中解决 SVM 的局限性.
主要方法:
- 开发了一个成本敏感的SVM模型,结合了不对称的LINEX损失函数.
- 利用一个Primal-Dual优化方法来克服由于约束不等式导致的模型的不平滑性.
- 利用优化函数的凸度来实现高效的训练和噪声强度.
主要成果:
- 与传统的SVM方法相比,拟议的模型在不平衡的数据集上表现出更高的性能.
- 该LINEX损失功能促进了高效的培训,并减少了对错误分类样本的处罚.
- 通过Primal-Dual优化方法,在保持其核心结构的同时,增强了该模型对噪声的强度.
结论:
- 这种新的成本敏感的SVM模型有效地解决了类不平衡和数据噪声问题.
- 集成LINEX损失和Primal-Dual优化为SVM提供了一个强大而高效的解决方案.
- 实验结果和统计测试证实了该模型的优越性和有效性.
更多相关视频
13:54A Workflow for Lipid Nanoparticle LNP Formulation Optimization using Designed Mixture-Process Experiments and Self-Validated Ensemble Models SVEM
Published on: August 18, 2023
4.5K
08:27Author Spotlight: Efficient Image Recognition Using Directional Gradient Histogram Technique and Support Vector Machines
Published on: January 5, 2024
1.0K
相关概念视频
01:18Reducing Line Loss
150
In a three-phase circuit, line loss is an indicator of energy dissipated as heat due to the resistance of transmission lines. To address this, incorporating transformers into the system—a step-up transformer at the source and a step-down transformer at the load—is a strategic solution. Two three-phase transformers are introduced to improve this.
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss...
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss...
150
01:29Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
47
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
47
01:11Residuals and Least-Squares Property
7.3K
The vertical distance between the actual value of y and the estimated value of y. In other words, it measures the vertical distance between the actual data point and the predicted point on the line
If the observed data point lies above the line, the residual is positive, and the line underestimates the actual data value for y. If the observed data point lies below the line, the residual is negative, and the line overestimates the actual data value for y.
The process of fitting the best-fit...
If the observed data point lies above the line, the residual is positive, and the line underestimates the actual data value for y. If the observed data point lies below the line, the residual is negative, and the line overestimates the actual data value for y.
The process of fitting the best-fit...
7.3K
01:21Linear Approximation in Time Domain
76
Nonlinear systems often require sophisticated approaches for accurate modeling and analysis, with state-space representation being particularly effective. This method is especially useful for systems where variables and parameters vary with time or operating conditions, such as in a simple pendulum or a translational mechanical system with nonlinear springs.
For a simple pendulum with a mass evenly distributed along its length and the center of mass located at half the pendulum's length,...
For a simple pendulum with a mass evenly distributed along its length and the center of mass located at half the pendulum's length,...
76
01:26Linear Approximation in Frequency Domain
88
Linear systems are characterized by two main properties: superposition and homogeneity. Superposition allows the response to multiple inputs to be the sum of the responses to each individual input. Homogeneity ensures that scaling an input by a scalar results in the response being scaled by the same scalar.
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear....
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear....
88
01:08Vector Algebra: Method of Components
13.8K
It is cumbersome to find the magnitudes of vectors using the parallelogram rule or using the graphical method to perform mathematical operations like addition, subtraction, and multiplication. There are two ways to circumvent this algebraic complexity. One way is to draw the vectors to scale, as in navigation, and read approximate vector lengths and angles (directions) from the graphs. The other way is to use the method of components.
In many applications, the magnitudes and directions of...
In many applications, the magnitudes and directions of...
13.8K