Related Experiment Video
Updated: Jul 19, 2026
08:27
Image Recognition and Parameter Analysis of Concrete Vibration State Based on Support Vector Machine
Published on: January 5, 2024
Support vector classifiers via gradient systems with discontinuous righthand sides
Leonardo V Ferreira1, Eugenius Kaszkurewicz, Amit Bhaya
1Department of Electrical Engineering, NACAD-COPPE/Federal University of Rio de Janeiro, Rio de Janeiro, RJ, Brazil. lvalente@coep.ufrj.br
Summary
This study introduces gradient dynamical systems using nonsmooth Lyapunov functions as a novel approach for support vector machines (SVMs) to classify nonseparable data. These systems demonstrate global convergence and improved scalability for efficient data discrimination.
Area of Science:
- Dynamical Systems
- Machine Learning
- Optimization
Background:
- Support Vector Machines (SVMs) are powerful tools for classification but struggle with nonseparable classes.
- Existing SVM formulations often involve complex optimization problems.
Purpose of the Study:
- To design gradient dynamical systems for SVMs capable of discriminating nonseparable classes.
- To ensure global convergence and parameter independence in the proposed systems.
Main Methods:
- Utilizing Persidskii-type nonsmooth Lyapunov functions to construct gradient systems.
- Applying an exact penalty method to constrained quadratic optimization problems inherent in SVMs.
- Employing the boundary layer technique to smooth discontinuous terms for ODE integration.
Main Results:
- Demonstrated global convergence of gradient system trajectories to solutions, independent of penalty and SVM parameters.
- Successful implementation of gradient systems on parallel computers, showing reduced processing times compared to traditional SVM packages.
- Validation of the systems' applicability in analog circuits and standard ODE integration software.
Conclusions:
- Gradient dynamical systems offer a robust and scalable alternative for SVM-based classification of nonseparable data.
- The proposed method provides efficient and convergent solutions, adaptable for both hardware and software implementations.
Related Concept Videos
01:19Gradient Vectors and Their Applications
Every point on a topographical map corresponds to a particular elevation, so the landscape can be modeled as a surface whose height depends on horizontal position. From any given location, a hiker may face infinitely many directions, but only one direction produces the fastest possible increase in elevation. This unique route is called the direction of steepest ascent, and in multivariable calculus, it is represented by the gradient vector of the elevation function.The gradient vector points...
01:27Significance of the Gradient Vector
A surface defined by a function of two variables can be understood by examining how it changes along specific directions. When one variable is held constant, the surface reduces to a curve that reflects variation in the other variable. For example, fixing one variable and moving parallel to a coordinate axis produces a cross-sectional curve. The slope of this curve at a given point represents how the function changes in that particular direction, providing a measure of local steepness.By...
01:27Gradient Fields
A gradient field is a vector field derived from a scalar field. A scalar field assigns a single numerical value to every point in space, such as temperature, pressure, or electric potential. The gradient field describes how that value changes from point to point. It gives both the direction of the fastest increase and the rate of change in that direction.For a scalar field f(x, y), the gradient is written as\begin{equation*}\nabla f=\left\langle \jfrac{\partial f}{\partial x},\jfrac{\partial...
01:25Maximizing the Directional Derivative
The directional derivative is a central concept in multivariable calculus that describes how a function changes at a given point when moving in a specified direction. This direction is represented by a unit vector, ensuring that only the orientation influences the rate of change. By varying the direction, different rates of change can be observed, demonstrating that the directional derivative depends strongly on the chosen direction.The directional derivative is computed using the gradient...
01:14Gradient and Del Operator
In mathematics and physics, the gradient and del operator are fundamental concepts used to describe the behavior of functions and fields in space. The gradient is a mathematical operator that gives both the magnitude and direction of the maximum spatial rate of change. Consider a person standing on a mountain. The slope of the mountain at any given point is not defined unless it is quantified in a particular direction. For this reason, a "directional derivative" is defined, which is a vector...
01:17Derivatives of Vector Functions
A vector-valued function describes position as a function of time. For example, in Cartesian coordinates, the position of a car moving along a curved road can be written as\begin{equation*}\textbf{r}(t)=\langle x(t),y(t),z(t)\rangle\end{equation*}Secant Vector and Average Velocity:This secant vector captures the overall change in position during the interval and provides a crude estimate of the direction of motion.At time t, the car is at point P, with position r(t). After a short interval h,...