Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Vector Algebra: Method of Components

Vector Algebra: Method of Components

It is cumbersome to find the magnitudes of vectors using the parallelogram rule or using the graphical method to perform mathematical operations like addition, subtraction, and multiplication. There are two ways to circumvent this algebraic complexity. One way is to draw the vectors to scale, as in navigation, and read approximate vector lengths and angles (directions) from the graphs. The other way is to use the method of components.
In many applications, the magnitudes and directions of...

Vectors in Engineering Applications

Vectors in Engineering Applications

A steel beam supported by two identical cables provides a practical example of static equilibrium. The beam has a downward weight of 5000 N, while the two cables support it from opposite sides. Because the arrangement is symmetric, each cable makes the same angle of 60° with the horizontal beam and carries the same tension.In equilibrium, the beam remains completely at rest. This means that the total horizontal and vertical forces must both be zero. Each cable pulls along its own direction, so...

Classification of Signals

Classification of Signals

In signal processing, signals are classified based on various characteristics: continuous-time versus discrete-time, periodic versus aperiodic, analog versus digital, and causal versus noncausal. Each category highlights distinct properties crucial for understanding and manipulating signals.
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...

Econometric Views (EViews)

Econometric Views (EViews)

Econometric Views, often stylized as EViews, is a package that merges statistical analysis with econometric studies. It is designed to provide tools for time series analysis, forecasting, and econometric model simulation. The software originated from MicroTSP software and has evolved significantly since its inception in 1981. The history of EViews is marked by a continuous effort to enhance its computational speed and user interface. It was initially developed for large computing systems but...

Quadratic Models

Quadratic Models

Quadratic models are mathematical representations used to describe relationships in which the rate of change changes at a constant rate. These models appear in a wide variety of natural and engineered systems, especially those involving motion, forces, and optimization. One common application is analyzing the vertical motion of objects influenced by gravity, such as a ball thrown into the air.In such scenarios, the object's height changes over time in a curved pattern, rising to a maximum point...

Classification of Systems-II

Classification of Systems-II

Continuous-time systems have continuous input and output signals, with time measured continuously. These systems are generally defined by differential or algebraic equations. For instance, in an RC circuit, the relationship between input and output voltage is expressed through a differential equation derived from Ohm's law and the capacitor relation,

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Linear dependency between /spl epsi/ and the input noise in /spl epsi/-support vector regression.

IEEE transactions on neural networks·2008

See all related articles

Search research articles

Related Experiment Videos

The evidence framework applied to support vector machines.

¹Department of Computer Science, Hong Kong Baptist University, Kowloon Tong, Hong Kong. jamesk@comp.hkbu.edu.hk

IEEE Transactions on Neural Networks

|February 6, 2008

Summary

We demonstrate that training Support Vector Machines (SVMs) aligns with MacKay's evidence framework. This integration enables automatic parameter tuning and unlocks Bayesian methods for SVMs.

Area of Science:

Machine Learning
Computational Statistics
Artificial Intelligence

Background:

Support Vector Machines (SVMs) are powerful supervised learning models widely used for classification and regression.
MacKay's evidence framework provides a principled Bayesian approach to model inference and parameter estimation.
Current SVM training often relies on manual or heuristic parameter selection, which can be suboptimal.

Purpose of the Study:

To interpret Support Vector Machine (SVM) training within the context of MacKay's evidence framework.
To extend the application of MacKay's evidence framework to higher inference levels (levels 2 and 3) for SVMs.
To enable automatic adjustment of SVM regularization and kernel parameters using Bayesian methods.

Main Methods:

Interpreting SVM training as level 1 inference in MacKay's evidence framework.

Related Experiment Videos

Applying levels 2 and 3 of MacKay's evidence framework to SVMs.

Utilizing the integrated framework for automatic parameter optimization.

Main Results:

Demonstrated that SVM training is equivalent to level 1 inference in MacKay's evidence framework.
Successfully extended the framework to levels 2 and 3, allowing for automatic regularization and kernel parameter tuning.
Validated the performance of the integrated Bayesian approach on both synthetic and real-world datasets.

Conclusions:

The integration of SVMs with MacKay's evidence framework provides a novel Bayesian perspective on SVM training.
This approach facilitates automatic, near-optimal selection of key SVM hyperparameters.
The framework opens new avenues for applying advanced Bayesian inference tools to SVMs, enhancing their flexibility and performance.