Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Bayesian framework for least-squares support vector machine classifiers, gaussian processes, and kernel Fisher

T Van Gestel1, J A K Suykens, G Lanckriet

  • 1Katholieke Universiteit Leuven, Department of Electrical Engineering ESAT-SISTA, B-3001 Leuven, Belgium. tony.vangestel@kuleuven.ac.be

Neural Computation
|April 26, 2002
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Cat Scratch Colon.

Acta gastro-enterologica Belgica·2025
Same author

Short communication: Circadian variations and day-to-day variability of clinical signs used for the early diagnosis of pneumonia within and between calves.

Research in veterinary science·2023
Same author

Retroperitoneoscopic adrenalectomy - introducing a new surgical technique in South Africa.

South African journal of surgery. Suid-Afrikaanse tydskrif vir chirurgie·2023
Same author

Fit4Surgery for cancer patients during covid-19 lockdown - A systematic review and meta-analysis.

European journal of surgical oncology : the journal of the European Society of Surgical Oncology and the British Association of Surgical Oncology·2022
Same author

Unusual cause of low abdominal pain.

Acta gastro-enterologica Belgica·2021
Same author

Erythema multiforme in the esophagus.

Acta gastro-enterologica Belgica·2021
Same journal

A Model-Free Reinforcement Learning Implementation of Decision Making Under Uncertainty by Sequential Sampling.

Neural computation·2026
Same journal

DROP: Distributional and Regular Optimism and Pessimism for Reinforcement Learning.

Neural computation·2026
Same journal

Hierarchical Active Inference Using Successor Representations.

Neural computation·2026
Same journal

W-Kernel and Its Principal Space for Frequentist Evaluation of Bayesian Estimators.

Neural computation·2026
Same journal

A Hidden Markov Model-Inspired Sequence Classification Method for Hyperdimensional Computing.

Neural computation·2026
Same journal

Sparse Graphical Modeling for Electrophysiological Phase-Based Connectivity Using Circular Statistics.

Neural computation·2026
See all related articles

This study combines the Bayesian evidence framework with Least-Squares Support Vector Machines (LS-SVM) classifiers. This approach improves generalization performance by addressing optimization challenges in machine learning models.

Area of Science:

  • Machine Learning
  • Computational Statistics
  • Pattern Recognition

Background:

  • Multilayer Perceptrons (MLPs) training faces nonconvex optimization and hidden unit selection issues.
  • Support Vector Machines (SVMs) use kernel-induced feature spaces for nonlinear classification.
  • Least-Squares SVMs (LS-SVMs) modify SVMs with a least-squares cost function and equality constraints, simplifying solutions.

Purpose of the Study:

  • To integrate the Bayesian evidence framework with the Least-Squares Support Vector Machine (LS-SVM) classifier formulation.
  • To derive analytic expressions for Bayesian inference levels within the LS-SVM dual space.
  • To obtain posterior class probabilities by marginalizing over model parameters.

Main Methods:

  • Formulation of LS-SVMs in the dual space, leveraging a least-squares cost function and equality constraints.

Related Experiment Videos

  • Application of the Bayesian evidence framework to the LS-SVM classifier.
  • Derivation of analytic expressions in the dual space and calculation of posterior class probabilities.

    • Main Results:

    • Analytic expressions were obtained in the dual space across different Bayesian inference levels.
    • Posterior class probabilities were successfully derived through marginalization.
    • Empirical results on 10 datasets demonstrated consistent, good generalization performance for the proposed LS-SVM classifier.

    Conclusions:

    • The combination of the Bayesian evidence framework and LS-SVM classifiers provides a robust method for classification.
    • This integrated approach effectively addresses challenges in traditional machine learning models.
    • The developed LS-SVM classifier exhibits strong generalization capabilities, validated by empirical testing.