Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Constructing Bayesian formulations of sparse kernel learning methods.

Gavin C Cawley1, Nicola L C Talbot

  • 1School of Computing Sciences, University of East Anglia, Norwich NR4 7TJ, UK. gcc@cmp.uea.ac.uk

Neural Networks : the Official Journal of the International Neural Network Society
|August 9, 2005
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Kernel learning at the first level of inference.

Neural networks : the official journal of the International Neural Network Society·2014
Same author

Machine learning competition in immunology - Prediction of HLA class I binding peptides.

Journal of immunological methods·2011
Same author

Optimally regularised kernel Fisher discriminant classification.

Neural networks : the official journal of the International Neural Network Society·2007
Same author

An empirical evaluation of the fuzzy kernel perceptron.

IEEE transactions on neural networks·2007
Same author

Predictive uncertainty in environmental modelling.

Neural networks : the official journal of the International Neural Network Society·2007
Same author

Gene selection in cancer classification using sparse logistic regression with Bayesian regularization.

Bioinformatics (Oxford, England)·2006
Same journal

TraNce: Type-aware hypergraph neural network with biological mediators for drug repositioning.

Neural networks : the official journal of the International Neural Network Society·2026
Same journal

Decentralized ADMM for factorization-based Low-rank matrix estimation.

Neural networks : the official journal of the International Neural Network Society·2026
Same journal

Memristive neuromorphic circuit design inspired by the neural mechanisms of conditioned fear.

Neural networks : the official journal of the International Neural Network Society·2026
Same journal

Q-learning based asynchronous Boolean control networks stabilization with data loss.

Neural networks : the official journal of the International Neural Network Society·2026
Same journal

New results on prescribed-time synchronization of complex networks via intermittent control.

Neural networks : the official journal of the International Neural Network Society·2026
Same journal

Variance-constrained multi-view ensemble broad network for imbalanced data.

Neural networks : the official journal of the International Neural Network Society·2026
See all related articles

This study introduces a simplified Bayesian approach for sparse kernel learning using incomplete Cholesky factorization. This method efficiently creates sparse models and simplifies Bayesian analysis for algorithms like kernel ridge regression.

Area of Science:

  • Machine Learning
  • Statistical Modeling
  • Computational Statistics

Background:

  • Bayesian inference in kernel learning often involves complex computations.
  • Sparse kernel methods aim to improve efficiency and scalability.
  • Existing methods may lack a unified framework for Bayesian treatment.

Purpose of the Study:

  • To present a simplified technique for Bayesian analysis of sparse kernel learning algorithms.
  • To enable efficient Bayesian inference using a unified framework.
  • To demonstrate the method's applicability to kernel ridge regression and kernel logistic regression.

Main Methods:

  • Employing incomplete Cholesky factorization to modify the dual parameter space.
  • Whitening the Gaussian prior over dual model parameters.

Related Experiment Videos

  • Utilizing MacKay's evidence framework for Bayesian analysis.
  • Identifying a subset of training data as an approximate basis for sparsity.

    • Main Results:

    • The regularisation term simplifies to a standard weight-decay regulariser.
    • The incomplete Cholesky factorization naturally yields a sparse model by selecting a data subset.
    • Demonstrated successful Bayesian treatments for kernel ridge regression (KRR) and kernel logistic regression (KLR).

    Conclusions:

    • The proposed technique offers a simplified and unified approach to Bayesian sparse kernel learning.
    • The method enhances computational efficiency and model interpretability.
    • The approach is expected to be widely applicable to various kernel learning algorithms.