Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Advanced search algorithms for information-theoretic learning with kernel-based estimators.

Rodney A Morejon1, Jose C Principe

  • 1Computational Neuroengineering Laboratory, University of Florida, Gainesville, FL 32611, USA.

IEEE Transactions on Neural Networks
|October 6, 2004
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Human-AI Cooperation in Healthcare and Rehabilitation.

Delaware journal of public health·2026
Same author

Training sparse convolutional deep predictive coding networks with attention.

Neural networks : the official journal of the International Neural Network Society·2026
Same author

A generative spike prediction model using behavioral reinforcement for re-establishing neural functional connectivity.

Nature computational science·2026
Same author

The Conditional Cauchy-Schwarz Divergence With Applications to Time-Series Data and Sequential Decision Making.

IEEE transactions on pattern analysis and machine intelligence·2025
Same author

A Standard-Cell-Based Neuro-Inspired Integrate-and-Fire Analog-to-Time Converter for Biological and Low-Frequency Signals - Comparison With Analog Version.

IEEE transactions on biomedical circuits and systems·2024
Same author

IA-LSTM: Interaction-Aware LSTM for Pedestrian Trajectory Prediction.

IEEE transactions on cybernetics·2024

This study introduces efficient training algorithms for information-theoretic learning (ITL) criteria, enhancing adaptive systems. The proposed methods improve computational efficiency for advanced parameter search in machine learning.

Area of Science:

  • Machine Learning
  • Information Theory
  • Adaptive Systems

Background:

  • Information-theoretic learning (ITL) criteria offer advanced performance metrics beyond mean-square error (MSE).
  • These metrics, utilizing Renyi's quadratic entropy and mutual information, capture higher-order statistics.
  • A key challenge for ITL metrics is their inherent computational complexity.

Purpose of the Study:

  • To address the computational demands of ITL criteria in adaptive system training.
  • To adapt and propose efficient parameter search algorithms for ITL-based system training.

Main Methods:

  • Examination of established advanced-parameter search algorithms.
  • Modification of gradient-descent, conjugate gradient, and Levenberg-Marquardt (LM) algorithms for ITL.

Related Experiment Videos

  • Application of nonparametric kernel-based density estimation for performance metrics.

    • Main Results:

    • Demonstrated computational efficiency of the proposed modified algorithms.
    • Successful training of adaptive systems using ITL criteria with enhanced algorithms.
    • Validation through sample problems and performance metrics.

    Conclusions:

    • Modified advanced-parameter search algorithms significantly improve computational efficiency for ITL.
    • These efficient algorithms facilitate the practical application of ITL criteria in adaptive systems.
    • The findings support the use of ITL metrics for superior adaptive system performance.