Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Entropy-based kernel mixture modeling for topographic map formation.

Marc M Van Hulle1

  • 1Laboratorium voor Neuro- en Psychofysiologie, Katholieke Universiteit, Campus Gasthuisberg, B-3000 Leuven, Belgium. marc@neuro.kuleuven.ac.be

IEEE Transactions on Neural Networks
|October 6, 2004
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Correction: EEG-based classification of alzheimer's disease and frontotemporal dementia using functional connectivity.

Scientific reports·2026
Same author

The electrophysiological basis of resting-state fMRI hyperconnectivity in early Alzheimer's disease.

Alzheimer's research & therapy·2026
Same author

A Cross-Subject Band-Power Complexity Metric for Detecting Mental Fatigue Through EEG.

Brain sciences·2026
Same author

Word classification across speech modes from low-density electrocorticography signals.

Journal of neural engineering·2026
Same author

EEG-based classification of alzheimer's disease and frontotemporal dementia using functional connectivity.

Scientific reports·2026
Same author

Early aperiodic EEG changes in preclinical and prodromal Alzheimer's disease.

Alzheimer's research & therapy·2026
Same journal

Universal perceptron and DNA-like learning algorithm for binary neural networks: LSBF and PBF implementations.

IEEE transactions on neural networks·2013
Same journal

Guest editorial: special section on white box nonlinear prediction models.

IEEE transactions on neural networks·2011
Same journal

Data-based fault-tolerant control of high-speed trains with traction/braking notch nonlinearities and actuator failures.

IEEE transactions on neural networks·2011
Same journal

Guest editorial: special section on data-based control, modeling, and optimization.

IEEE transactions on neural networks·2011
Same journal

Neural network-based multiple robot simultaneous localization and mapping.

IEEE transactions on neural networks·2011
Same journal

Data-driven model-free adaptive control for a class of MIMO nonlinear discrete-time systems.

IEEE transactions on neural networks·2011
See all related articles

A novel information-theoretic learning algorithm creates kernel-based topographic maps by maximizing differential entropy. This method uniformly distributes kernel mixture densities and supports various kernel types for enhanced data representation.

Area of Science:

  • Machine Learning
  • Information Theory
  • Computational Neuroscience

Background:

  • Topographic maps are essential for unsupervised learning and data visualization.
  • Existing kernel-based methods often lack robust mechanisms for density uniformization.
  • Information-theoretic principles offer a powerful framework for learning optimal data representations.

Purpose of the Study:

  • Introduce a new information-theoretic learning algorithm for kernel-based topographic map formation.
  • Address the challenge of uniformizing cumulative distribution of kernel mixture densities.
  • Extend the algorithm to handle both one-dimensional and multidimensional data.

Main Methods:

  • Utilize a nonparametric differential entropy estimator.
  • Employ normalized gradient ascent for optimization.

Related Experiment Videos

  • Explore both differentiable (e.g., Gaussian) and nondifferentiable (e.g., rectangular) kernels.
  • Derive a fixed-point rule for heterogeneous kernel mixtures.
  • Main Results:

    • The algorithm effectively uniformizes the cumulative distribution of kernel mixture densities.
    • Performance is assessed and compared against theoretically optimal benchmarks.
    • Demonstrated support for a variety of kernel functions.
    • A fixed-point rule for heterogeneous mixtures was successfully derived.

    Conclusions:

    • The proposed information-theoretic algorithm provides an effective approach for kernel-based topographic map formation.
    • The method offers improved density uniformization and flexibility in kernel choice.
    • The work lays the foundation for multidimensional extensions of topographic map learning.