Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Residuals and Least-Squares Property01:11

Residuals and Least-Squares Property

The vertical distance between the actual value of y and the estimated value of y. In other words, it measures the vertical distance between the actual data point and the predicted point on the line
If the observed data point lies above the line, the residual is positive, and the line underestimates the actual data value for y. If the observed data point lies below the line, the residual is negative, and the line overestimates the actual data value for y.
The process of fitting the best-fit...
Linearization and Approximation01:26

Linearization and Approximation

Linearization is a mathematical technique used to approximate complex, nonlinear functions with simpler linear models in the vicinity of a chosen reference point. The method is based on the idea that, although a function may be difficult to evaluate exactly, its behavior near a specific input value can often be closely approximated by the tangent line at that point. This approach is particularly useful when small deviations from a known value are involved.Consider the square root function, for...
Application of Linearization and Approximation01:29

Application of Linearization and Approximation

A drone flying through complex terrain often relies on more than one sensing method to estimate small changes in altitude. Along with direct measurements, air pressure provides a useful indirect indicator of vertical movement. Atmospheric pressure decreases as altitude increases, and this relationship is commonly described using an exponential model. Although accurate, converting pressure measurements into altitude values requires calculations that are too complex to perform repeatedly during...
Role of Matrix Metalloproteases in Degradation of ECM01:23

Role of Matrix Metalloproteases in Degradation of ECM

Matrix metalloproteases (MMPs) are enzymes involved in the hydrolysis of proteins and glycoproteins of the extracellular matrix. MMPs are essential for the migration and proliferation of cells through the dense matrix network, throughout embryonic development, and throughout morphogenesis. The first MMP activity discovered was a collagenase in a tadpole's tail undergoing metamorphosis. The active collagen deposition and modifications lead to the morphogenesis of tadpoles into the adult body.
A...
Multi-input and Multi-variable systems01:22

Multi-input and Multi-variable systems

Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence of...
Regression Toward the Mean01:52

Regression Toward the Mean

Regression toward the mean (“RTM”) is a phenomenon in which extremely high or low values—for example, and individual’s blood pressure at a particular moment—appear closer to a group’s average upon remeasuring. Although this statistical peculiarity is the result of random error and chance, it has been problematic across various medical, scientific, financial and psychological applications. In particular, RTM, if not taken into account, can interfere when researchers try to extrapolate results...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Benchmarking the urinary transplant metabolome of kidney transplant recipients using healthy organ donors.

Frontiers in transplantation·2026
Same author

Machine learning based EMG analysis of intermuscular coherence and cumulant density in tremor and myoclonus.

Clinical neurophysiology : official journal of the International Federation of Clinical Neurophysiology·2026
Same author

Toxicological impacts of environmentally equivalent microplastics and cadmium co-exposure in tropical freshwater crab <i>Sartoriana spinigera</i>.

Frontiers in toxicology·2026
Same author

Structure Is Information: Structural Identifiability Mappings for Machine Learning With Partially Observed Dynamical Systems.

IEEE transactions on cybernetics·2026
Same author

Prototype-Based Classifiers and Vector Quantization on a Quantum Computer-Implementing Integer Arithmetic Oracles for Nearest Prototype Search.

Entropy (Basel, Switzerland)·2026
Same author

The Impact of Early Postoperative Oral Intake on the Length of Hospital Stay: A Meta-Analysis.

Acta anaesthesiologica Scandinavica·2026
Same journal

Universal perceptron and DNA-like learning algorithm for binary neural networks: LSBF and PBF implementations.

IEEE transactions on neural networks·2013
Same journal

Guest editorial: special section on white box nonlinear prediction models.

IEEE transactions on neural networks·2011
Same journal

Data-based fault-tolerant control of high-speed trains with traction/braking notch nonlinearities and actuator failures.

IEEE transactions on neural networks·2011
Same journal

Guest editorial: special section on data-based control, modeling, and optimization.

IEEE transactions on neural networks·2011
Same journal

Neural network-based multiple robot simultaneous localization and mapping.

IEEE transactions on neural networks·2011
Same journal

Data-driven model-free adaptive control for a class of MIMO nonlinear discrete-time systems.

IEEE transactions on neural networks·2011
See all related articles

Related Experiment Videos

Regularization in matrix relevance learning.

Petra Schneider1, Kerstin Bunte, Han Stiekema

  • 1Johann Bernoulli Institute for Mathematics and Computer Science, University of Groningen, Groningen, The Netherlands. p.schneider@rug.nl

IEEE Transactions on Neural Networks
|March 19, 2010
PubMed
Summary
This summary is machine-generated.

This study introduces a regularization technique for matrix learning in Learning Vector Quantization (LVQ) to improve training stability and generalization. The method enhances generalized LVQ (GLVQ) by preventing oversimplification and improving performance on classification tasks.

Related Experiment Videos

Area of Science:

  • Machine Learning
  • Pattern Recognition
  • Data Mining

Background:

  • Learning Vector Quantization (LVQ) algorithms utilize adaptive distance measures.
  • Matrix learning extends LVQ by incorporating relevance matrices for adaptive feature weighting.
  • Standard metric learning can lead to oversimplification and training instabilities due to excessive dimension elimination.

Purpose of the Study:

  • To introduce a regularization technique for matrix learning in Generalized LVQ (GLVQ).
  • To mitigate oversimplification and improve generalization ability in LVQ-based classification.
  • To demonstrate the effectiveness of regularization, even with rank-limited relevance matrices.

Main Methods:

  • A regularization term is added to the cost function of GLVQ.
  • The proposed matrix learning approach is tested on artificial data.
  • The technique is applied to benchmark classification datasets from the UCI Repository.

Main Results:

  • Regularization effectively prevents unfavorable training behaviors like oversimplification.
  • The proposed method improves the generalization ability of GLVQ.
  • The usefulness of regularization is confirmed for rank-limited relevance matrices, enabling low-dimensional data representation.

Conclusions:

  • Regularization is a valuable addition to matrix learning in GLVQ for enhanced performance and stability.
  • The technique offers a robust solution for classification tasks, particularly with high-dimensional or complex data.
  • This work highlights the benefits of regularization for implicit low-dimensional data representation in metric learning.