Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Search research articles

Related Experiment Videos

A forward-constrained regression algorithm for sparse kernel density estimation.

Xia Hong¹, Sheng Chen, Chris J Harris

¹School of Systems Engineering, University of Reading, Hampshire, UK. x.hong@reading.ac.uk

IEEE Transactions on Neural Networks

|February 14, 2008

Summary

This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Adaptive Multioutput Gradient RBF Tracker for Nonlinear and Nonstationary Regression.

IEEE transactions on cybernetics·2023

Same author

Deep Cascade Gradient RBF Networks With Output-Relevant Feature Extraction and Adaptation for Nonlinear and Nonstationary Processes.

IEEE transactions on cybernetics·2022

Same author

Multi-Output Selective Ensemble Identification of Nonlinear and Nonstationary Industrial Processes.

IEEE transactions on neural networks and learning systems·2020

Same author

Characterization of extended-spectrum β-lactamases (ESBLs)-producing Salmonella in retail raw chicken carcasses.

International journal of food microbiology·2017

Same author

Sclareolide enhances gemcitabine‑induced cell death through mediating the NICD and Gli1 pathways in gemcitabine‑resistant human pancreatic cancer.

Molecular medicine reports·2017

Same author

Improving the reversibility of thermal denaturation and catalytic efficiency of Bacillus licheniformis α-amylase through stabilizing a long loop in domain B.

PloS one·2017

Same journal

Universal perceptron and DNA-like learning algorithm for binary neural networks: LSBF and PBF implementations.

IEEE transactions on neural networks·2013

Same journal

Guest editorial: special section on white box nonlinear prediction models.

IEEE transactions on neural networks·2011

Same journal

Data-based fault-tolerant control of high-speed trains with traction/braking notch nonlinearities and actuator failures.

IEEE transactions on neural networks·2011

Same journal

Guest editorial: special section on data-based control, modeling, and optimization.

IEEE transactions on neural networks·2011

Same journal

Neural network-based multiple robot simultaneous localization and mapping.

IEEE transactions on neural networks·2011

Same journal

Data-driven model-free adaptive control for a class of MIMO nonlinear discrete-time systems.

IEEE transactions on neural networks·2011

See all related articles

This study introduces a novel sparse kernel density estimator using forward-constrained regression. The method efficiently selects kernels and optimizes parameters, offering a computationally inexpensive approach for density estimation.

Area of Science:

Statistics
Machine Learning
Computational Science

Background:

Kernel density estimation (KDE) is a fundamental non-parametric tool for estimating probability density functions.
Classical Parzen window (PW) methods can be computationally intensive and may not scale well with high-dimensional data.
Sparse methods are needed to reduce computational complexity and improve interpretability of KDE models.

Purpose of the Study:

To develop a computationally efficient sparse kernel density estimator.
To construct a novel algorithm based on forward-constrained regression (FCR).
To minimize the leave-one-out (LOO) test score while ensuring model positivity.

Main Methods:

The proposed algorithm constructs a sparse kernel density estimator using a forward-constrained regression (FCR) approach.

Related Experiment Videos

Significant kernels are selected iteratively, minimizing the leave-one-out (LOO) test score under positivity constraints.

Kernel widths are updated using the Gauss-Newton method, with fixed model parameter estimates.

Main Results:

The developed sparse kernel density estimator is shown to be effective through numerical examples.
The approach demonstrates low computational cost and simplicity in implementation.
The method successfully selects significant kernels and optimizes parameters efficiently.

Conclusions:

The proposed FCR-based sparse kernel density estimator offers an efficient and computationally inexpensive alternative to classical methods.
The algorithm's iterative kernel selection and parameter optimization contribute to its efficacy.
This method provides a practical solution for density estimation tasks requiring sparsity and efficiency.