Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Sparse modeling using orthogonal forward regression with PRESS statistic and regularization.

Sheng Chen1, Xia Hong, Chris J Harris

  • 1Department of Electronics and Computer Science, University of Southampton, Southampton SO17 1BJ, UK.

IEEE Transactions on Systems, Man, and Cybernetics. Part B, Cybernetics : a Publication of the IEEE Systems, Man, and Cybernetics Society
|September 21, 2004
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Adaptive Multioutput Gradient RBF Tracker for Nonlinear and Nonstationary Regression.

IEEE transactions on cybernetics·2023
Same author

Deep Cascade Gradient RBF Networks With Output-Relevant Feature Extraction and Adaptation for Nonlinear and Nonstationary Processes.

IEEE transactions on cybernetics·2022
Same author

Multi-Output Selective Ensemble Identification of Nonlinear and Nonstationary Industrial Processes.

IEEE transactions on neural networks and learning systems·2020
Same author

Characterization of extended-spectrum β-lactamases (ESBLs)-producing Salmonella in retail raw chicken carcasses.

International journal of food microbiology·2017
Same author

Sclareolide enhances gemcitabine‑induced cell death through mediating the NICD and Gli1 pathways in gemcitabine‑resistant human pancreatic cancer.

Molecular medicine reports·2017
Same author

Improving the reversibility of thermal denaturation and catalytic efficiency of Bacillus licheniformis α-amylase through stabilizing a long loop in domain B.

PloS one·2017
Same journal

Strategic Ability Updating in Concurrent Games by Coalitional Commitment.

IEEE transactions on systems, man, and cybernetics. Part B, Cybernetics : a publication of the IEEE Systems, Man, and Cybernetics Society·2015
Same journal

Meta-Analysis of the First Facial Expression Recognition Challenge.

IEEE transactions on systems, man, and cybernetics. Part B, Cybernetics : a publication of the IEEE Systems, Man, and Cybernetics Society·2012
Same journal

Adjustable model-based fusion method for multispectral and panchromatic images.

IEEE transactions on systems, man, and cybernetics. Part B, Cybernetics : a publication of the IEEE Systems, Man, and Cybernetics Society·2012
Same journal

Face Feature Weighted Fusion Based on Fuzzy Membership Degree for Video Face Recognition.

IEEE transactions on systems, man, and cybernetics. Part B, Cybernetics : a publication of the IEEE Systems, Man, and Cybernetics Society·2012
Same journal

A New Adaptive Fast Cellular Automaton Neighborhood Detection and Rule Identification Algorithm.

IEEE transactions on systems, man, and cybernetics. Part B, Cybernetics : a publication of the IEEE Systems, Man, and Cybernetics Society·2012
Same journal

Human-arm-and-hand-dynamic model with variability analyses for a stylus-based haptic interface.

IEEE transactions on systems, man, and cybernetics. Part B, Cybernetics : a publication of the IEEE Systems, Man, and Cybernetics Society·2012
See all related articles

This study presents an efficient algorithm for creating sparse regression models by optimizing generalization. It uses leave-one-out cross-validation to minimize prediction error, ensuring effective and automatic model construction.

Area of Science:

  • Machine Learning
  • Statistical Modeling
  • Computational Statistics

Background:

  • Sparse regression models are crucial for interpretability and generalization in high-dimensional data.
  • Existing methods often require separate validation sets or manual parameter tuning, limiting efficiency and automation.
  • Optimizing generalization directly during model construction is a key challenge in statistical learning.

Purpose of the Study:

  • To develop an efficient and automatic algorithm for constructing sparse linear-in-the-weights regression models.
  • To directly optimize model generalization capability using leave-one-out cross-validation.
  • To enhance model sparsity through integrated regularization techniques.

Main Methods:

  • The algorithm employs an orthogonal forward regression strategy for computational efficiency.

Related Experiment Videos

  • It incrementally minimizes the predicted residual sums of squares (PRESS) statistic, a leave-one-out error measure.
  • A local regularization method is incorporated to promote model sparsity.

    • Main Results:

    • The proposed algorithm effectively constructs sparse regression models that demonstrate strong generalization performance.
    • It eliminates the need for a separate validation dataset during model construction.
    • Comparisons with state-of-the-art methods show competitive or superior performance in generating sparse, generalizable models.

    Conclusions:

    • The developed algorithm offers an efficient, automatic, and effective approach to sparse regression model construction.
    • Directly optimizing generalization via PRESS minimization is a viable strategy for building robust models.
    • The method provides a valuable tool for researchers and practitioners seeking interpretable and high-performing predictive models.