Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Dictionary learning algorithms for sparse representation.

Kenneth Kreutz-Delgado1, Joseph F Murray, Bhaskar D Rao

  • 1Electrical and Computer Engineering, Jacobs School of Engineering, University of California, San Diego, La Jolla, California 92093-0407, USA. kruetz@ece.ucsd.edu

Neural Computation
|February 20, 2003
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

REMIL-IBD: Region-filtered multiple instance learning for interpretable slide-level grading of inflammatory bowel disease.

Journal of pathology informatics·2026
Same author

Transition of the presynaptic vesicle cluster from a compact to dispersed organization during long-term potentiation.

Proceedings of the National Academy of Sciences of the United States of America·2026
Same author

Tactile stimulation and newborn heart rate responses in the delivery room: an observational video study.

Resuscitation·2026
Same author

Synaptic spine head morphodynamics from graph grammar rules for actin dynamics.

bioRxiv : the preprint server for biology·2026
Same author

Dynamical mechanisms for coordinating long-term working memory based on the precision of spike-timing in cortical neurons.

Biological cybernetics·2026
Same author

Spatial Immune Profiling and AI-Based Classifiers Identify Predictors of BCG Therapy Outcomes in High-Risk Non-Muscle-Invasive Bladder Cancer.

Cancers·2026
Same journal

A Model-Free Reinforcement Learning Implementation of Decision Making Under Uncertainty by Sequential Sampling.

Neural computation·2026
Same journal

DROP: Distributional and Regular Optimism and Pessimism for Reinforcement Learning.

Neural computation·2026
Same journal

Hierarchical Active Inference Using Successor Representations.

Neural computation·2026
Same journal

W-Kernel and Its Principal Space for Frequentist Evaluation of Bayesian Estimators.

Neural computation·2026
Same journal

A Hidden Markov Model-Inspired Sequence Classification Method for Hyperdimensional Computing.

Neural computation·2026
Same journal

Sparse Graphical Modeling for Electrophysiological Phase-Based Connectivity Using Circular Statistics.

Neural computation·2026
See all related articles

This study introduces algorithms for learning domain-specific dictionaries, enabling sparse representations of environmental signals. These data-driven dictionaries improve signal separation and achieve higher coding efficiency in image compression.

Area of Science:

  • Machine Learning
  • Signal Processing
  • Computational Imaging

Background:

  • Sparse representations are crucial for efficient signal processing and data compression.
  • Learning domain-specific dictionaries enhances the ability to capture environmental signal characteristics.
  • Existing methods like Independent Component Analysis (ICA) have limitations in signal separation.

Purpose of the Study:

  • To develop algorithms for data-driven learning of domain-specific overcomplete dictionaries.
  • To achieve maximum likelihood and maximum a posteriori dictionary estimates using Bayesian models.
  • To enable concise and sparse representations of environmental signals.

Main Methods:

  • Utilized Bayesian models with concave/Schur-concave (CSC) negative log priors.

Related Experiment Videos

  • Developed iterative algorithms combining sparse representation finding (FOCUSS variants) and dictionary updates.
  • Employed synthetic data and natural images for experimental validation.

    • Main Results:

    • Demonstrated improved performance over ICA methods in signal-to-noise ratios for complete dictionaries.
    • Showcased accurate recovery of true underlying dictionaries and sparse sources in the overcomplete case.
    • Achieved higher coding efficiency (compression and accuracy) with learned overcomplete dictionaries for natural images.

    Conclusions:

    • The developed algorithms effectively learn environmentally adapted dictionaries for sparse signal representation.
    • Overcomplete dictionaries offer superior performance in terms of signal separation, source recovery, and image coding efficiency.
    • This approach provides a powerful tool for analyzing and compressing complex environmental signals.