Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Long-term Potentiation01:35

Long-term Potentiation

58.9K
Long-term potentiation, or LTP, is one of the ways by which synaptic plasticity—changes in the strength of chemical synapses—can occur in the brain. LTP is the process of synaptic strengthening that occurs over time between pre- and postsynaptic neuronal connections. The synaptic strengthening of LTP works in opposition to the synaptic weakening of long-term depression (LTD) and together are the main mechanisms that underlie learning and memory.
58.9K
Introduction to Learning01:18

Introduction to Learning

1.3K
Learning is the process of acquiring knowledge or skills through practice or experience, leading to long-lasting behavioral changes. This acquisition occurs through interaction with the environment and requires practice or experience. For instance, mastering a skill such as surfing requires considerable practice and experience, highlighting the essential role of repeated interactions with the environment in learning.
In contrast to learned behaviors, unlearned behaviors such as crying, sexual...
1.3K
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving01:29

Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving

361
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
361

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Spatiotemporal Sequence Prediction With Point Processes and Self-Organizing Decision Trees.

IEEE transactions on neural networks and learning systems·2021
Same author

Markovian RNN: An Adaptive Time Series Prediction Network With HMM-Based Switching for Nonstationary Environments.

IEEE transactions on neural networks and learning systems·2021
Same author

Multi-Label Sentiment Analysis on 100 Languages With Dynamic Weighting for Label Imbalance.

IEEE transactions on neural networks and learning systems·2021
Same author

Achieving Online Regression Performance of LSTMs With Simple RNNs.

IEEE transactions on neural networks and learning systems·2021
Same author

Online Anomaly Detection With Bandwidth Optimized Hierarchical Kernel Density Estimators.

IEEE transactions on neural networks and learning systems·2020
Same author

Energy-Efficient LSTM Networks for Online Learning.

IEEE transactions on neural networks and learning systems·2019

Related Experiment Videos

Efficient Online Learning Algorithms Based on LSTM Neural Networks.

Tolga Ergen, Suleyman Serdar Kozat

    IEEE Transactions on Neural Networks and Learning Systems
    |September 19, 2017
    PubMed
    Summary

    This study introduces novel Long Short-Term Memory (LSTM) networks for online nonlinear regression, offering efficient training via particle filtering (PF) and achieving optimal parameter estimation with reduced computational complexity.

    Related Experiment Videos

    Area of Science:

    • Machine Learning
    • Deep Learning
    • Statistical Modeling

    Background:

    • Online nonlinear regression presents challenges in real-time parameter estimation.
    • Existing methods often lack efficiency or guaranteed convergence for complex models.

    Purpose of the Study:

    • To develop novel regression structures using Long Short-Term Memory (LSTM) networks for online nonlinear regression.
    • To introduce efficient and effective online training methods for these novel structures.
    • To demonstrate the superiority of LSTM-based approaches over conventional methods.

    Main Methods:

    • Developed LSTM-based regression structures and formulated them in a state-space form.
    • Implemented particle filtering (PF)-based updates for efficient training.
    • Also provided stochastic gradient descent and extended Kalman filter-based updates.
    • Introduced a Gated Recurrent Unit (GRU)-based alternative.

    Main Results:

    • PF-based training guarantees convergence to optimal parameter estimation under specific conditions.
    • Achieved performance comparable to first-order gradient methods with controlled particle counts.
    • LSTM-based approach demonstrated superiority in sequential prediction tasks on real-world datasets.
    • Significant performance improvements observed compared to conventional methods.

    Conclusions:

    • Novel LSTM and GRU-based regression structures offer efficient and effective online nonlinear regression.
    • Particle filtering provides a robust and computationally efficient training mechanism.
    • The proposed methods significantly outperform traditional approaches in sequential prediction tasks.