Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Hazard Rate

Hazard Rate

The hazard rate, also known as the hazard function or failure rate, is a statistical measure used to describe the instantaneous rate at which an event occurs, given that the event has not yet happened. From a probabilistic perspective, it represents the likelihood that a subject will experience the event in a very small time interval, conditional on surviving up to the beginning of that interval. In terms of frequency, the hazard rate can be viewed as the ratio of the number of events to the...

Current Growth And Decay In RL Circuits

Current Growth And Decay In RL Circuits

The current growth and decay in RL circuits can be understood by considering a series RL circuit consisting of a resistor, an inductor, a constant source of emf, and two switches. When the first switch is closed, the circuit is equivalent to a single-loop circuit consisting of a resistor and an inductor connected to a source of emf. In this case, the source of emf produces a current in the circuit. If there were no self-inductance in the circuit, the current would rise immediately to a steady...

Regression Toward the Mean

Regression Toward the Mean

Regression toward the mean (“RTM”) is a phenomenon in which extremely high or low values—for example, and individual’s blood pressure at a particular moment—appear closer to a group’s average upon remeasuring. Although this statistical peculiarity is the result of random error and chance, it has been problematic across various medical, scientific, financial and psychological applications. In particular, RTM, if not taken into account, can interfere when...

Survival Tree

Survival Tree

Survival trees are a non-parametric method used in survival analysis to model the relationship between a set of covariates and the time until an event of interest occurs, often referred to as the "time-to-event" or "survival time." This method is particularly useful when dealing with censored data, where the event has not occurred for some individuals by the end of the study period, or when the exact time of the event is unknown.
Building a Survival Tree
Constructing a...

Introduction to Learning

Introduction to Learning

Learning is the process of acquiring knowledge or skills through practice or experience, leading to long-lasting behavioral changes. This acquisition occurs through interaction with the environment and requires practice or experience. For instance, mastering a skill such as surfing requires considerable practice and experience, highlighting the essential role of repeated interactions with the environment in learning.
In contrast to learned behaviors, unlearned behaviors such as crying, sexual...

Generalization, Discrimination, and Extinction

Generalization, Discrimination, and Extinction

Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Metabolic Reprogramming in Recurrent Spontaneous Abortion: Key Biomarkers Identification and Diagnostic Model Development.

IET systems biology·2026

Same author

Single-cell and spatial transcriptomics identify SPP1 + trophoblast necroptosis as a potential contributor to late-onset preeclampsia via SPP1-CD44-mediated interaction with macrophages.

Journal of translational medicine·2026

Same author

OPRK1 insufficiency results in trophoblast dysfunction and correlates with preeclampsia pathogenesis.

Journal of reproductive immunology·2026

Same author

Integrating Frequency Guidance into Multi-Source Domain Generalization for Acoustic-Based Fault Diagnosis in Industrial Systems.

Sensors (Basel, Switzerland)·2026

Same author

Cytokine profiling of maternal peripheral and umbilical cord blood in term and preterm labor.

Frontiers in immunology·2026

Same author

Sparse Variational Student-t Processes for Heavy-Tailed Modeling.

IEEE transactions on neural networks and learning systems·2026

Same journal

Granular Ball-Based Noise-Resistant Fuzzy Multineighborhood Feature Selection via Label Enhancement and Feature Graph.

IEEE transactions on neural networks and learning systems·2026

Same journal

Fighting Evolving Spam With ARTMAP Models: A Noise-Resilient Online Detection Framework.

IEEE transactions on neural networks and learning systems·2026

Same journal

HyperSAT: Unsupervised Hypergraph Neural Networks for Weighted MaxSAT Problems.

IEEE transactions on neural networks and learning systems·2026

Same journal

Negation of Basic Belief Assignment in Multisource Information Fusion on Dempster-Shafer Theory With Applications in Pattern Classification.

IEEE transactions on neural networks and learning systems·2026

Same journal

Intervention Feasible Region and Driver Risk Capacity Aware Human-Machine Collaborative Safe Trajectory Planning.

IEEE transactions on neural networks and learning systems·2026

Same journal

A Unified Differential Denoising Learning Framework With a Pre-Trained Model and Fuzzy Graph Networks for Drug-Drug Interaction Prediction.

IEEE transactions on neural networks and learning systems·2026

See all related articles

Search research articles

Related Experiment Video

Updated: Sep 30, 2025

Deep Neural Networks for Image-Based Dietary Assessment

Deep Neural Networks for Image-Based Dietary Assessment

Published on: March 13, 2021

Learning Rate Dropout.

Huangxing Lin, Weihong Zeng, Yihong Zhuang

IEEE Transactions on Neural Networks and Learning Systems

|March 14, 2022

Summary

This summary is machine-generated.

Learning rate dropout (LRD) accelerates deep neural network training and improves generalization by randomly dropping learning rates. This technique helps optimizers escape local optima and saddle points for faster, more robust convergence.

Related Experiment Videos

Last Updated: Sep 30, 2025

Deep Neural Networks for Image-Based Dietary Assessment

Deep Neural Networks for Image-Based Dietary Assessment

Published on: March 13, 2021

Area of Science:

Artificial Intelligence
Machine Learning
Deep Learning

Background:

Deep neural network training relies heavily on optimization algorithms.
Existing optimizers often suffer from slow convergence and difficulty escaping local optima.

Purpose of the Study:

To introduce Learning Rate Dropout (LRD) as a novel gradient descent technique.
To enhance convergence speed and generalization in deep learning models.

Main Methods:

LRD randomly sets a subset of learning rates to zero at each iteration.
Only parameters with non-zero learning rates are updated.
Gradients for dropped parameters are accumulated for future updates, similar to momentum.

Main Results:

LRD significantly accelerates the training process of deep neural networks.
The technique effectively prevents overfitting, leading to better model generalization.
LRD aids optimizers in escaping saddle points and local optima.

Conclusions:

Learning Rate Dropout is a simple yet effective method to improve deep learning optimization.
LRD offers a promising approach for faster and more robust model training.