Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Reinforcement Schedules

Reinforcement Schedules

Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...

Improving Translational Accuracy

Improving Translational Accuracy

Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...

Generalization, Discrimination, and Extinction

Generalization, Discrimination, and Extinction

Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...

Survival Tree

Survival Tree

Survival trees are a non-parametric method used in survival analysis to model the relationship between a set of covariates and the time until an event of interest occurs, often referred to as the "time-to-event" or "survival time." This method is particularly useful when dealing with censored data, where the event has not occurred for some individuals by the end of the study period, or when the exact time of the event is unknown.
Building a Survival Tree
Constructing a...

Observational Learning

Observational Learning

Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...

Prediction Intervals

Prediction Intervals

The interval estimate of any variable is known as the prediction interval. It helps decide if a point estimate is dependable.
However, the point estimate is most likely not the exact value of the population parameter, but close to it. After calculating point estimates, we construct interval estimates, called confidence intervals or prediction intervals. This prediction interval comprises a range of values unlike the point estimate and is a better predictor of the observed sample value, y.

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Pharmacists' propensity to trust automated technologies: A demographic analysis.

Journal of the American Pharmacists Association : JAPhA·2025

Same author

The Effects of Presenting AI Uncertainty Information on Pharmacists' Trust in Automated Pill Recognition Technology: Exploratory Mixed Subjects Study.

JMIR human factors·2025

Same author

Scalable Accelerated Materials Discovery of Sustainable Polysaccharide-Based Hydrogels by Autonomous Experimentation and Collaborative Learning.

ACS applied materials & interfaces·2024

Same author

The optimization and operation of multi-energy-coupled microgrids by the improved fireworks algorithm-shuffled frog-leaping algorithm.

PeerJ. Computer science·2024

Same author

Federated Gaussian Process: Convergence, Automatic Personalization and Multi-fidelity Modeling.

IEEE transactions on pattern analysis and machine intelligence·2024

Same author

Designing Human-Centered AI to Prevent Medication Dispensing Errors: Focus Group Study With Pharmacists.

JMIR formative research·2023

Search research articles

Related Experiment Video

Updated: Aug 3, 2025

Deep Neural Networks for Image-Based Dietary Assessment

Deep Neural Networks for Image-Based Dietary Assessment

Published on: March 13, 2021

SALR: Sharpness-Aware Learning Rate Scheduler for Improved Generalization.

Xubo Yue, Maher Nouiehed, Raed Al Kontar

IEEE Transactions on Neural Networks and Learning Systems

|April 7, 2023

Summary

Sharpness-Aware Learning Rate (SALR) technique improves deep learning generalization by dynamically adjusting learning rates. SALR helps optimizers escape sharp valleys, leading to faster convergence and flatter loss function minimizers.

More Related Videos

Slice Patch Clamp Technique for Analyzing Learning-Induced Plasticity

Slice Patch Clamp Technique for Analyzing Learning-Induced Plasticity

Published on: November 11, 2017

Acquisition of a High-precision Skilled Forelimb Reaching Task in Rats

Acquisition of a High-precision Skilled Forelimb Reaching Task in Rats

Published on: June 22, 2015

Related Experiment Videos

Last Updated: Aug 3, 2025

Deep Neural Networks for Image-Based Dietary Assessment

Deep Neural Networks for Image-Based Dietary Assessment

Published on: March 13, 2021

Slice Patch Clamp Technique for Analyzing Learning-Induced Plasticity

Slice Patch Clamp Technique for Analyzing Learning-Induced Plasticity

Published on: November 11, 2017

Acquisition of a High-precision Skilled Forelimb Reaching Task in Rats

Acquisition of a High-precision Skilled Forelimb Reaching Task in Rats

Published on: June 22, 2015

Area of Science:

Deep Learning
Machine Learning Optimization

Background:

Deep learning models often struggle with generalization.
Manual tuning of learning rate schedules is complex and time-consuming.
Sharp minima in the loss landscape can hinder model convergence and performance.

Purpose of the Study:

To introduce Sharpness-Aware Learning Rate (SALR), a novel technique for automated learning rate scheduling.
To improve the generalization capabilities of deep learning models.
To enable optimizers to escape sharp minima more effectively.

Main Methods:

SALR dynamically updates the learning rate based on the local sharpness of the loss function.
The technique is designed to recover flat minimizers, promoting better generalization.
SALR was integrated with various gradient-based optimizers and tested across diverse network architectures.

Main Results:

SALR demonstrated improved generalization performance across multiple deep learning models.
The method led to faster convergence rates compared to baseline approaches.
Experiments showed that SALR effectively drives solutions towards significantly flatter regions of the loss landscape.

Conclusions:

SALR offers an effective automated approach to learning rate scheduling in deep learning.
The technique enhances model generalization and accelerates convergence.
By focusing on loss landscape sharpness, SALR contributes to more robust and efficient deep learning optimization.