Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Associative Learning

Associative Learning

Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...

Purposive Learning

Purposive Learning

E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a...

Cognitive Learning

Cognitive Learning

Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...

Linear time-invariant Systems

Linear time-invariant Systems

A system is linear if it displays the characteristics of homogeneity and additivity, together termed the superposition property. This principle is fundamental in all linear systems. Linear time-invariant (LTI) systems include systems with linear elements and constant parameters.
The input-output behavior of an LTI system can be fully defined by its response to an impulsive excitation at its input. Once this impulse response is known, the system's reaction to any other input can be...

Observational Learning

Observational Learning

Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...

Classification of Systems-I

Classification of Systems-I

Linearity is a system property characterized by a direct input-output relationship, combining homogeneity and additivity.
Homogeneity dictates that if an input x(t) is multiplied by a constant c, the output y(t) is multiplied by the same constant. Mathematically, this is expressed as:

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

In situ mapping of iron oxidation in laminar metal fuel flames using X-ray absorption spectroscopy.

Journal of synchrotron radiation·2026

Same author

Hyperbolic Neural Population Geometry Benefits Computation.

ArXiv·2026

Same author

Compositionality and systematicity emerge from iterated learning in deep linear networks.

Proceedings of the National Academy of Sciences of the United States of America·2026

Same author

Astrocyte-induced internal state transitions reshape brainwide sensory, integrative, and motor computations.

bioRxiv : the preprint server for biology·2026

Same author

Stability through plasticity: Finding robust memories through representational drift.

Proceedings of the National Academy of Sciences of the United States of America·2025

Same author

Humans and neural networks show similar patterns of transfer and interference during continual learning.

Nature human behaviour·2025

Search research articles

Related Experiment Video

Updated: Jun 29, 2025

A Virtual Machine Platform for Non-Computer Professionals for Using Deep Learning to Classify Biological Sequences of Metagenomic Data

A Virtual Machine Platform for Non-Computer Professionals for Using Deep Learning to Classify Biological Sequences of Metagenomic Data

Published on: September 25, 2021

Exact learning dynamics of deep linear networks with prior knowledge.

Clémentine C J Dominé¹, Lukas Braun², James E Fitzgerald³

¹Gatsby Computational Neuroscience Unit, University College London, London, United Kingdom.

Journal of Statistical Mechanics (Online)

|March 25, 2024

Summary

Deep neural network learning relies on initial weights. This study provides exact solutions for learning dynamics in deep linear networks, revealing how initializations impact learning speed and convergence.

Keywords:

deep learning learning theory machine learning

More Related Videos

Deep Neural Networks for Image-Based Dietary Assessment

Deep Neural Networks for Image-Based Dietary Assessment

Published on: March 13, 2021

A Step-by-Step Implementation of DeepBehavior, Deep Learning Toolbox for Automated Behavior Analysis

A Step-by-Step Implementation of DeepBehavior, Deep Learning Toolbox for Automated Behavior Analysis

Published on: February 6, 2020

Related Experiment Videos

Last Updated: Jun 29, 2025

A Virtual Machine Platform for Non-Computer Professionals for Using Deep Learning to Classify Biological Sequences of Metagenomic Data

A Virtual Machine Platform for Non-Computer Professionals for Using Deep Learning to Classify Biological Sequences of Metagenomic Data

Published on: September 25, 2021

Deep Neural Networks for Image-Based Dietary Assessment

Deep Neural Networks for Image-Based Dietary Assessment

Published on: March 13, 2021

A Step-by-Step Implementation of DeepBehavior, Deep Learning Toolbox for Automated Behavior Analysis

A Step-by-Step Implementation of DeepBehavior, Deep Learning Toolbox for Automated Behavior Analysis

Published on: February 6, 2020

Area of Science:

Machine Learning
Deep Learning Theory
Computational Neuroscience

Background:

Deep neural network (DNN) learning effectiveness is heavily influenced by initial network weights.
Theoretical understanding of how prior knowledge in initial weights shapes learning dynamics remains limited.

Purpose of the Study:

To derive exact solutions for learning dynamics in deep linear networks with rich prior knowledge.
To generalize existing theoretical frameworks for analyzing learning in DNNs.

Main Methods:

Generalization of Fukumizu's matrix Riccati solution.
Derivation of explicit expressions for evolving network function, representational similarity, and neural tangent kernel.
Analysis of a broad class of initializations and tasks.

Main Results:

Identified task-independent initializations that accelerate learning dynamics from slow to fast exponential trajectories.
Demonstrated convergence to a global optimum with preserved representational similarity, independent of initial internal representations.
Characterized the dynamic alignment of network weights with task structure.

Conclusions:

Developed a mathematical toolkit for understanding the impact of prior knowledge on deep learning dynamics.
Provided rigorous justification for previous learning models and highlighted implications for continual and reversal learning.
Showcased how specific initializations can decouple learning trajectories from initial representational structures.