Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Neural Circuits

Neural Circuits

Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...

Protein Networks

Protein Networks

An organism can have thousands of different proteins, and these proteins must cooperate to ensure the health of an organism. Proteins bind to other proteins and form complexes to carry out their functions. Many proteins interact with multiple other proteins creating a complex network of protein interactions.
These interactions can be represented through maps depicting protein-protein interaction networks, represented as nodes and edges. Nodes are circles that are representative of a protein,...

Circuit Terminology

Circuit Terminology

An electrical network is a system composed of interconnected elements, such as resistors, capacitors, inductors, and voltage or current sources. Unlike a circuit, an electrical network does not necessarily form a closed path. In other words, while all circuits can be considered networks due to their interconnected nature, not every network qualifies as a circuit.
A circuit, on the other hand, is also an interconnected system of electrical elements but must contain one or more closed paths.

Neural Regulation

Neural Regulation

Digestion begins with a cephalic phase that prepares the digestive system to receive food. When our brain processes visual or olfactory information about food, it triggers impulses in the cranial nerves innervating the salivary glands and stomach to prepare for food.

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

What if eye...? Computationally recreating vision evolution.

Science advances·2025

Same author

Dynamics in Deep Classifiers Trained with the Square Loss: Normalization, Low Rank, Neural Collapse, and Generalization Bounds.

Research (Washington, D.C.)·2023

Same author

Complexity control by gradient descent in deep networks.

Nature communications·2020

Same author

Scale and translation-invariance for novel objects in human vision.

Scientific reports·2020

Same author

Invariant recognition drives neural representations of action sequences.

PLoS computational biology·2017

Same author

A fast, invariant representation for human action in the visual system.

Journal of neurophysiology·2017

Same journal

Tau protein as a regulator of mitochondrial function and dynamics.

Proceedings of the National Academy of Sciences of the United States of America·2026

Same journal

A scalable, dividing cell model for the robust propagation and quantification of human sporadic Creutzfeldt-Jakob disease prions.

Proceedings of the National Academy of Sciences of the United States of America·2026

Same journal

Epigenetic regulation of mesenchymal BMP signaling directs postnatal organ innervation.

Proceedings of the National Academy of Sciences of the United States of America·2026

Same journal

Single-shot wide-field biochemical imaging at 1 kHz frame rate.

Proceedings of the National Academy of Sciences of the United States of America·2026

Same journal

Morphogenesis and topological evolution of a frustrated nematic liquid crystal under confinement.

Proceedings of the National Academy of Sciences of the United States of America·2026

Same journal

B cell-intrinsic CXCR3 drives efficient generation of ectopic pulmonary germinal center responses to influenza A virus infection.

Proceedings of the National Academy of Sciences of the United States of America·2026

See all related articles

Search research articles

Related Experiment Video

Updated: Dec 18, 2025

Author Spotlight: Enhancement of Salient Object Detection for Smart Grid Applications

Author Spotlight: Enhancement of Salient Object Detection for Smart Grid Applications

Published on: December 15, 2023

Theoretical issues in deep networks.

Tomaso Poggio¹, Andrzej Banburski², Qianli Liao²

¹Center for Brains, Minds, and Machines, Massachusetts Institute of Technology, Cambridge, MA 02139 tp@ai.mit.edu.

Proceedings of the National Academy of Sciences of the United States of America

|June 11, 2020

Summary

This summary is machine-generated.

Deep learning theory is advancing, showing deep networks can avoid the curse of dimensionality for specific functions. Gradient descent implicitly regularizes deep networks, minimizing expected error in overparameterized models.

Keywords:

approximation deep learning generalization machine learning optimization

More Related Videos

Author Spotlight: Advancing Alzheimer's Research – Exploring Early Detection and Multi-Omics Approaches

Author Spotlight: Advancing Alzheimer's Research – Exploring Early Detection and Multi-Omics Approaches

Published on: December 15, 2023

Deep Neural Networks for Image-Based Dietary Assessment

Deep Neural Networks for Image-Based Dietary Assessment

Published on: March 13, 2021

Related Experiment Videos

Last Updated: Dec 18, 2025

Author Spotlight: Enhancement of Salient Object Detection for Smart Grid Applications

Author Spotlight: Enhancement of Salient Object Detection for Smart Grid Applications

Published on: December 15, 2023

Author Spotlight: Advancing Alzheimer's Research – Exploring Early Detection and Multi-Omics Approaches

Author Spotlight: Advancing Alzheimer's Research – Exploring Early Detection and Multi-Omics Approaches

Published on: December 15, 2023

Deep Neural Networks for Image-Based Dietary Assessment

Deep Neural Networks for Image-Based Dietary Assessment

Published on: March 13, 2021

Area of Science:

Computer Science
Artificial Intelligence
Machine Learning Theory

Background:

Deep learning's theoretical underpinnings remain largely unknown.
Key questions involve approximation power, optimization dynamics, and generalization.
Overparameterization and lack of explicit regularization pose theoretical challenges.

Purpose of the Study:

To provide a theoretical characterization of deep learning.
To address approximation capabilities and optimization dynamics.
To explain out-of-sample performance in overparameterized deep networks.

Main Methods:

Analyzing approximation power of deep versus shallow networks.
Investigating gradient flow dynamics of normalized weights.
Connecting gradient descent dynamics to constrained optimization problems.

Main Results:

Deep convolutional networks can avoid the curse of dimensionality for certain compositional functions.
Gradient flow of normalized weights is equivalent to minimizing loss under a unit norm constraint.
Implicit regularization occurs during gradient descent with exponential loss functions.

Conclusions:

Deep learning models exhibit implicit regularization, leading to minimum norm solutions.
Gradient descent in deep networks effectively minimizes expected error.
Theoretical insights advance understanding of deep learning's success.