Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Neural Circuits01:25

Neural Circuits

919
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
919
Neural Regulation01:37

Neural Regulation

39.0K
Digestion begins with a cephalic phase that prepares the digestive system to receive food. When our brain processes visual or olfactory information about food, it triggers impulses in the cranial nerves innervating the salivary glands and stomach to prepare for food.
39.0K
Neuroplasticity01:01

Neuroplasticity

245
Neuroplasticity reflects the brain's remarkable capacity to adapt and evolve, responding dynamically to learning, experiences, or injury by reorganizing its neural circuitry. This reorganization involves creating new neural connections and refining old ones through a series of biological processes that contribute to the brain's lifelong development and adaptability.
245

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Follow the money: A startup-based measure of AI exposure across occupations, industries, and regions.

PNAS nexus·2026
Same author

Entropy-driven phase behavior of all-DNA associative polymers.

The Journal of chemical physics·2025
Same author

ANNaMo: Coarse-grained modeling for folding and assembly of RNA and DNA systems.

The Journal of chemical physics·2024
Same author

Asymmetric Relatedness from Partial Correlation.

Entropy (Basel, Switzerland)·2022
Same author

A Context Similarity-Based Analysis of Countries' Technological Performance.

Entropy (Basel, Switzerland)·2020
Same author

Where is your field going? A machine learning approach to study the relative motion of the domains of physics.

PloS one·2020

Related Experiment Video

Updated: May 10, 2025

Author Spotlight: Advancing Alzheimer's Research – Exploring Early Detection and Multi-Omics Approaches
09:47

Author Spotlight: Advancing Alzheimer's Research – Exploring Early Detection and Multi-Omics Approaches

Published on: December 15, 2023

901

The Intrinsic Dimension of Neural Network Ensembles.

Francesco Tosti Guerra1, Andrea Napoletano2, Andrea Zaccaria2

  • 1Department of Physics, Sapienza University of Rome, 00185 Rome, Italy.

Entropy (Basel, Switzerland)
|April 26, 2025
PubMed
Summary

Random network initialization significantly increases neural network ensemble variability more than data distortion or dropout. Understanding these training impacts optimizes model performance and parameter space exploration.

Keywords:
ensemble learningintrinsic dimensionmachine learning explainabilityneural network

More Related Videos

Author Spotlight: Advancing Large-Scale Neural Dynamics Through HD-MEA Technology
09:44

Author Spotlight: Advancing Large-Scale Neural Dynamics Through HD-MEA Technology

Published on: March 8, 2024

4.5K
Statistical Modelling of Cortical Connectivity Using Non-invasive Electroencephalograms
08:51

Statistical Modelling of Cortical Connectivity Using Non-invasive Electroencephalograms

Published on: November 1, 2019

5.6K

Related Experiment Videos

Last Updated: May 10, 2025

Author Spotlight: Advancing Alzheimer's Research – Exploring Early Detection and Multi-Omics Approaches
09:47

Author Spotlight: Advancing Alzheimer's Research – Exploring Early Detection and Multi-Omics Approaches

Published on: December 15, 2023

901
Author Spotlight: Advancing Large-Scale Neural Dynamics Through HD-MEA Technology
09:44

Author Spotlight: Advancing Large-Scale Neural Dynamics Through HD-MEA Technology

Published on: March 8, 2024

4.5K
Statistical Modelling of Cortical Connectivity Using Non-invasive Electroencephalograms
08:51

Statistical Modelling of Cortical Connectivity Using Non-invasive Electroencephalograms

Published on: November 1, 2019

5.6K

Area of Science:

  • Artificial Intelligence
  • Machine Learning
  • Computational Neuroscience

Background:

  • Neural networks exhibit complex collective behaviors during training.
  • These behaviors are often visualized on evolving mathematical structures called manifolds.
  • The intrinsic dimension quantifies ensemble variability and training strategy impact.

Purpose of the Study:

  • To analyze the collective behavior of neural network ensembles.
  • To quantify the impact of various training strategies on parameter space exploration.
  • To understand how training choices affect model accuracy.

Main Methods:

  • Characterizing neural network ensembles using intrinsic dimension on complex manifolds.
  • Quantifying parameter space coverage influenced by training choices.
  • Investigating the impact of random initialization, data distortion, dropout, and batch shuffle.

Main Results:

  • Random initialization is the primary driver of variability in neural network ensembles.
  • Intrinsic dimension correlates with parameter space coverage and network variability.
  • Combinations of training strategies and their impact on prediction accuracy were analyzed.

Conclusions:

  • Training choices, particularly random initialization, significantly influence neural network ensemble dynamics.
  • Higher intrinsic dimension indicates greater variability and parameter space exploration.
  • This study highlights the critical, often underestimated, role of training strategies in deep learning.