Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Multicompartment Models: Overview01:14

Multicompartment Models: Overview

474
Multicompartment models are mathematical constructs that depict how drugs are distributed and eliminated within the body. They segment the body into several compartments, symbolizing various physiological or anatomical areas connected through drug transfer processes such as absorption, metabolism, distribution, and elimination.
These models offer a more comprehensive representation of drug behavior in the body than one-compartment models. They accommodate the complexity of drug distribution,...
474
Compartment Models: Single-Compartment Model01:14

Compartment Models: Single-Compartment Model

3.0K
The single-compartment model serves as a simplified representation of the human body. This model assumes that the body functions as a single, well-mixed open compartment. When a drug is administered intravenously, it enters the body and quickly distributes uniformly. The drug then undergoes biotransformation and elimination, ultimately leaving the body. The volume of this compartment is referred to as the apparent volume of distribution into which the drug can uniformly distribute. In this...
3.0K
Mechanistic Models: Overview of Compartment Models01:21

Mechanistic Models: Overview of Compartment Models

333
Mechanistic models, a category encompassing both physiological and compartmental modeling, differ from empirical models' approaches to incorporating known factors about the systems being modeled. Empirical models describe data with minimal assumptions, while mechanistic models aim to provide a robust description of available data by specifying assumptions and integrating known factors about the system. Compartmental analysis is a key example of a mechanistic model in pharmacokinetics and...
333
Compartment Models: Two-Compartment Model01:20

Compartment Models: Two-Compartment Model

6.9K
The two-compartment model divides the body into central and peripheral compartments to account for varying blood perfusion rates among organs and tissues, affecting drug distribution. The central compartment includes blood and highly perfused tissues with rapid drug distribution, while the peripheral compartment contains tissues with slower drug distribution. After a single IV bolus dose, the drug concentration is high in plasma and low in tissues. The drug distribution between compartments...
6.9K
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving01:29

Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving

261
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
261
Multi-input and Multi-variable systems01:22

Multi-input and Multi-variable systems

373
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence of...
373

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Incorporating brain-inspired mechanisms for multimodal learning in artificial intelligence.

Science advances·2026
Same author

Allowing AI co-authors is a disregard for humanization.

Accountability in research·2024
Same author

Brain-inspired neural circuit evolution for spiking neural networks.

Proceedings of the National Academy of Sciences of the United States of America·2023
Same author

Self-backpropagation of synaptic modifications elevates the efficiency of spiking and artificial neural networks.

Science advances·2021

Related Experiment Video

Updated: Jan 8, 2026

Computational Modeling of Retinal Neurons for Visual Prosthesis Research - Fundamental Approaches
10:50

Computational Modeling of Retinal Neurons for Visual Prosthesis Research - Fundamental Approaches

Published on: June 21, 2022

2.1K

Spiking world model with multicompartment neurons for model-based reinforcement learning.

Yinqian Sun1,2, Feifei Zhao1,2,3, Mingyang Lyu1,4

  • 1Brain-inspired Cognitive AI Lab, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China.

Proceedings of the National Academy of Sciences of the United States of America
|December 12, 2025
PubMed
Summary

This study introduces a novel spiking world model (Spiking-WM) for reinforcement learning. Spiking neural networks (SNNs) with enhanced temporal memory now achieve comparable performance to traditional models in decision-making tasks.

Keywords:
brain-inspired intelligencedendritic computational modelmodel-based reinforcement learningspiking world model

More Related Videos

Real-time Electrophysiology: Using Closed-loop Protocols to Probe Neuronal Dynamics and Beyond
08:08

Real-time Electrophysiology: Using Closed-loop Protocols to Probe Neuronal Dynamics and Beyond

Published on: June 24, 2015

12.0K
3D Modeling of Dendritic Spines with Synaptic Plasticity
07:13

3D Modeling of Dendritic Spines with Synaptic Plasticity

Published on: May 18, 2020

7.3K

Related Experiment Videos

Last Updated: Jan 8, 2026

Computational Modeling of Retinal Neurons for Visual Prosthesis Research - Fundamental Approaches
10:50

Computational Modeling of Retinal Neurons for Visual Prosthesis Research - Fundamental Approaches

Published on: June 21, 2022

2.1K
Real-time Electrophysiology: Using Closed-loop Protocols to Probe Neuronal Dynamics and Beyond
08:08

Real-time Electrophysiology: Using Closed-loop Protocols to Probe Neuronal Dynamics and Beyond

Published on: June 24, 2015

12.0K
3D Modeling of Dendritic Spines with Synaptic Plasticity
07:13

3D Modeling of Dendritic Spines with Synaptic Plasticity

Published on: May 18, 2020

7.3K

Area of Science:

  • Computational Neuroscience
  • Artificial Intelligence
  • Machine Learning

Background:

  • Spiking neural networks (SNNs) show promise in perception but are underexplored in model-based reinforcement learning (RL).
  • Existing SNNs struggle with the long-term temporal memory required for accurate world models in RL.
  • Biological neurons' dynamic dendritic integration offers insights for improved SNN capabilities.

Purpose of the Study:

  • To develop a novel multicompartment neuron model for enhanced temporal information processing in SNNs.
  • To construct a spiking world model (Spiking-WM) for model-based deep reinforcement learning using SNNs.
  • To evaluate the performance and long-term memory capabilities of Spiking-WM.

Main Methods:

  • Proposed a multicompartment neuron model for nonlinear, multi-dendritic information integration.
  • Developed Spiking-WM, integrating spiking state-space, convolutional, and policy networks.
  • Evaluated Spiking-WM on DeepMind Control Suite and multiple speech datasets.

Main Results:

  • Spiking-WM demonstrated superior performance over existing SNN models in RL tasks.
  • Achieved performance comparable to artificial neural network (ANN) world models using Gated Recurrent Units (GRUs).
  • The multicompartment neuron model surpassed other SNNs in processing long speech sequences.

Conclusions:

  • The proposed multicompartment neuron model enhances SNNs' temporal processing for RL.
  • Spiking-WM effectively enables model-based deep reinforcement learning with SNNs.
  • This approach advances SNNs for complex decision-making and long-sequence data processing.