Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Neuroplasticity01:01

Neuroplasticity

Neuroplasticity reflects the brain's remarkable capacity to adapt and evolve, responding dynamically to learning, experiences, or injury by reorganizing its neural circuitry. This reorganization involves creating new neural connections and refining old ones through a series of biological processes that contribute to the brain's lifelong development and adaptability.
Neural Circuits01:25

Neural Circuits

Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Observational Learning01:12

Observational Learning

Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning because...
Reinforcement01:23

Reinforcement

Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Reinforcement Schedules01:24

Reinforcement Schedules

Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Neural Regulation01:37

Neural Regulation

Digestion begins with a cephalic phase that prepares the digestive system to receive food. When our brain processes visual or olfactory information about food, it triggers impulses in the cranial nerves innervating the salivary glands and stomach to prepare for food.

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Catecholamine precursor modulation of human exploration: Evidence from a large gender-balanced sample.

PLoS computational biology·2026
Same author

Open science practices in behavioral addictions: An exploratory survey.

Journal of behavioral addictions·2026
Same author

High precision and cost-effective multiplex quantification of amyloid-β40, amyloid-β42, p181Tau, p217Tau, neurofilament light chain, and glial fibrillary acidic protein from plasma and serum.

Journal of Alzheimer's disease : JAD·2025
Same author

Signatures of Perseveration and Heuristic-Based Directed Exploration in Two-Step Sequential Decision Task Behaviour.

Computational psychiatry (Cambridge, Mass.)·2025
Same author

Decreased functional connectivity is associated with increased levels of Cerebral Spinal Fluid soluble-PDGFRβ, a marker of blood brain barrier breakdown, in older adults.

Brain imaging and behavior·2024
Same author

Pharmacological Enhancement of Dopamine Neurotransmission Does Not Affect Illusory Pattern Perception.

eNeuro·2024

Related Experiment Video

Updated: Jul 17, 2026

Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks
11:18

Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks

Published on: March 2, 2015

Recurrent Neural Network Exploration Strategies During Reinforcement Learning Depend on Network Capacity.

H Flimm1, D Tuzsus2, I Pappas3

  • 1Department of Psychology, Ludwig Maximilian University of Munich, Munich, Germany.

Computational Brain & Behavior
|July 16, 2026
PubMed
Summary

Network capacity significantly impacts artificial neural network exploration strategies in reinforcement learning. Higher capacity recurrent neural networks (RNNs) show more directed exploration, approaching human-like behavior but still differing in specific learning parameters.

Keywords:
Computational modelingExplorationHidden unitsPerseverationRecurrent neural networks

Related Experiment Videos

Last Updated: Jul 17, 2026

Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks
11:18

Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks

Published on: March 2, 2015

Area of Science:

  • Computational neuroscience
  • Artificial intelligence
  • Cognitive science

Background:

  • Artificial neural networks (ANNs) model biological brains for complex task understanding.
  • Recurrent neural networks (RNNs) with 48 hidden units achieve human-level performance in bandit tasks but use different strategies.

Purpose of the Study:

  • To systematically investigate how network capacity (number of hidden units) influences computational mechanisms and performance in ANNs.
  • To compare RNN behavior across different capacities and with human learners.

Main Methods:

  • Computational modeling of RNNs with varying capacities (e.g., 48 vs. 576 hidden units).
  • Utilized a restless multi-armed bandit task common in neuroscience research.
  • Compared network exploration strategies (directed vs. random) and learning parameters (switch rate, perseveration) with human learners.

Main Results:

  • High-capacity RNNs exhibited increased directed exploration and decreased random exploration compared to low-capacity networks.
  • RNNs with 576 hidden units showed exploration strategies closer to human learners.
  • Despite closer strategies, RNNs still deviated from humans in switch rate and perseveration.

Conclusions:

  • Network capacity is crucial for shaping exploration strategies in reinforcement learning.
  • Human learners may employ resource-rational strategies, allocating more cognitive resources to task solving.
  • Findings contribute to developing more human-like ANNs for insights into brain mechanisms.