Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Fixed Action Patterns01:06

Fixed Action Patterns

18.4K
A fixed action pattern (FAP) is a specific, hard-wired sequence of behaviors that occurs in response to an external stimulus, called a sign stimulus. The behavior is “fixed” because it is essentially unchangeable—proceeding similarly across individuals of a species every time it occurs.
18.4K
Impression Management Techniques III: Aligning Actions01:29

Impression Management Techniques III: Aligning Actions

215
Aligning actions are communicative strategies individuals employ to maintain social harmony and preserve personal identity in the face of potential disruptions to social norms. These actions are particularly important in managing social impressions when one's behavior might be seen as inappropriate, incompetent, or morally questionable.Types of Aligning ActionsThe three principal types of aligning actions are disclaimers, accounts, and apologies.DisclaimersDisclaimers are preventive; they are...
215
Reaction Mechanisms03:06

Reaction Mechanisms

33.5K
Chemical reactions often occur in a stepwise fashion, involving two or more distinct reactions taking place in a sequence. A balanced equation indicates the reacting species and the product species, but it reveals no details about how the reaction occurs at the molecular level. The reaction mechanism (or reaction path) provides details regarding the precise, step-by-step process by which a reaction occurs.
For instance, the decomposition of ozone appears to follow a mechanism with two steps:
33.5K
Multi-Step Reactions02:31

Multi-Step Reactions

9.1K
Chemical reactions often occur in a stepwise fashion involving two or more distinct reactions taking place in a sequence. A balanced equation indicates the reacting species and the product species, but it reveals no details about how the reaction occurs at the molecular level. The reaction mechanism (or reaction path) provides details regarding the precise, step-by-step process by which a reaction occurs. Each of the steps in a reaction mechanism is called an elementary reaction. These...
9.1K
Maxam-Gilbert Sequencing01:05

Maxam-Gilbert Sequencing

13.9K
In the same year as the discovery of the Sanger sequencing method, another group of scientists, Allan Maxam and Walter Gilbert, demonstrated their chemical-cleavage method for DNA sequencing. The Maxam-Gilbert method relies on using different chemicals that can cleave the DNA sequence at specific sites, the separation of resulting DNA fragments of variable size using electrophoresis, and deciphering the DNA sequence from the resulting gel bands.
Challenges of the Maxam-Gilbert Method
The...
13.9K
Sequences01:29

Sequences

467
Sequences are fundamental mathematical objects consisting of ordered lists of numbers that follow a specific rule or pattern. Sequences are critical in various mathematical concepts, including calculus, series, and number theory. They can model real-world phenomena such as population growth, financial investments, and physical processes like the diminishing height of a bouncing ball.Each number in a sequence is referred to as a term. Typically, the terms are denoted as a1, a2, a3,…, where...
467

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Differential Dopamine Receptor-Dependent Sensitivity Improves the Switch Between Hard and Soft Selection in a Model of the Basal Ganglia.

Neural computation·2022
Same author

Roles for globus pallidus externa revealed in a computational model of action selection in the basal ganglia.

Neural networks : the official journal of the International Neural Network Society·2018
Same author

A probabilistic, distributed, recursive mechanism for decision-making in the brain.

PLoS computational biology·2018
Same author

Integrating Brain and Biomechanical Models-A New Paradigm for Understanding Neuro-muscular Control.

Frontiers in neuroscience·2018
Same author

Decision-making and action selection in insects: inspiration from vertebrate-based theories.

Frontiers in behavioral neuroscience·2015
Same author

Probabilistic Decision Making with Spikes: From ISI Distributions to Behaviour via Information Gain.

PloS one·2015

Related Experiment Video

Updated: Apr 19, 2026

Author Spotlight: A Novel Setup to Conduct Naturalistic Laboratory Experiments with Real Human Actors in Scenarios
07:43

Author Spotlight: A Novel Setup to Conduct Naturalistic Laboratory Experiments with Real Human Actors in Scenarios

Published on: August 4, 2023

2.9K

Finding minimal action sequences with a simple evaluation of actions.

Ashvin Shah1, Kevin N Gurney1

  • 1Department of Psychology, The University of Sheffield Sheffield, UK.

Frontiers in Computational Neuroscience
|December 16, 2014
PubMed
Summary

Animals can learn the shortest action sequence to achieve goals using simple "outcome achieved" signals. This study explores "no-cost learning rules" for action discovery, finding they discover minimal sequences but require separate processes to prevent errors with extensive training.

Keywords:
action discoverydopamineintrinsic motivationoptimal controlredundancyreinforcement learning

More Related Videos

Corticospinal Excitability Modulation During Action Observation
12:33

Corticospinal Excitability Modulation During Action Observation

Published on: December 31, 2013

9.5K
Examining Recall Memory in Infancy and Early Childhood Using the Elicited Imitation Paradigm
06:35

Examining Recall Memory in Infancy and Early Childhood Using the Elicited Imitation Paradigm

Published on: April 28, 2016

36.0K

Related Experiment Videos

Last Updated: Apr 19, 2026

Author Spotlight: A Novel Setup to Conduct Naturalistic Laboratory Experiments with Real Human Actors in Scenarios
07:43

Author Spotlight: A Novel Setup to Conduct Naturalistic Laboratory Experiments with Real Human Actors in Scenarios

Published on: August 4, 2023

2.9K
Corticospinal Excitability Modulation During Action Observation
12:33

Corticospinal Excitability Modulation During Action Observation

Published on: December 31, 2013

9.5K
Examining Recall Memory in Infancy and Early Childhood Using the Elicited Imitation Paradigm
06:35

Examining Recall Memory in Infancy and Early Childhood Using the Elicited Imitation Paradigm

Published on: April 28, 2016

36.0K

Area of Science:

  • Behavioral neuroscience
  • Computational neuroscience
  • Reinforcement learning

Background:

  • Animals discover minimal action sequences to achieve outcomes.
  • Traditional models focus on 'how well' an outcome is achieved, not just 'if'.
  • Action discovery mechanisms rely on simple 'outcome achieved' signals, not graded success.

Purpose of the Study:

  • Investigate if action discovery mechanisms can find minimal action sequences with simplified feedback.
  • Implement and analyze 'no-cost learning rules' consistent with action discovery.
  • Examine the role of these rules in behavioral development and potential limitations.

Main Methods:

  • Computational modeling of 'no-cost learning rules' where actions leading to an outcome have equal behavioral measure.
  • Simulated tasks to test the ability of no-cost rules to discover minimal action sequences.
  • Analysis of behavior development and the effects of extensive training and attenuation disruption.

Main Results:

  • No-cost learning rules successfully discover minimal action sequences in simulated environments.
  • These rules maintain execution of minimal sequences for extended periods.
  • Extensive training leads to extraneous actions, indicating a need for an additional attenuation process.

Conclusions:

  • Simplified 'outcome achieved' feedback is sufficient for discovering minimal action sequences via no-cost learning rules.
  • Action discovery mechanisms can be computationally implemented with no-cost rules.
  • Behavioral development likely involves no-cost rules coupled with an attenuation mechanism to refine action selection and prevent errors.