Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Simple learning rules to cope with changing environments.

Roderich Gross1, Alasdair I Houston, Edmund J Collins

  • 1School of Biological Sciences, University of Bristol, Woodland Road, Bristol BS8 1UG, UK. roderich.gross@ieee.org

Journal of the Royal Society, Interface
|March 14, 2008
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Incubation strategy and hatching start time affect the duration of the nestling period in precocial Arctic-breeding sandpipers.

Biology letters·2026
Same author

Functional response predicts invasiveness but not trophic impact.

The Journal of animal ecology·2026
Same author

Optimal diving: patch quality, depth, and marginal value.

Behavioral ecology : official journal of the International Society for Behavioral Ecology·2025
Same author

Optimal competitors: the balance of attraction and choices of mutualists, like pollinators, drives facilitation and may promote crop pollination.

Proceedings. Biological sciences·2025
Same author

Scales of risk and adaptive 'dread': an evolutionary theory of risk inflation.

Scientific reports·2025
Same author

When size matters: energy allocation and thermogenic mechanisms in very small mammals, African pygmy mice.

The Journal of experimental biology·2025
Same journal

RNA-ligand complexes and the attenuation of neutral confinement in the evolution of RNA secondary structures.

Journal of the Royal Society, Interface·2026
Same journal

Individual detachment-reintegration events in homing pigeon flocks and the dominance of directional adjustment in their kinematic features.

Journal of the Royal Society, Interface·2026
Same journal

Thermal stress disrupts symbiotic fluid dynamics in bobtail squid.

Journal of the Royal Society, Interface·2026
Same journal

Distinct geometrical landscapes distinguish between modes of tristability in gene regulatory networks.

Journal of the Royal Society, Interface·2026
Same journal

Slow modulation of the contraction patterns in Physarum polycephalum.

Journal of the Royal Society, Interface·2026
Same journal

Moo-ving mountains: grazing agents drive terracette formation on steep hillslopes.

Journal of the Royal Society, Interface·2026
See all related articles

This study analyzes animal decision-making rules for energy rewards in changing environments. A simple extension to existing learning rules significantly improves long-term exploitation of dynamic environments.

Area of Science:

  • * Computational neuroscience
  • * Animal behavior modeling
  • * Reinforcement learning

Background:

  • * Agents repeatedly choose actions with uncertain, time-varying reward probabilities.
  • * Switching between actions incurs costs.
  • * Existing deterministic and stochastic learning rules are widely used to model animal decision-making.

Purpose of the Study:

  • * To investigate the influence of learning rate on agent energy gain.
  • * To compare rule performance against optimal and random strategies.
  • * To develop improved learning rules for dynamic environments.

Main Methods:

  • * Simulation of two established learning rules (deterministic and stochastic).
  • * Analysis of agent energy gain across varying learning rates.

Related Experiment Videos

  • * Comparison with theoretical benchmarks (full knowledge vs. no knowledge).

    • Main Results:

    • * Both rules effectively exploit the environment over short periods.
    • * Rules are equivalent under certain learning rates, favoring actions with shortest unsuccessful trial runs.
    • * Performance degrades significantly in the long term, often matching random chance.

    Conclusions:

    • * Standard learning rules are insufficient for long-term exploitation of changing environments.
    • * A proposed simple extension enhances learning and exploitation capabilities indefinitely.
    • * This extension offers a more robust model for adaptive decision-making.