Related Experiment Videos
Reinforcement learning and decision making in monkeys during a competitive game
Daeyeol Lee1, Michelle L Conroy, Benjamin P McGreevy
1Department of Brain and Cognitive Sciences, Center for Visual Science, University of Rochester, Rochester, NY 14627, USA. dlee@cvs.rochester.edu
Brain Research. Cognitive Brain Research
|November 25, 2004
Summary
Monkeys playing a game adapted their choices based on opponent strategy, showing biases consistent with reinforcement learning. This suggests animals learn optimal decision-making through experience and opponent modeling.
Area of Science:
- Neuroscience
- Cognitive Science
- Animal Behavior
Background:
- Adaptive decision-making is crucial for survival in dynamic environments.
- Understanding the neural basis of how animals adjust strategies through experience is essential.
Purpose of the Study:
- To investigate how an opponent's strategy influences an animal's decision-making process.
- To explore the neural mechanisms underlying adaptive decision-making in monkeys.
Main Methods:
- Monkeys were trained to play a competitive oculomotor free-choice game against a computer.
- The computer opponent employed three distinct algorithms exploiting the monkey's choice and reward history.
- Analysis focused on how monkey choices deviated from predictions under different computer strategies.
Main Results:
- Monkeys exhibited choice biases, deviating from probability matching when the opponent played randomly.
- Animal choices were influenced by both their own and the opponent's past actions.
- Biases were reduced when the opponent utilized both players' histories, aligning with reinforcement learning predictions.
Conclusions:
- Monkeys adjust their decision-making strategies based on opponent behavior and history.
- Observed biases suggest the use of reinforcement learning algorithms for optimizing choices.
- The study provides insights into the neural basis of adaptive, competitive decision-making.