Related Experiment Video
Updated: Jun 29, 2025

The HoneyComb Paradigm for Research on Collective Human Behavior
Published on: January 19, 2019
Mesoscale effects of trader learning behaviors in financial markets: A multi-agent reinforcement learning study
Johann Lussange1, Stefano Vrizzi1, Stefano Palminteri1,2
1Laboratoire des Neurosciences Cognitives, Département des Études Cognitives, INSERM U960, Paris, France.
Abstract:
Recent advances in the field of machine learning have yielded novel research perspectives in behavioural economics and financial markets microstructure studies. In this paper we study the impact of individual trader leaning characteristics on markets using a stock market simulator designed with a multi-agent architecture. Each agent, representing an autonomous investor, trades stocks through reinforcement learning, using a centralized double-auction limit order book. This approach allows us to study the impact of individual trader traits on the whole stock market at the mesoscale in a bottom-up approach. We chose to test three trader trait aspects: agent learning rate increases, herding behaviour and random trading. As hypothesized, we find that larger learning rates significantly increase the number of crashes. We also find that herding behaviour undermines market stability, while random trading tends to preserve it.
Related Concept Videos
Observational Learning
Modeling in Therapy
Participant Modeling
Participant modeling involves therapists demonstrating calm and effective behaviors in...
Law of Effect
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...
Steps in the Modeling Process
Attention is the first necessary component for observational learning. It involves focusing on what the model is doing and saying. For example, if you decide to take a drawing class to enhance your skills, you need to pay close attention to the instructor's words and hand movements. The characteristics of the model significantly...
Cognitive Learning
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
Reinforcement Schedules
Once a behavior is learned,...

