Related Experiment Video
Updated: Jun 24, 2026

07:47
Measuring Delay Discounting in Humans Using an Adjusting Amount Task
Published on: January 9, 2016
15.3K
Stock market trading via actor-critic reinforcement learning and adaptable data structure
1Quantitative Methods Department, Cunef University, Madrid, Madrid, Spain.
Peerj. Computer Science
|March 10, 2025
Summary
This study introduces a reinforcement learning (RL) model for automated, short-term trading to minimize capital loss. The innovative approach enhances investment agent accuracy in volatile markets like crude oil, gold, and the Euro.
Area of Science:
- Computational Finance
- Machine Learning
- Algorithmic Trading
Background:
- Stock market investments face challenges due to political, economic, and social volatility.
- Developing accurate, efficient investment models is crucial for minimizing capital loss.
Purpose of the Study:
- To propose an innovative, short-term, automatic investment model using reinforcement learning (RL).
- To enhance the learning and accuracy of investment agents in volatile markets.
- To reduce capital loss during trading operations.
Main Methods:
- Application of a reinforcement learning (RL) model with an actor-critic neural network.
- Utilizing rectified linear unit (ReLU) neurons for specialized agent generation.
- Implementation of an adaptable data window structure for improved learning.
Main Results:
- The RL model demonstrated reduced average losses: 0.03% in Euro, 0.25% in gold, and 0.13% in crude oil.
- Achieved more efficient trading and minimized investment losses across different time periods.
- Reduced the model's overall learning time.
Conclusions:
- The proposed RL model offers an effective solution for short-term, automated trading.
- The adaptable data window structure enhances agent performance in foreign exchange markets.
- This approach contributes to minimizing financial losses in dynamic trading environments.
Related Concept Videos
Actuarial Approach
The actuarial approach, a statistical method originally developed for life insurance risk assessment, is widely used to calculate survival rates in clinical and population studies. This method accounts for participants lost to follow-up or those who die from causes unrelated to the study, ensuring a more accurate representation of survival probabilities.
Consider the example of a high-risk surgical procedure with significant early-stage mortality. A two-year clinical study is conducted,...
Consider the example of a high-risk surgical procedure with significant early-stage mortality. A two-year clinical study is conducted,...
Reinforcement
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Reinforcement Schedules
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
Observational Learning
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning because...
Actor-Observer Effect
The actor-observer effect, a cognitive bias closely linked to the fundamental attribution error, refers to the tendency for individuals to attribute their behavior to external, situational factors while explaining others’ behavior in terms of internal, dispositional traits. This asymmetry in attribution significantly influences social perception and judgment.Cognitive Mechanisms Behind the EffectTwo primary psychological mechanisms contribute to the actor-observer effect: differences in visual...
Equity Theory
Equity theory explains how our sense of fairness influences the dynamics of close relationships. Rooted in social psychology, the theory posits that individuals evaluate fairness by comparing the ratio of their contributions to the rewards they receive. Relationship satisfaction is highest when these ratios are perceived as balanced between partners, promoting mutual reciprocity and a sense of justice.Equity vs. Equality in RelationshipsEquity is distinct from equality. Fairness does not...

