相关实验视频

Updated: May 5, 2026

Operant Procedures for Assessing Behavioral Flexibility in Rats
08:30

Operant Procedures for Assessing Behavioral Flexibility in Rats

Published on: February 15, 2015

20.9K

重新思考折扣规范化:新的解释,意想不到的后果和强化学习规范化解决方案

Sarah Rathnam1, Sonali Parbhoo2, Siddharth Swaroop1

  • 1John A. Paulson School of Engineering and Applied Sciences, Harvard University, Cambridge, MA 02138 USA.

Journal of machine learning research : JMLR
|May 8, 2025
PubMed
概括

在强化学习中,折扣规范化可能会导致由于数据不均而导致表现不佳. 本研究引入了新的,国家具体行动的方法,通过解决这些意想不到的后果来改善政策优化.

关键词:
马尔科夫决策过程确定性等同性确定性等同性折扣因子是指折扣因子.规范化 规范化 规范化强化学习是一种强化学习.

更多相关视频

Measuring Delay Discounting in Humans Using an Adjusting Amount Task07:47

Measuring Delay Discounting in Humans Using an Adjusting Amount Task

Published on: January 9, 2016

15.1K
New Variations for Strategy Set-shifting in the Rat09:45

New Variations for Strategy Set-shifting in the Rat

Published on: January 23, 2017

7.7K

相关概念视频

Operant Conditioning01:21

Operant Conditioning

Operant conditioning, a key concept in behavioral psychology, involves using reinforcement and punishment to alter the likelihood of a behavior being repeated. B.F. introduced this type of conditioning. Skinner focused on voluntary behaviors and the consequences that follow them, influencing whether these behaviors will be strengthened or diminished.
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
1.5K
Reinforcement01:23

Reinforcement

Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
154
Punishment01:27

Punishment

Negative reinforcement and punishment are often confused but serve distinct functions in behavior modification. Reinforcement, whether positive or negative, increases the likelihood of a desired behavior, while punishment decreases it.
Punishment can be positive or negative. Positive punishment involves adding an undesirable stimulus, such as scolding, to decrease a behavior. Negative punishment involves removing a desirable stimulus, such as taking away a favorite toy, to decrease behavior....
118
Generalization, Discrimination, and Extinction01:24

Generalization, Discrimination, and Extinction

Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
337
Reinforcement Schedules01:24

Reinforcement Schedules

Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
116
Timing and Consequences on Behavior01:08

Timing and Consequences on Behavior

In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective. 
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
57