预测下一个反应:展示整合基于人工智能的强化学习与行为科学的实用性
David J Cox1,2, Carlos Santos1
1Institute of Applied Behavioral Science at Endicott College, Beverly, MA USA.
Perspectives on behavior science
|June 16, 2025
概括
人工智能 (AI) 的强化学习 (RL) 模型,特别是那些包含惩罚的模型,显著改善了对生物生物体行为的预测. 将人工智能与操作心理学结合起来,可以提高预测准确度,并解决理论问题.
科学领域:
- 整合了人工智能 (AI) 和行为科学.
- 专注于强化学习 (RL) 和操作条件原则.
背景情况:
- 强化和惩罚的概念起源于心理学和人工智能.
- 心理学研究生物的行为;人工智能模型代理行为奖励最大化.
研究的目的:
- 描述基于AI的强化学习 (RL) 特性,并将其与操作性研究进行比较.
- 探索如何将人工智能和操作洞察力结合起来可以推进这两个领域.
- 通过预测生物生物体的反应来证明相互效用.
主要方法:
- 开发了12个人工有机体 (AO) 使用操作性研究信息的特征集,有和没有惩罚.
- 六名参与者预测了这些AO的反应.
- 引入了第13种方法:通过Q-learning模拟的人类选择,用于响应预测.
主要成果:
- Q-学习模型实现了最高的平均预测准确率 (95%).
- 使用分子/分子信息和惩罚的模型平均准确率为89%.
- 准确性明显下降 (47%-54%),没有惩罚的意外情况.
结论:
- 基于人工智能的RL技术,结合操作知识,提高了行为预测的准确性.
- 这种整合有助于解决关于多尺度行为模型和惩罚在学习中的作用的理论问题.
相关概念视频
Law of Effect
1.6K
B.F. Skinner, a prominent figure in behavioral psychology, introduced operant conditioning by emphasizing the role of consequences in shaping behavior. This theory builds upon the law of effect proposed by Edward Thorndike, which posits that behaviors followed by satisfying outcomes are likely to be repeated. In contrast, those followed by unsatisfying outcomes are less likely to recur.
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...
1.6K
Behaviorism
2.7K
The field of behaviorism was pioneered by figures such as Ivan Pavlov, John B. Watson, and B.F. Skinner fundamentally shifted the focus of psychology to the observable and controllable aspects of human and animal behavior. This shift marked a critical evolution in the discipline, emphasizing scientific rigor and experimental methodology.
The core premise of behaviorism is its focus on observable behavior rather than internal thoughts or feelings. This approach argues that true scientific...
The core premise of behaviorism is its focus on observable behavior rather than internal thoughts or feelings. This approach argues that true scientific...
2.7K
Behavior Modification
238
Behavioral approaches have often been criticized for ignoring mental processes and focusing solely on observable behavior. However, these approaches provide an optimistic perspective for individuals seeking to change their behaviors. Rather than concentrating on intrinsic personality traits, behavioral approaches suggest that even longstanding habits can be modified by changing the reward contingencies that maintain them.
A real-world application of operant conditioning principles is applied...
A real-world application of operant conditioning principles is applied...
238
Reinforcement Schedules
243
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
243
Timing and Consequences on Behavior
158
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective.
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
158
Primary and Secondary Reinforcers
423
In psychology, reinforcement is a key concept in behavior modification. B.F. Skinner demonstrated this with his experiments involving rats in what is known as a Skinner box. The rats learned to press a lever to receive food, a primary reinforcer that fulfilled their innate need for nourishment.
Effective reinforcers for humans vary depending on the individual and the context. Primary reinforcers, such as food, water, sleep, shelter, and pleasure, have inherent value and satisfy basic biological...
Effective reinforcers for humans vary depending on the individual and the context. Primary reinforcers, such as food, water, sleep, shelter, and pleasure, have inherent value and satisfy basic biological...
423


