人間の強化学習プロセスとバイアス:計算論的特徴付けと行動公共政策への応用可能性
1Laboratoire de Neurosciences Cognitives et Computationnelles, Institut National de la Santé et de la Recherche Médicale, Paris, France.
Mind & society
|December 22, 2025
まとめ
この研究は、強化学習(RL)における計算論的バイアスを理解するためのフレームワークを導入する。praxicバイアスとepistemicバイアスを区別し、行動公共政策への洞察を提供する。
科学分野:
- 認知科学
- 人工知能
- 行動経済学
背景:
- 強化学習(RL)は、報酬と罰を通じてエージェントの学習をモデル化する。
- 人間のRLは、規範的基準からしばしば逸脱し、体系的なバイアスを示す。
- 既存の研究は、RLにおける計算論的バイアスを強調している。
研究 の 目的:
- 計算論的バイアスの評価のための概念的フレームワークと分類法の提案。
- praxicバイアス(行動選択エラー)とepistemicバイアス(表現エラー)の区別。
- 相対的評価とバイアス更新を主要なepistemicバイアスとして特徴付け、議論する。
主な方法:
- 概念的フレームワークの開発。
- 計算論的バイアスの分類法の作成。
- 既存研究の文献レビューと統合。
主要な成果:
- praxicバイアスとepistemicバイアスの導入。
- 相対的評価とバイアス更新を主要なepistemicバイアスとして特定。
- これらのバイアスの行動的シグネチャと適応的役割についての議論。
結論:
- 発見は、理論的および応用的なRLドメインに情報を提供する。
- 行動公共政策において、ナッジと比較して強化学習に基づく介入は十分に活用されていない。
- 歴史的な誤解に対処し、行動公共政策設計へのRLの統合を提唱する。
関連する概念動画
Behavior Modification
521
Behavioral approaches have often been criticized for ignoring mental processes and focusing solely on observable behavior. However, these approaches provide an optimistic perspective for individuals seeking to change their behaviors. Rather than concentrating on intrinsic personality traits, behavioral approaches suggest that even longstanding habits can be modified by changing the reward contingencies that maintain them.
A real-world application of operant conditioning principles is applied...
A real-world application of operant conditioning principles is applied...
521
Cognitive Learning
970
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
970
Behaviorism
4.2K
The field of behaviorism was pioneered by figures such as Ivan Pavlov, John B. Watson, and B.F. Skinner fundamentally shifted the focus of psychology to the observable and controllable aspects of human and animal behavior. This shift marked a critical evolution in the discipline, emphasizing scientific rigor and experimental methodology.
The core premise of behaviorism is its focus on observable behavior rather than internal thoughts or feelings. This approach argues that true scientific...
The core premise of behaviorism is its focus on observable behavior rather than internal thoughts or feelings. This approach argues that true scientific...
4.2K
Behavioral Genetics and Its Designs
969
Behavior genetics explores how genetic inheritance influences human behavior. It focuses on how genes, passed from parents to offspring, contribute to the development of behavioral traits and tendencies. This branch of genetics seeks to understand the complex interplay between inherited genetic factors and environmental influences in shaping our behaviors.
The primary methodologies used in behavior genetics include family studies, twin studies, and adoption studies, each providing unique...
The primary methodologies used in behavior genetics include family studies, twin studies, and adoption studies, each providing unique...
969
Law of Effect
2.4K
B.F. Skinner, a prominent figure in behavioral psychology, introduced operant conditioning by emphasizing the role of consequences in shaping behavior. This theory builds upon the law of effect proposed by Edward Thorndike, which posits that behaviors followed by satisfying outcomes are likely to be repeated. In contrast, those followed by unsatisfying outcomes are less likely to recur.
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...
2.4K
Operant Conditioning
2.7K
Operant conditioning, a key concept in behavioral psychology, involves using reinforcement and punishment to alter the likelihood of a behavior being repeated. B.F. introduced this type of conditioning. Skinner focused on voluntary behaviors and the consequences that follow them, influencing whether these behaviors will be strengthened or diminished.
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
2.7K


