"PyTDL":一个多功能时差学习算法来模拟决策和认知学习的行为过程
Qiyun Wu1, Xiaodan Yang2, Kaishu Wang3
1State Key Laboratory of Intelligent Manufacturing Equipment and Technology, Huazhong University of Science and Technology, Wuhan 430074, China.
iScience
|January 21, 2025
概括
本研究介绍了PyTDL,这是一个灵活的Python框架,用于模拟学习和决策中的认知过程. 它增强了传统的时间差 (TD) 学习模型,用于动态的,现实世界的场景.
科学领域:
- 神经科学是一个神经科学.
- 认知科学 认知科学
- 计算生物学 计算生物学
背景情况:
- 人类和动物通过奖励反来学习复杂的任务,动态调整期望和选择.
- 了解这种学习背后的认知机制是具有挑战性的.
- 传统的时间差 (TD) 学习模型在动态和多样化的任务方面存在局限性.
研究的目的:
- 介绍PyTDL,一种基于Python的新型模块化框架,用于模拟学习和决策中的动态,非线性认知过程.
- 提供可定制的价值更新功能和决策策略.
- 为与实证数据对齐计算模型提供一个工具.
主要方法:
- 开发了PyTDL,这是一个具有用户友好的GUI和API的Python框架.
- 实现可定制的价值更新功能和决策策略.
- 在不确定条件下的两个认知任务中模拟动物决策.
主要成果:
- PyTDL成功模拟了动态的非线性认知过程.
- 该框架在复杂,不确定的环境中模拟动物决策的实用性得到了证明.
- PyTDL允许针对特定研究需求量身定制的模型创建.
结论:
- 对于研究学习和决策的研究人员来说,PyTDL提供了一个灵活而强大的工具.
- 开源框架促进了对复杂环境中大脑机制的理解.
- PyTDL促进了神经科学中计算和实证方法的整合.
相关概念视频
Cognitive Learning
219
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
219
Decision Making
85
Decision-making is a fundamental cognitive process that involves evaluating alternatives and selecting among them. This process can range from simple choices, such as deciding what to wear, to complex decisions, like choosing a major in college or a career path. The complexity of the decision often dictates the approach we use, which can be broadly categorized into two types: automatic and controlled decision-making.
Automatic decision-making is fast, intuitive, and relies on gut feelings...
Automatic decision-making is fast, intuitive, and relies on gut feelings...
85
Introduction to Cognitive Psychology
414
Cognitive psychology is the field of psychology dedicated to examining how people think. It attempts to explain how and why we think the way we do by studying the interactions among human thinking, emotion, creativity, language, and problem-solving, as well as other cognitive processes. Cognitive psychology studies how information is processed and manipulated in remembering, thinking, and knowing.
This field emerged in the mid-20th century, following a period dominated by behaviorism, which...
This field emerged in the mid-20th century, following a period dominated by behaviorism, which...
414
Reason and Intuition
6.3K
The human brain processes information for decision-making using one of two routes: an intuitive system and a rational system (Epstein, 1994; popularized by Kahneman, 2011 as System 1 and System 2, respectively). The intuitive system is quick, impulsive, and operates with minimal effort, relying on emotions or habits to provide cues for what to do next, while the rational system is logical, analytical, deliberate, and methodical. Research in neuropsychology suggests that the...
6.3K
Purposive Learning
97
E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a...
97
Information Processing Approach
30
The information-processing theory of cognitive development centers on fundamental mental processes, including attention, memory, and problem-solving skills. Researchers in this field examine how cognitive abilities, such as working memory, evolve and influence children's overall development. Studies indicate that children with stronger working memory tend to excel in reading comprehension, math, and problem-solving compared to peers with less efficient memory skills. Low working memory is...
30


