强化metalearner作为一个生物学上可信的meta-learning框架
Tim Vriens1, Mattias Horan2, Jacqueline Gottlieb3,4
1Institute of Cognitive Sciences and Technologies, CNR, Rome, Italy Tim.Vriens@unicampus.it, massimo.silvetti@istc.cnr.ithttps://ctnlab.it/index.php/massimo-silvetti/, https://www.istc.cnr.it/en/people/massimo-silvetti.
The Behavioral and brain sciences
|September 23, 2024
概括
超学习模型可能缺乏可解释性,限制了它们的神经科学研究实用性. 一种替代的超参数优化方法可以为生物计算提供可测试的假设.
科学领域:
- 计算神经科学是一种计算神经科学.
- 机器学习 机器学习
- 超级学习 (meta-learning) 是一种学习方式.
背景情况:
- 超学习模型在神经科学研究中越来越多地应用.
- 某些元学习方法的可解释性和可伪造性引发了对科学严谨性的担忧.
研究的目的:
- 评估一种特定的元学习方法的实用性 (Binz等). 为了神经科学.
- 提出一种替代的元学习策略,以提高可解释性和可伪造性.
主要方法:
- 批判性地分析了Binz等人提出的元学习框架. 关于模型的可解释性和可伪造性.
- 开发和评估了以超参数优化为中心的替代元学习方法.
主要成果:
- 宾兹等人. 在Binz等. 超学习方法的结果是模型的解释性和伪造性很差.
- 提出的基于超参数优化的超学习方法产生了可解释和可伪造的模型.
结论:
- 在神经科学中,具有较低可解释性和可伪造性的meta-learning方法的价值有限.
- 超参数优化为神经科学中的meta-learning提供了一个可行的替代方案,可以生成关于生物计算的经验可验证假设.
相关概念视频
Cognitive Learning
229
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
229
Purposive Learning
104
E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a...
104
Observational Learning
149
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
149
Reinforcement
186
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
186
Metacognition
142
Metacognition is a conscious process where individuals are aware of their cognitive and executive processes, such as planning before solving a problem or self-monitoring during reading. For instance, a writer may need help with composing a piece. The situation involves a writer who is working on a piece of writing, but while doing so, they realize that something is missing. They notice that their characters lack depth or details. This realization occurs because the writer is reflecting on their...
142
Generalization, Discrimination, and Extinction
468
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
468


