一个生物灵感的最小模型,用于非静止的K-武装强盗

Krubeal Danieli¹, Mikkel Elle Lepperød²

¹Center for Integrative Neuroplasticity, FYSCELL, University of Oslo, Oslo, Norway.

Biological cybernetics

|March 10, 2026

概括

我们开发了一种生物可信的神经模型,用于决策,它与标准的强化学习算法相匹配,用于解决多武器强盗问题. 这个模型显示了基于不确定性的适应性探索,为神经机制提供了洞察力.

科学领域:

计算神经科学是一种计算神经科学.
认知神经科学是一种认知神经科学.
人工智能的人工智能是人工智能.

背景情况:

强化学习算法擅长解决多武器强盗问题,但往往缺乏生物可信性.
现有的模型可能无法完全捕捉不确定性下决策的基础的神经动力学.

研究的目的:

提出一个新的,生物灵感的神经模型,用于决策在随机盗问题.
评估模型的性能与已建立的算法对比,并评估其生物可信性.
研究适应性行为策略及其神经支.

主要方法:

开发了一个神经模型,使用相互作用的速率神经元群体,灵感来自轨道前和前带皮层.
在各种随机强盗问题上测试了模型的性能.
采用进化优化来调整超参数和分析突触机制对齐.
研究的适应性策略基于不确定性水平的贪和探索性行为之间发生转变.

主要成果:

这种生物灵感模型实现了强大的性能,与普森采样和UCB等标准算法相提并论.
该模型展示了适应性行为,转向低不确定性贪策略和高不确定性探索性策略.
进化优化产生了与突触机制和学习速度适应原理相一致的超参数.

结论:

生物启发的计算架构可以在决策任务中实现竞争性性能.
拟议的模型提供了一个可信的神经机制,用于在不确定性下进行适应性决策.
研究结果表明神经架构,突触功能和有效的强化学习策略之间存在联系.

关键词:

适应适应适应决策方式决策方式塑性是一种可塑性.强化学习是一种强化学习.

相关概念视频

00:48

Optimal Foraging

14.2K

How animals obtain and eat their food is called foraging behavior. Foraging can include searching for plants and hunting for prey and depends on the species and environment.

14.2K

01:24

One-Compartment Open Model: Wagner-Nelson and Loo Riegelman Method for k_a Estimation

1.3K

This lesson introduces two critical methods in pharmacokinetics, the Wagner-Nelson and Loo-Riegelman methods, used for estimating the absorption rate constant (ka) for drugs administered via non-intravenous routes. The Wagner-Nelson method relates ka to the plasma concentration derived from the slope of a semilog percent unabsorbed time plot. However, it is limited to drugs with one-compartment kinetics and can be impacted by factors like gastrointestinal motility or enzymatic degradation.
On...

1.3K

01:23

Mechanistic Models: Compartment Models in Individual and Population Analysis

314

Mechanistic models are utilized in individual analysis using single-source data, but imperfections arise due to data collection errors, preventing perfect prediction of observed data. The mathematical equation involves known values (Xi), observed concentrations (Ci), measurement errors (εi), model parameters (ϕj), and the related function (ƒi) for i number of values. Different least-squares metrics quantify differences between predicted and observed values. The ordinary least...

314

01:29

Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving

377

Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...

377

01:06

Model Approaches for Pharmacokinetic Data: Distributed Parameter Models

301

Pharmacokinetic models are mathematical constructs that represent and predict the time course of drug concentrations in the body, providing meaningful pharmacokinetic parameters. These models are categorized into compartment, physiological, and distributed parameter models.
The distributed parameter models are specifically designed to account for variations and differences in some drug classes. This model is particularly useful for assessing regional concentrations of anticancer or...

301

01:13

Parameters Affecting Nonlinear Elimination: Zero-Order Input, First-Order Absorption and Two-Compartment Model

381

Drugs administered through various routes can lead to nonlinear elimination, resulting in complex pharmacokinetic behaviors crucial to understanding efficacious drug dosing.
When a drug is administered through a constant intravenous infusion and eliminated via nonlinear pharmacokinetics, it follows zero-order input. For example, oral drugs undergo first-order absorption upon administration and are eliminated through nonlinear pharmacokinetics.
In the case of subcutaneously administered drugs,...

381