了解连续决策过程的随机动态:对多武装强盗的路径整体分析
Bo Li1,2, Chi Ho Yeung3
1School of Science, Harbin Institute of Technology (Shenzhen), Shenzhen 518055, China.
本研究分析了使用统计物理学的多武装强盗 (MAB) 模型. 我们揭示了多式联运遗憾分布,展示了最好的手臂的早期糟糕奖励如何导致对次优选择的显著利用.
科学领域:
- 在不确定性下做决定
- 顺序性决策理论是一个理论.
- 统计物理应用 统计物理应用
背景情况:
- 多武装强盗 (MAB) 模型是不确定性下决策的基本框架.
- 它模拟了在顺序收集奖励中的勘探-开采权衡.
- 现有的算法往往侧重于非对称的最佳性,使得有限时间动态的理解较少.
研究的目的:
- 分析多臂强盗 (MAB) 模型的有限时间行为.
- 用新的分析技术来描述累积遗憾的分布.
- 了解复杂的动态行为及其对决策的影响.
主要方法:
- 在MAB模型中应用统计物理技术.
- 累积遗憾分布的分析特征.
- 分析结果与模拟数据的比较.
主要成果:
- 在MAB模型中确定累积后悔的多式联络分布.
- 证明,从最好的手臂获得的初始低于最佳的奖励可以推动过度剥削.
- 有限时间动态行为的特征及其与遗憾的关系.
结论:
- 统计物理学为分析有限时间MAB动态提供了强大的工具.
- 遗憾分布并不总是单模式的,这对算法性能有影响.
- 了解这些动态对于优化顺序决策策略至关重要.
更多相关视频
07:42An Automated T-maze Based Apparatus and Protocol for Analyzing Delay- and Effort-based Decision Making in Free Moving Rodents
Published on: August 2, 2018
13:04Measuring the Subjective Value of Risky and Ambiguous Options using Experimental Economics and Functional MRI Methods
Published on: September 19, 2012
相关概念视频
Decision Making: P-value Method
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can...
Decision Making
Automatic decision-making is fast, intuitive, and relies on gut feelings...
Decision Making: Traditional Method
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
Multi-input and Multi-variable systems
In the absence...
Parameters Affecting Nonlinear Elimination: Zero-Order Input, First-Order Absorption and Two-Compartment Model
When a drug is administered through a constant intravenous infusion and eliminated via nonlinear pharmacokinetics, it follows zero-order input. For example, oral drugs undergo first-order absorption upon administration and are eliminated through nonlinear pharmacokinetics.
In the case of subcutaneously administered drugs,...
