在多步决策过程中,XCS用于连续感知别名
1Department of Computer Science, Okayama University, 3-1-1 Tsushima-naka Kita-ku Okayama, 700-8530, Japan uwano@okayama-u.ac.jp.
Evolutionary computation
|March 4, 2026
概括
机器人在区分状态方面面临挑战,原因是连续的感知别名. 基于参考框架的新层次XCS (Hi-FoRsXCS) 系统通过链接别名状态来提高政策学习的准确性.
科学领域:
- 人工智能的人工智能
- 机器人技术 机器人技术 机器人技术
- 认知科学 认知科学
背景情况:
- 连续感知别名对学习代理人构成重大挑战,阻碍他们区分状态并做出最佳决策的能力.
- 当前的系统往往在有效抽象和对观察的歧视方面扎,限制了政策学习.
- 这就需要新的方法来处理机器人系统中复杂的状态表示.
研究的目的:
- 引入新类型的顺序别名并提出一个增强的XCS分类器系统.
- 为了使学习代理人能够有效地管理和学习别名状态在连续的决策任务.
- 在存在感知别名时,提高政策学习的准确性和效率.
主要方法:
- 在顺序别名化背景下引入新的别名化类型.
- 开发基于参考框架的层次 XCS (Hi-FoRsXCS) 分类器.
- 实施一个完整的学习国家行动图.
- 连锁连锁的异名状态的序列与相同的观察到一个链.
主要成果:
- 拟议的Hi-FoRsXCS系统成功地链接了别名状态的序列.
- Hi-FoRsXCS使用状态链的末端预测了观察和别名状态之间的关联.
- 实验结果表明,Hi-FoRsXCS在准确性方面明显优于现有系统.
- 该系统通过完整的行动图实现了最佳的政策学习.
结论:
- Hi-FoRsXCS为学习代理中的顺序感知别名提供了一个强大的解决方案.
- 链接机制有效地解决了差异化状态与类似观察的挑战.
- 与以前的方法相比,增强的系统在政策学习准确性方面表现优越.
- 提供了进一步讨论Hi-FoRsXCS的局限性.
相关概念视频
01:20Parallel Processing
839
The brain processes sensory information rapidly due to parallel processing, which involves sending data across multiple neural pathways at the same time. This method allows the brain to manage various sensory qualities, such as shapes, colors, movements, and locations, all concurrently. For instance, when observing a forest landscape, the brain simultaneously processes the movement of leaves, the shapes of trees, the depth between them, and the various shades of green. This enables a quick and...
839
01:14Decision Making: Traditional Method
5.6K
The process of hypothesis testing based on the traditional method includes calculating the critical value, testing the value of the test statistic using the sample data, and interpreting these values.
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
5.6K
01:20Decision Making
1.1K
Decision-making is a fundamental cognitive process that involves evaluating alternatives and selecting among them. This process can range from simple choices, such as deciding what to wear, to complex decisions, like choosing a major in college or a career path. The complexity of the decision often dictates the approach we use, which can be broadly categorized into two types: automatic and controlled decision-making.
Automatic decision-making is fast, intuitive, and relies on gut feelings...
Automatic decision-making is fast, intuitive, and relies on gut feelings...
1.1K
01:22Multi-input and Multi-variable systems
449
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence of...
In the absence of...
449