适应性政策切换为多剂型ASVs在多目标水域清洁环境中的多剂型ASV
Dame Seck1, Samuel Yanes-Luis2, Manuel Perales-Esteve1
1Department of Electronic Engineering, University of Sevilla, 41004 Seville, Spain.
Sensors (Basel, Switzerland)
|January 28, 2026
概括
自主地表车辆使用多剂深度强化学习来有效清洁塑料. 这种适应性框架优化了勘探和清洁任务,优于水生环境的固定策略.
科学领域:
- 环境科学 环境科学
- 机器人技术 机器人技术 机器人技术
- 人工智能的人工智能
背景情况:
- 塑料污染对全球水生环境构成重大生态威胁.
- 可扩展和自主解决方案对于有效的环境清洁行动至关重要.
- 协调的多车系统为应对大规模污染挑战提供了一个有希望的方法.
研究的目的:
- 为协调自主地表车辆 (ASV) 开发一个多智能增强学习框架.
- 在ASV任务中解脱和优化勘探和垃圾收集的相互矛盾目标.
- 创建一个适应性系统,能够管理任务切换,以实现高效的自主清洁.
主要方法:
- 制定了ASV协调问题作为一个部分可观测的马尔科夫游戏.
- 实施了多代理深度强化学习框架,使用共享的多任务深度Q网络与卷积骨干和双头.
- 开发了一个基于加权奖励聚合和奖励贪策略的适应性任务交换机制.
主要成果:
- 与固定阶段方法相比,拟议的框架在超量 (14%) 和统一性 (300%) 度量方面显示出显著的改进.
- 该系统有效地适应了各种初始垃圾分配,表现出强大的性能.
- 构建了帕雷托阵线,捕捉了对勘探和清理任务权衡的非主导解决方案.
结论:
- 开发的多代理深度强化学习框架为水生环境中自主清洁塑料提供了有效和适应性的策略.
- 参数共享和自我中心状态设计提高了学习效率,并使跨代理和任务的经验聚合成为可能.
- 这种方法为环境监测和修复提供了可扩展的解决方案,为决策者提供了多样化的操作策略.
相关概念视频
Multi-input and Multi-variable systems
412
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence of...
In the absence of...
412
Multi-Step Reactions
8.7K
Chemical reactions often occur in a stepwise fashion involving two or more distinct reactions taking place in a sequence. A balanced equation indicates the reacting species and the product species, but it reveals no details about how the reaction occurs at the molecular level. The reaction mechanism (or reaction path) provides details regarding the precise, step-by-step process by which a reaction occurs. Each of the steps in a reaction mechanism is called an elementary reaction. These...
8.7K
Multi-species Conserved Sequences
4.7K
Next-generation sequencing technologies have created large genomic databases of a variety of animals and plants. Ever since the human genome project was completed, scientists studied the genome of primates, mammals, and other phylogenetically distant living beings. Such large-scale studies have provided new insights into the evolutionary relationship between organisms.
Although the genome of each species varies greatly from each other, a few sequences are highly conserved. Such conserved...
Although the genome of each species varies greatly from each other, a few sequences are highly conserved. Such conserved...
4.7K
Insertion of Multi-pass Transmembrane Proteins in the RER
18.3K
The rough ER membrane synthesizes, assembles, and embeds transmembrane proteins in diverse topologies. These proteins function as transporters or channels and can remain in the ER membrane or are sent to the Golgi complex, lysosome, and cell membrane.
The multipass transmembrane proteins are the type IV integral membrane proteins with multiple topogenic sequences determining their spatial arrangement in the ER membrane. Nearly all multipass proteins lack a cleavable signal sequence and use...
The multipass transmembrane proteins are the type IV integral membrane proteins with multiple topogenic sequences determining their spatial arrangement in the ER membrane. Nearly all multipass proteins lack a cleavable signal sequence and use...
18.3K
Multi-pass Transmembrane Proteins and β-barrels
6.5K
In multi-pass transmembrane proteins, the polypeptide chain crosses the membrane more than once. The transmembrane polypeptide chain either forms an α-helix or β-strand structure. α-Helix containing multi-pass transmembrane proteins are ubiquitous, whereas β-strand containing ones are mainly found in gram-negative bacteria, mitochondria, and chloroplasts.
α-Helix containing multi-pass transmembrane proteins
Multi-pass transmembrane proteins such as...
α-Helix containing multi-pass transmembrane proteins
Multi-pass transmembrane proteins such as...
6.5K
Switching of BJT
849
Switching behavior in Bipolar Junction Transistors (BJTs) is a fundamental aspect utilized in various electronic circuits, particularly for digital logic applications like switches and amplifiers. In a typical switching circuit, a BJT alternates between cut-off and saturation modes, corresponding to the "off" and "on" states, respectively, thus behaving like an ideal switch.
Cut-off Mode ("Off" State): In this state, both the emitter-base and collector-base junctions are...
Cut-off Mode ("Off" State): In this state, both the emitter-base and collector-base junctions are...
849


