Jove
Visualize
联系我们
JoVE
x logofacebook logolinkedin logoyoutube logo
关于 JoVE
概览领导团队博客JoVE 帮助中心
作者
出版流程编辑委员会范围与政策同行评审常见问题投稿
图书馆员
用户评价订阅访问资源图书馆顾问委员会常见问题
研究
JoVE JournalMethods CollectionsJoVE Encyclopedia of Experiments存档
教育
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab Manual教师资源中心教师网站
使用条款与条件
隐私政策
政策

相关概念视频

Constraints and Statical Determinacy01:26

Constraints and Statical Determinacy

568
In structural engineering, the equilibrium of a system is not only determined by its equations of equilibrium but also with the help of constraints. Constraints refer to restrictions on the motion of a system. The proper combinations of constraints can minimize the total number of constraints needed to maintain a system in mechanical equilibrium. When this happens, the system is said to be statically determinate. For such systems, the unknown reaction supports can be estimated using equilibrium...
568
Naturalistic Observations02:30

Naturalistic Observations

15.4K
If you want to understand how behavior occurs, one of the best ways to gain information is to simply observe the behavior in its natural context. However, people might change their behavior in unexpected ways if they know they are being observed. How do researchers obtain accurate information when people tend to hide their natural behavior? As an example, imagine that your professor asks everyone in your class to raise their hand if they always wash their hands after using the restroom. Chances...
15.4K
Censoring Survival Data01:09

Censoring Survival Data

56
Survival analysis is a statistical method used to analyze time-to-event data, often employed in fields such as medicine, engineering, and social sciences. One of the key challenges in survival analysis is dealing with incomplete data, a phenomenon known as "censoring." Censoring occurs when the event of interest (such as death, relapse, or system failure) has not occurred for some individuals by the end of the study period or is otherwise unobservable, and it might have many different...
56
Multi-input and Multi-variable systems01:22

Multi-input and Multi-variable systems

93
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
93
Statically Indeterminate Problem Solving01:16

Statically Indeterminate Problem Solving

355
Statically indeterminate problems are those where statics alone can not determine the internal forces or reactions. Consider a structure comprising two cylindrical rods made of steel and brass. These rods are joined at point B and restrained by rigid supports at points A and C. Now, the reactions at points A and C and the deflection at point B are to be determined. This rod structure is classified as statically indeterminate as the structure has more supports than are necessary for maintaining...
355
Archival Research01:40

Archival Research

15.9K
Some researchers gain access to large amounts of data without interacting with a single research participant. Instead, they use existing records to answer various research questions. This type of research approach is known as archival research. Archival research relies on looking at past records or data sets to look for interesting patterns or relationships. For example, a researcher might access the academic records of all individuals who enrolled in college within the past ten years and...
15.9K

您也可能阅读

相关文章

通过共同作者、期刊和引用图与本文相关的文章。

排序
Same author

Covalent organic frameworks for ratiometric fluorescent monitoring copper corrosion in tin bronze.

Spectrochimica acta. Part A, Molecular and biomolecular spectroscopy·2026
Same author

Rainfall sustains multiyear La Niña.

Nature communications·2026
Same author

Imminent rapid decline of the Indonesian Throughflow after reaching a turning point of CO2 concentration.

Nature communications·2025
Same author

Improvement analysis of organic light emitting diode temperature control by integrating whale algorithm in PID control system.

PloS one·2025
Same author

Genome-wide analysis of C-repeat binding factor (CBF) family members in Pennisetum glaucum and the function of PgCBF21 under cold stress.

BMC plant biology·2025
Same author

Learning to Coordinate With Different Teammates via Team Probing.

IEEE transactions on neural networks and learning systems·2025

相关实验视频

Updated: May 27, 2025

Operation of the Collaborative Composite Manufacturing CCM System
10:09

Operation of the Collaborative Composite Manufacturing CCM System

Published on: October 1, 2019

6.5K

用离线数据限制一个不受限制的多代理策略.

Cong Guan1, Tao Jiang2, Yi-Chen Li3

  • 1National Key Laboratory for Novel Software Technology, Nanjing University, Nanjing, China; School of Artificial Intelligence, Nanjing University, Nanjing, China; Polixir Technologies, Nanjing, China. Electronic address: https://www.lamda.nju.edu.cn/gaunc/.

Neural networks : the official journal of the International Neural Network Society
|February 18, 2025
PubMed
概括

使用离线数据 (CUTMAP) 限制无限制的多代理政策,可以在没有在线培训的情况下实现安全的多代理强化学习. CUTMAP有效地将现有政策适应新的约束,减少现实世界的互动需求.

关键词:
有限制的强化学习学习.多代理增强学习学习多代理增强学习在线非线增强学习.

更多相关视频

A Networked Desktop Virtual Reality Setup for Decision Science and Navigation Experiments with Multiple Participants
06:28

A Networked Desktop Virtual Reality Setup for Decision Science and Navigation Experiments with Multiple Participants

Published on: August 26, 2018

5.9K
The HoneyComb Paradigm for Research on Collective Human Behavior
06:48

The HoneyComb Paradigm for Research on Collective Human Behavior

Published on: January 19, 2019

9.3K

相关实验视频

Last Updated: May 27, 2025

Operation of the Collaborative Composite Manufacturing CCM System
10:09

Operation of the Collaborative Composite Manufacturing CCM System

Published on: October 1, 2019

6.5K
A Networked Desktop Virtual Reality Setup for Decision Science and Navigation Experiments with Multiple Participants
06:28

A Networked Desktop Virtual Reality Setup for Decision Science and Navigation Experiments with Multiple Participants

Published on: August 26, 2018

5.9K
The HoneyComb Paradigm for Research on Collective Human Behavior
06:48

The HoneyComb Paradigm for Research on Collective Human Behavior

Published on: January 19, 2019

9.3K

科学领域:

  • 人工智能的人工智能
  • 机器学习 机器学习
  • 机器人技术 机器人技术 机器人技术

背景情况:

  • 现实世界的多代理系统需要在约束下 (例如安全,经济) 进行决策.
  • 约束式多代理强化学习 (CMARL) 解决了这一问题,但通常依赖于在线培训,这往往是不可行的.
  • 在初始政策培训后,可能会出现新的约束,需要进行调整.

研究的目的:

  • 提出一种方法 (CUTMAP) 用于使用离线数据来约束不受约束的多代理政策.
  • 为了使CMARL在不需要在线交互的情况下实现,并促进适应新的约束.
  • 为了应对线下学习的挑战,例如分发转移.

主要方法:

  • 在多代理最大强化学习中开发了一个可扩展的优化目标.
  • 使用不受约束的先前政策和离线成本信号估计了可分解的Q函数.
  • 纳入了保守的损失条款,以减轻线下分销转移.

主要成果:

  • CUTMAP有效地使用仅线下数据来约束不受约束的政策.
  • 该方法可以通过重新使用以前的政策而适应新的约束,而无需重新培训.
  • 在各种合作多代理基准 (星际飞船,粒子游戏,机器人控制) 中表现出卓越的表现.

结论:

  • 通过利用离线数据,CUTMAP为CMARL提供了一个实用的解决方案.
  • 它减少了对昂贵的在线交互和模拟器开发的需求.
  • 方便在现实应用中部署MARL,限制不断变化.