从传感器观测的开放词汇预测世界模型
Robin Karlsson1, Ruslan Asfandiyarov2, Alexander Carballo3
1Graduate School of Informatics, Nagoya University, Nagoya 464-8603, Japan.
Sensors (Basel, Switzerland)
|July 27, 2024
概括
研究人员开发了一种开放词汇预测世界模型 (OV-PWM),用于人工智能代理从传感器数据中学习因果模拟. 这个框架使机器人能够构建空间语义内存和内部模拟功能,以提高导航和理解.
科学领域:
- 人工智能的人工智能
- 认知科学 认知科学
- 机器人技术 机器人技术 机器人技术
背景情况:
- 智能代理人通过学习的因果心理模拟来执行空间推理.
- 学习这些模拟被称为预测世界建模.
研究的目的:
- 介绍开放词汇预测世界模型 (OV-PWM) 的第一个框架,能够从传感器观测中学习.
- 使人工智能代理能够执行预测性的世界建模,以增强空间推理和模拟.
主要方法:
- 使用层次变异自编码器 (HVAE) 实现了OV-PWM.
- 根据部分观测,HVAE可以预测多样而准确的环境.
- 模型是用于语义推理的潜在组成嵌入的高维嵌入地图.
主要成果:
- OV-PWM将预测世界建模简化为单阶段,端到端的学习方法.
- 卡拉模拟器实验证明了紧的潜伏表示和精确的世界生成与细节.
- 在一个城市序列上,在六个查询语义上实现了69mIoU,突出了详细的场景理解.
结论:
- OV-PWM为人工智能提供了一个通用的持续学习范式.
- 为移动机器人提供空间语义记忆和学习内部模拟.
- 为更具适应性和智能的通用机器人铺平了道路.
相关概念视频
Observational Learning
158
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
158
Multi-input and Multi-variable systems
105
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
In the absence...
105
Natural and Artificial Concepts
138
In psychology, concepts can be divided into two categories: natural and artificial. Natural concepts are formed through direct or indirect experiences. For example, consider the concept of snow. If you live in a place with regular snowfall, such as Essex Junction, Vermont, you know snow through direct experiences. You’ve seen it fall, touched it, shoveled it, and played in it. You recognize its texture, appearance, and even its smell. In contrast, if you live on an island like Saint...
138
Naturalistic Observations
15.4K
If you want to understand how behavior occurs, one of the best ways to gain information is to simply observe the behavior in its natural context. However, people might change their behavior in unexpected ways if they know they are being observed. How do researchers obtain accurate information when people tend to hide their natural behavior? As an example, imagine that your professor asks everyone in your class to raise their hand if they always wash their hands after using the restroom. Chances...
15.4K
Prediction Intervals
2.2K
The interval estimate of any variable is known as the prediction interval. It helps decide if a point estimate is dependable.
However, the point estimate is most likely not the exact value of the population parameter, but close to it. After calculating point estimates, we construct interval estimates, called confidence intervals or prediction intervals. This prediction interval comprises a range of values unlike the point estimate and is a better predictor of the observed sample value, y.
However, the point estimate is most likely not the exact value of the population parameter, but close to it. After calculating point estimates, we construct interval estimates, called confidence intervals or prediction intervals. This prediction interval comprises a range of values unlike the point estimate and is a better predictor of the observed sample value, y.
2.2K
Data Collection by Observations
11.9K
Data collection refers to a systematic way of obtaining, observing, measuring, and analyzing accurate information. Observational studies are one of the most widely used methods of data collection. It involves collecting data by observing the behavior and physical characteristics of a sample without making any modifications to the sample.
An astronomer viewing the motion and brightness of stars in the sky and recording the data is an example of observational data collection. A botanist recording...
An astronomer viewing the motion and brightness of stars in the sky and recording the data is an example of observational data collection. A botanist recording...
11.9K


