Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Observational Learning

Observational Learning

Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...

Multi-input and Multi-variable systems

Multi-input and Multi-variable systems

Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...

Natural and Artificial Concepts

Natural and Artificial Concepts

In psychology, concepts can be divided into two categories: natural and artificial. Natural concepts are formed through direct or indirect experiences. For example, consider the concept of snow. If you live in a place with regular snowfall, such as Essex Junction, Vermont, you know snow through direct experiences. You’ve seen it fall, touched it, shoveled it, and played in it. You recognize its texture, appearance, and even its smell. In contrast, if you live on an island like Saint...

Naturalistic Observations

Naturalistic Observations

If you want to understand how behavior occurs, one of the best ways to gain information is to simply observe the behavior in its natural context. However, people might change their behavior in unexpected ways if they know they are being observed. How do researchers obtain accurate information when people tend to hide their natural behavior? As an example, imagine that your professor asks everyone in your class to raise their hand if they always wash their hands after using the restroom. Chances...

Prediction Intervals

Prediction Intervals

The interval estimate of any variable is known as the prediction interval. It helps decide if a point estimate is dependable.
However, the point estimate is most likely not the exact value of the population parameter, but close to it. After calculating point estimates, we construct interval estimates, called confidence intervals or prediction intervals. This prediction interval comprises a range of values unlike the point estimate and is a better predictor of the observed sample value, y.

Data Collection by Observations

Data Collection by Observations

Data collection refers to a systematic way of obtaining, observing, measuring, and analyzing accurate information. Observational studies are one of the most widely used methods of data collection. It involves collecting data by observing the behavior and physical characteristics of a sample without making any modifications to the sample.
An astronomer viewing the motion and brightness of stars in the sky and recording the data is an example of observational data collection. A botanist recording...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

R1 Prognostic Significance of T-Wave Amplitude Variability for Adverse Cardiovascular Outcomes: A Systematic Review and Meta-Analysis.

Journal of arrhythmia·2026

Same author

Durvalumab After Chemoradiotherapy for Locally Advanced NSCLC: A Real-World Analysis Using a Nationwide Claims Database in Japan.

Clinical lung cancer·2026

Same author

Radiotherapy utilization in the last 30 days before death among patients with malignant neoplasms in Japan: a claims database study.

International journal of clinical oncology·2026

Same author

Influence of Age on the Effectiveness of Lee Silverman Voice Treatment<sup>®</sup> BIG in Patients with Parkinson's Disease: A Retrospective Exploratory Observational Study.

Geriatrics (Basel, Switzerland)·2026

Same author

Comparison of three arm-positioning techniques for minimizing motion artifacts in breast magnetic resonance imaging: a prospective volunteer study.

Breast cancer (Tokyo, Japan)·2026

Same author

Applying team strategies for dynamic coordination: A comparative study of expertise using 3-on-3 basketball.

PloS one·2026

Same journal

RETRACTED: Zhang et al. A Novel Framework for Reconstruction and Imaging of Target Scattering Centers via Wide-Angle Incidence in Radar Networks. <i>Sensors</i> 2025, <i>25</i>, 6802.

Sensors (Basel, Switzerland)·2026

Same journal

Enhancing Unsupervised Multi-Source Domain Adaptation for Person Re-Identification via Mixture of Experts and Graph-Based Relation.

Sensors (Basel, Switzerland)·2026

Same journal

Development of an Instrumented Glove for Palmar Pressure Assessment in Kayakers.

Sensors (Basel, Switzerland)·2026

Same journal

Development and Experimental Validation of an Autonomous IoT-Based Monitoring System for Real-Time Water Quality Assessment in the Amazon River.

Sensors (Basel, Switzerland)·2026

Same journal

Semi-Supervised Adversarial Learning Framework for Controller Area Network Bus Intrusion Detection.

Sensors (Basel, Switzerland)·2026

Same journal

Smart Optimization Method for Safety Signs in Innovative Manufacturing Environments Integrating Industrial Field IoT Sensors and Knowledge Graphs.

Sensors (Basel, Switzerland)·2026

See all related articles

Search research articles

Related Experiment Video

Updated: Jun 18, 2025

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Published on: December 6, 2024

Open-Vocabulary Predictive World Models from Sensor Observations.

Robin Karlsson¹, Ruslan Asfandiyarov², Alexander Carballo³

¹Graduate School of Informatics, Nagoya University, Nagoya 464-8603, Japan.

Sensors (Basel, Switzerland)

|July 27, 2024

Summary

This summary is machine-generated.

Researchers developed an open-vocabulary predictive world model (OV-PWM) for AI agents to learn causal simulations from sensor data. This framework enables robots to build spatio-semantic memory and internal simulation capabilities for enhanced navigation and understanding.

Keywords:

BEV generation autonomous driving continual learning generative models mobile robots open-vocabulary semantics self-supervised learning world models

More Related Videos

Using the Visual World Paradigm to Study Sentence Comprehension in Mandarin-Speaking Children with Autism

Using the Visual World Paradigm to Study Sentence Comprehension in Mandarin-Speaking Children with Autism

Published on: October 3, 2018

Using Eye Movements Recorded in the Visual World Paradigm to Explore the Online Processing of Spoken Language

Using Eye Movements Recorded in the Visual World Paradigm to Explore the Online Processing of Spoken Language

Published on: October 13, 2018

Related Experiment Videos

Last Updated: Jun 18, 2025

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Published on: December 6, 2024

Using the Visual World Paradigm to Study Sentence Comprehension in Mandarin-Speaking Children with Autism

Using the Visual World Paradigm to Study Sentence Comprehension in Mandarin-Speaking Children with Autism

Published on: October 3, 2018

Using Eye Movements Recorded in the Visual World Paradigm to Explore the Online Processing of Spoken Language

Using Eye Movements Recorded in the Visual World Paradigm to Explore the Online Processing of Spoken Language

Published on: October 13, 2018

Area of Science:

Artificial Intelligence
Cognitive Science
Robotics

Background:

Intelligent agents perform spatial reasoning via learned causal mental simulations.
Learning these simulations is known as predictive world modeling.

Purpose of the Study:

Introduce the first framework for an open-vocabulary predictive world model (OV-PWM) capable of learning from sensor observations.
Enable AI agents to perform predictive world modeling for enhanced spatial reasoning and simulation.

Main Methods:

Implemented OV-PWM using a hierarchical variational autoencoder (HVAE).
The HVAE predicts diverse and accurate environments from partial observations.
Models high-dimensional embedding maps of latent compositional embeddings for semantic inference.

Main Results:

OV-PWM simplifies predictive world modeling to a single-stage, end-to-end learning method.
CARLA simulator experiments demonstrate compact latent representations and accurate world generation with fine details.
Achieved 69 mIoU over six query semantics on an urban sequence, highlighting detailed scene understanding.

Conclusions:

OV-PWM offers a versatile continual learning paradigm for AI.
Provides spatio-semantic memory and learned internal simulation for mobile robots.
Paves the way for more adaptable and intelligent general-purpose robots.