Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Mental imagery for a conversational robot.

Deb Roy1, Kai-Yuh Hsiao, Nikolaos Mavridis

  • 1Massachussetts Institute of Technology Media Laboratory, MIT, Cambridge, MA 02142, USA. dkroy@media.mit.edu

IEEE Transactions on Systems, Man, and Cybernetics. Part B, Cybernetics : a Publication of the IEEE Systems, Man, and Cybernetics Society
|October 16, 2004
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Language model estimates indicate increased outgroup animosity among a sample of politicians, journalists, and partisan users on Twitter and Reddit.

Scientific reports·2026
Same author

The speed of news in Twitter (X) versus radio.

Scientific reports·2024
Same author

Allograft nephrectomy versus nonallograft nephrectomy after failed renal transplantation: a systematic review by updated meta-analysis.

Transplant international : official journal of the European Society for Organ Transplantation·2021
Same author

Simulating SARS-CoV-2 epidemics by region-specific variables and modeling contact tracing app containment.

NPJ digital medicine·2021
Same author

Sex and gender differences and biases in artificial intelligence for biomedicine and healthcare.

NPJ digital medicine·2020
Same author

Minimally invasive stabilization for thoracolumbar and lumbar fractures: a comparative study with short segment open Schanz screw constructs.

Journal of spine surgery (Hong Kong)·2019
Same journal

Strategic Ability Updating in Concurrent Games by Coalitional Commitment.

IEEE transactions on systems, man, and cybernetics. Part B, Cybernetics : a publication of the IEEE Systems, Man, and Cybernetics Society·2015
Same journal

Meta-Analysis of the First Facial Expression Recognition Challenge.

IEEE transactions on systems, man, and cybernetics. Part B, Cybernetics : a publication of the IEEE Systems, Man, and Cybernetics Society·2012
Same journal

Adjustable model-based fusion method for multispectral and panchromatic images.

IEEE transactions on systems, man, and cybernetics. Part B, Cybernetics : a publication of the IEEE Systems, Man, and Cybernetics Society·2012
Same journal

Face Feature Weighted Fusion Based on Fuzzy Membership Degree for Video Face Recognition.

IEEE transactions on systems, man, and cybernetics. Part B, Cybernetics : a publication of the IEEE Systems, Man, and Cybernetics Society·2012
Same journal

A New Adaptive Fast Cellular Automaton Neighborhood Detection and Rule Identification Algorithm.

IEEE transactions on systems, man, and cybernetics. Part B, Cybernetics : a publication of the IEEE Systems, Man, and Cybernetics Society·2012
Same journal

Human-arm-and-hand-dynamic model with variability analyses for a stylus-based haptic interface.

IEEE transactions on systems, man, and cybernetics. Part B, Cybernetics : a publication of the IEEE Systems, Man, and Cybernetics Society·2012
See all related articles

Robots can now understand and use spatial language by creating a "mental model" of their environment. This allows them to imagine different viewpoints and track objects not in sight for better conversations.

Area of Science:

  • Robotics
  • Artificial Intelligence
  • Cognitive Science

Background:

  • Robots need to connect language and vision for natural conversations.
  • Language involves perspective-taking and object permanence, which are challenging for robots.

Purpose of the Study:

  • To enable robots to engage in situated spoken dialogue.
  • To develop a system for robots to comprehend and produce spatial language.

Main Methods:

  • Coupling active vision with physical simulation to create a robot's "mental model" of its environment.
  • Implementing procedures for generating "imagined" views from arbitrary perspectives.

Main Results:

  • A robotic manipulator can maintain a dynamic internal representation of its physical surroundings.

Related Experiment Videos

  • The system supports understanding and generating language related to spatial relationships and object presence.

    • Conclusions:

    • The developed approach allows robots to simulate perspective shifts and maintain object permanence.
    • This is a foundational step towards more natural human-robot interaction and situated language understanding.