Immersive Robot Teleoperation Based on User Gestures in Mixed Reality Space.

Area of Science:

• Robotics and Human-Computer Interaction
• Immersive Technologies

Background:

• Mixed Reality (MR) enables immersive visualization and interaction.
• Current MR systems map human motion to robots but often neglect environmental mapping.
• Insufficient environmental mapping hinders precise robotic task manipulation in MR.

Purpose of the Study:

• To propose an improved system for robot operation in real space using MR.
• To enhance immersion and task precision by mapping the surrounding environment in MR.

Main Methods:

• Developed a system to map the robot's task environment into the MR space.
• Enabled users to perform robot operations within this mapped MR environment.
• Focused on improving visualization of objects for precise manipulation.

Main Results:

• The proposed system successfully maps the surrounding task environment into MR.
• Users can operate robots in real space with enhanced environmental awareness.
• Improved precision in manipulation tasks due to better object visibility.

Conclusions:

• Mapping the task environment in MR significantly enhances robot operation.
• This approach overcomes limitations of previous MR systems for precise manipulation.
• The system offers a more comfortable and effective way to perform complex robotic tasks.