Three-Dimensional Visualization System with Spatial Information for Navigation of Tele-Operated Robots

Area of Science:

• Robotics
• Computer Vision
• Geospatial Information Systems

Background:

• Tele-operated robots are crucial for tasks in inaccessible disaster areas.
• Effective environmental visualization is vital for real-time robot control and decision-making.
• Existing systems may lack the necessary accuracy and comprehensive spatial data for complex environments.

Purpose of the Study:

• To develop and evaluate a novel three-dimensional visualization system for tele-operated robots.
• To enhance the situational awareness and control capabilities of robot operators in real-time.
• To provide accurate spatial information and multiple viewing angles for improved decision-making.

Main Methods:

• The system integrates four fisheye cameras and a 360° laser scanner.
• A spatial model is generated from laser scanner data as the robot navigates unknown environments.
• A single, stitched image is created in real-time by mapping data from the cameras onto the spatial model.

Main Results:

• The visualized output provides integrated spatial information, enabling operators to easily perceive the surroundings.
• The system allows operators to ascertain the robot's relative position within the environment.
• Multiple viewing angles are available without repositioning the robot or sensors, improving adaptability.
• Experimental results indicate a more natural visual appearance compared to conventional methods.

Conclusions:

• The proposed 3D visualization system significantly enhances tele-operation by providing real-time, accurate spatial context.
• This system improves operator comprehension and decision-making in dynamic and hazardous environments.
• The integration of camera and laser scanner data offers a robust solution for robot navigation and task execution.