Design, Implementation and Evaluation of an Immersive Teleoperation Interface for Human-Centered Autonomous Driving

Area of Science:

• Robotics and Human-Robot Interaction (HRI)
• Autonomous Systems
• Virtual Reality (VR) and Simulation

Background:

• Advancing autonomous driving necessitates robust human-in-the-loop systems for safety and public trust.
• Remote intervention capabilities are crucial for managing unexpected events in autonomous driving.

Purpose of the Study:

• To design and evaluate a context-aware immersive teleoperation interface for remote interventions in autonomous driving emergencies.
• To explore the integration of real-time simulation, VR, and multimodal feedback for enhanced remote control.

Main Methods:

• Developed a modular ROS2-based teleoperation system with seamless simulation-to-physical platform transitions.
• Integrated virtual reality, real-time simulation, and multimodal feedback (e.g., gesture recognition).
• Evaluated system performance through experimental testing focusing on task success and user experience.

Main Results:

• Achieved a high task success rate in experimental evaluations.
• Demonstrated significant user satisfaction with the immersive teleoperation interface.
• Confirmed the importance of intuitive controls, accurate gesture recognition, and low-latency feedback.

Conclusions:

• The developed immersive teleoperation system effectively supports remote interventions in autonomous driving scenarios.
• Multisensory feedback and intuitive controls are key to building operator trust and situational awareness.
• This approach enhances human supervision and confidence, contributing to the acceptance of autonomous driving technologies.