Robotic arm control by augmented reality-assisted object detection

Area of Science:

• Robotics
• Human-Computer Interaction
• Assistive Technology

Background:

• Existing robotic arm control systems often require physical input devices.
• These devices pose challenges for patients with severe motor impairments.

Purpose of the Study:

• To develop an accessible robotic arm control system for patients with motor impairments.
• To overcome the limitations of traditional physical input devices.

Main Methods:

• The proposed system integrates augmented reality and object detection.
• It enables robotic arm control solely through eye tracking.
• The system automatically configures paths between the robotic arm and target objects.

Main Results:

• Precise object localization was achieved.
• An intuitive gaze-based interface was implemented.
• The system demonstrated a user-friendly alternative to conventional methods.

Conclusions:

• The novel eye-tracking robotic arm control system offers significant advantages for patients with motor impairments.
• This technology provides a more accessible and intuitive solution compared to existing methods.