Human-in-the-loop active electrosense.

Area of Science:

• Robotics
• Bio-inspired sensing
• Human-computer interaction

Background:

• Weakly electric fish utilize active electrosense for short-range object detection in darkness.
• Underwater teleoperation faces challenges in environments with poor visibility, such as dark or turbid water.

Purpose of the Study:

• To investigate the application of active electrosense for object localization in underwater teleoperation using a virtual reality head-mounted display (VR HMD).
• To achieve human-computer synergy by integrating an active electrosense robot with a VR system, leveraging human strengths in pattern interpretation and computer strengths in data processing.

Main Methods:

• An active electrosense underwater robot was integrated with the Oculus Rift VR HMD.
• A virtual environment was created to visualize electric images of surrounding objects and incorporate virtual fixtures to guide users.
• User testing was conducted to evaluate the effectiveness of the system for object localization.

Main Results:

• Virtual fixtures within the VR environment significantly reduced the time required for object localization.
• The virtual fixtures did not substantially increase the accuracy of object position estimation.
• The study demonstrated the feasibility of translating electrolocation physics into an intuitive visual representation.

Conclusions:

• Integrating active electrosense with VR offers a promising approach for underwater object localization in challenging visibility conditions.
• Human-computer synergy, facilitated by intuitive visual feedback, enhances task performance in electrolocation-based teleoperation.
• This technology has the potential to overcome limitations of traditional imaging systems in environments where visibility is compromised.