Related Experiment Video
Updated: Dec 7, 2025
06:34
A Single-Channel and Non-Invasive Wearable Brain-Computer Interface for Industry and Healthcare
Published on: July 7, 2023
3.0K
Electrode-free visual prosthesis/exoskeleton control using augmented reality glasses in a first
Simon Hazubski1,2, Harald Hoppe1, Andreas Otte3
1Laboratory of Computer Assisted Medicine, Division of Medical Engineering, Department of Electrical Engineering, Medical Engineering and Computer Science, Offenburg University, Badstr. 24, 77652, Offenburg, Germany.
Scientific Reports
|October 2, 2020
Summary
This study introduces a novel augmented reality (AR) system for intuitive prosthetic control. Visual tracking via AR glasses offers a natural alternative to traditional neuroprosthetic methods, enhancing usability for patients.
Area of Science:
- Neuroprosthetics and Biomedical Engineering
- Human-Computer Interaction
- Augmented Reality Applications
Background:
- Current neuroprosthetic control methods like electromyography (EMG) and electrooculography/electroencephalography (EOG/EEG) are costly, time-consuming, prone to interference, and require extensive patient training.
- There is a significant need for more robust, user-friendly prosthetic control systems suitable for daily use.
Purpose of the Study:
- To present a novel concept for complete visual control of prostheses, exoskeletons, or other end-effectors using augmented reality (AR) glasses.
- To demonstrate the feasibility of this AR-based control system in a proof-of-concept study.
Main Methods:
- Utilized AR glasses with an integrated monocular camera to track a marker attached to the prosthesis.
- Registered minimal relative head movements concerning the prosthesis for control input.
- Implemented and presented two distinct control mechanisms with visual feedback for a motorized hand orthosis and a motorized hand prosthesis.
Main Results:
- Successfully demonstrated a functional AR-based visual control system for prosthetic devices.
- The system leverages head movements tracked by AR glasses for intuitive prosthesis manipulation.
- Visual feedback integrated into the grasping process enhances the natural feel of control.
Conclusions:
- The proposed AR visual control system offers a natural and intuitive method for operating prostheses and exoskeletons.
- This approach addresses limitations of current neuroprosthetic control systems, potentially improving patient adoption and daily usability.
- Further development of this visual control paradigm holds promise for advancing neuroprosthetic technology.
