Related Experiment Video
Updated: Mar 5, 2026

13:44
Haptic/Graphic Rehabilitation: Integrating a Robot into a Virtual Environment Library and Applying it to Stroke Therapy
Published on: August 8, 2011
14.7K
Performance evaluation of 3D vision-based semi-autonomous control method for assistive robotic manipulator.
Hyun W Ka1,2, Cheng-Shiu Chung1,2, Dan Ding1,2
1a Department of Veterans Affairs , Human Engineering Research Laboratories , Pittsburgh , PA , USA.
Disability and Rehabilitation. Assistive Technology
|March 23, 2017
Summary
A new 3D vision-based semi-autonomous control interface enhances robot arm operation for individuals with impaired motor control. This system offers faster performance on complex tasks, improving rehabilitation outcomes.
Area of Science:
- Robotics
- Human-Computer Interaction
- Rehabilitation Engineering
Background:
- Assistive robotic manipulators (ARMs) are crucial for individuals with motor impairments.
- Existing control methods can be physically and cognitively demanding.
- There is a need for more intuitive and efficient control interfaces for ARMs.
Purpose of the Study:
- To develop and evaluate a 3D vision-based semi-autonomous control interface for ARMs.
- To assess the efficiency and usability of this interface for users with impaired motor control.
- To explore the potential benefits for clinical practice and rehabilitation.
Main Methods:
- Implementation of a semi-autonomous control interface using a commercially available ARM and a low-cost depth-sensing camera.
- Integration of object detection, audible text output for manipulation options, and voice command recognition.
- Empirical evaluations with human subjects from two groups to compare performance with manual control.
Main Results:
- The 3D vision-based semi-autonomous control interface facilitated fine motion control for users with impaired motor control.
- Significantly faster performance was observed for complex, real-life tasks compared to simple tasks.
- The system provided task-specific intelligent assistance while maintaining user control.
Conclusions:
- The developed interface offers a viable alternative control method for ARMs, reducing physical and cognitive demands.
- This technology has the potential to improve clinical practice and enhance the independence of individuals with motor impairments.
- The semi-autonomous control is compatible with various manual control methods for ARMs.
Keywords:
Assistive robotic manipulatorphysical disabilityrehabilitation roboticssemi-autonomous control
