Related Experiment Video
Updated: Jun 7, 2026
05:12
Using Virtual Reality to Transfer Motor Skill Knowledge from One Hand to Another
Published on: September 18, 2017
545.8K
SensARy Substitution: Augmented Reality Techniques to Enhance Force Perception in Touchless Robot Control
IEEE Transactions on Visualization and Computer Graphics
|March 14, 2025
Summary
Augmented reality (AR) enhances touchless human-robot interaction by providing visual or vibrotactile feedback, reducing force errors in applications like robotic ultrasound. However, increased feedback led to longer task completion times.
Area of Science:
- Human-Robot Interaction
- Robotics
- Augmented Reality
Background:
- Touchless human-robot interaction (HRI) lacks crucial haptic feedback, impacting applications like robotic ultrasound where force perception is vital for image quality.
- Augmented reality (AR) offers sensory substitution through visual or vibrotactile feedback to mitigate this limitation.
Purpose of the Study:
- To investigate the effectiveness of visual and vibrotactile feedback in touchless HRI for robotic ultrasound.
- To compare multimodal feedback against individual feedback modalities and evaluate different visualization designs and positions.
Main Methods:
- Implemented two visualization types (2D bar, 3D arrow) at three positions for visual force feedback.
- Investigated the effects of vibrotactile feedback and multimodal feedback (visual + vibrotactile) compared to feedback-less conditions.
- Collected data on force errors and subjective user preferences.
Main Results:
- Sensory substitution significantly eased interaction compared to no feedback.
- Visual support reduced average force errors and was subjectively preferred.
- Increased feedback led to longer task completion times.
- A 2D bar visualization was more effective than a 3D arrow, and on-screen visualizations were preferred.
Conclusions:
- Visual and vibrotactile feedback are effective sensory substitution methods for touchless HRI.
- Visualization design and display position significantly influence user performance and preference.
- Findings contribute to developing improved sensory substitution for touchless HRI in critical applications.
Related Concept Videos
01:33Somatosensation
The somatosensory system relays sensory information from the skin, mucous membranes, limbs, and joints. Somatosensation is more familiarly known as the sense of touch. A typical somatosensory pathway includes three types of long neurons: primary, secondary, and tertiary. Primary neurons have cell bodies located near the spinal cord in groups of neurons called dorsal root ganglia. The sensory neurons of ganglia innervate designated areas of skin called dermatomes.
01:27Tactile and Chemical Senses
Tactile senses encompass touch, temperature, and pain, each mediated by specific receptors. Touch receptors detect mechanical energy or pressure against the skin. Sensory fibers from these receptors enter the spinal cord and relay information to the brain stem. Here, most fibers cross over to the opposite side of the brain. The touch information then moves to the thalamus, which projects a map of the body's surface onto the somatosensory areas of the parietal lobes in the cerebral cortex. This...