Related Experiment Video
Updated: Jul 15, 2025
08:15
Capturing Dynamic Finger Gesturing with High-resolution Surface Electromyography and Computer Vision
Published on: March 28, 2025
587
Visualizing Hand Force with Wearable Muscle Sensing for Enhanced Mixed Reality Remote Collaboration
IEEE Transactions on Visualization and Computer Graphics
|October 3, 2023
Summary
This study introduces a system using surface electromyography (sEMG) sensors to share hand force in mixed reality (MR) remote collaboration. Visualizing this force enhances expert awareness and perception during physical tasks.
Area of Science:
- Human-Computer Interaction
- Robotics
- Wearable Technology
Background:
- Remote collaboration on physical tasks is vital, but understanding the worker's hand force is underexplored.
- Current mixed reality (MR) systems lack effective methods for conveying physical forces during remote collaboration.
Purpose of the Study:
- To develop and evaluate a prototype system for estimating and visualizing hand force in MR remote collaboration.
- To investigate the impact of shared hand force information on expert awareness, perception, and social presence.
Main Methods:
- Utilized wearable surface electromyography (sEMG) sensors to estimate hand force.
- Developed a system to visualize estimated hand force, overlaid on the worker's view or avatar.
- Conducted a user study with three visualization methods and two view modes to assess collaboration effectiveness.
Main Results:
- Sensing and sharing hand force significantly improved the expert's task awareness.
- Experts showed enhanced perception of the collaborator's hand force and object weight.
- A heightened sense of social presence was observed for the expert.
Conclusions:
- Hand force visualization in MR remote collaboration positively impacts expert perception and engagement.
- Design implications are provided for future MR systems integrating hand force sensing and visualization.
Related Concept Videos
01:30Three-Dimensional Force System
2.1K
In mechanical engineering, a three-dimensional force system is a system of forces acting in three dimensions, with forces applied along the x, y, and z coordinate axes. The three-dimensional force system is an important concept in mechanical engineering, as it allows engineers to understand and analyze the behavior of objects and structures in three dimensions. By understanding the forces acting on a system, engineers can design more efficient and effective mechanical systems that can withstand...
2.1K
01:17Muscles of the Forearm that Move the Hand and Fingers
1.0K
The muscles of the forearm that move the wrist, hand, and digits are numerous and diverse. They can be classified into two groups based on their location and function — the anterior and posterior compartment muscles.
Anterior Compartment
The anterior compartment muscles originate from the humerus. They primarily function as flexors and are also known as flexor muscles. They typically insert on the carpals, metacarpals, and phalanges. The superficial layer includes the flexor carpi...
Anterior Compartment
The anterior compartment muscles originate from the humerus. They primarily function as flexors and are also known as flexor muscles. They typically insert on the carpals, metacarpals, and phalanges. The superficial layer includes the flexor carpi...
1.0K