Related Experiment Video
Updated: Nov 1, 2025

Capturing Dynamic Finger Gesturing with High-resolution Surface Electromyography and Computer Vision
Published on: March 28, 2025
Magnetic Array Assisted Triboelectric Nanogenerator Sensor for Real-Time Gesture Interaction.
Ken Qin1, Chen Chen1, Xianjie Pu2
1Department of Applied Physics, State Key Laboratory of Power Transmission Equipment & System Security and New Technology, Chongqing Key Laboratory of Soft Condensed Matter Physics and Smart Materials, Chongqing University, Chongqing, 400044, People's Republic of China.
A novel magnetic array assisted sliding triboelectric sensor enables real-time gesture control for robotic hands. This wearable sensor accurately quantifies finger motion, enhancing human-robot interaction through intuitive control.
Area of Science:
- Robotics
- Human-Machine Interaction
- Sensor Technology
Background:
- Robotic hands offer versatile applications but often lack intuitive control methods.
- Current human-robot interaction relies on handles, limiting natural engagement.
- Gesture-based control promises enhanced convenience and intuition.
Purpose of the Study:
- To develop a magnetic array assisted sliding triboelectric sensor for real-time gesture interaction with robotic hands.
- To enable intuitive control of robotic hands through natural human hand movements.
- To provide a new strategy for natural, intuitive, and real-time human-robotic interaction.
Main Methods:
- A sliding triboelectric sensor integrated with a magnetic array was designed.
- Finger flexion and extension movements generated positive/negative pulse signals.
- Pulse counting in unit time quantified finger motion degree, speed, and direction.
- A two-part magnetic array optimized sensor durability, low-speed signal amplitude, and stability.
Main Results:
- The sensor successfully translated finger traction movements into quantifiable pulse signals.
- Real-time judgment of finger motion degree, speed, and direction was achieved.
- The magnetic array enhanced sensor durability, signal stability, and low-speed performance.
- A direct quantization approach for gesture sensing was demonstrated.
Conclusions:
- The magnetic array assisted sliding triboelectric sensor offers a direct quantization method for gesture recognition.
- This technology provides a natural and intuitive strategy for real-time human-robotic interaction.
- Optimized wearable gesture sensors pave the way for advanced human-robot collaboration.
Related Concept Videos
Magnetic Force
The magnetic force acting on a moving charge...
Design Example: Resistive Touchscreen
When a user touches the screen, the two layers make contact at a specific point known as the touchpoint. This contact reduces the resistance between...

