Related Experiment Video
Updated: May 22, 2025

Capturing Dynamic Finger Gesturing with High-resolution Surface Electromyography and Computer Vision
Published on: March 28, 2025
Deep Learning-Assisted Triboelectric Sensor for Complex Gesture Recognition
Ping Zhang1, Weimeng Pan1, Zhihao Li1
1School of Electrical and Information Engineering, Tianjin University, Tianjin 300072, P. R. China.
Abstract:
With the rapid development of the Internet of Things (IoT) and 5G technology, there has been a considerable increase in demand for self-powered and flexible sensors. However, existing solutions frequently prove inadequate regarding flexibility, energy efficiency, and the accuracy with which gestures can be recognized, particularly in noncontact operation scenarios. As a result, there is a need for innovative developments in sensor technology. This study proposes an artificial intelligence-based gesture recognition system comprising a triboelectric sensor ring, an Arduino signal processing module, and a deep learning module. Our approach enables the direct reading of triboelectric signals by Arduino through integrated circuits, thereby maintaining the output voltage of triboelectric signals within the input range of commonly used microcontrollers. The integration of triboelectric technology with sophisticated deep learning methodologies, notably the utilization of a one-dimensional convolutional neural network (CNN), has enabled the development of a system that exhibits an accuracy rate exceeding 95% in the recognition of 12 distinct gestures. This study demonstrates the prospective utility of triboelectric sensors in the realms of gesture recognition, wearable technology, and human-machine interaction.

