Related Experiment Video
Updated: Oct 10, 2025
08:15
Capturing Dynamic Finger Gesturing with High-resolution Surface Electromyography and Computer Vision
Published on: March 28, 2025
827
Human-Computer Interaction Using Manual Hand Gestures in Real Time
Mohammad Alsaffar1, Abdullah Alshammari1, Gharbi Alshammari1
1University of Ha'il, College of Computer Science and Engineering, Department of Computer Science and Information, Ha'il, Saudi Arabia.
Computational Intelligence and Neuroscience
|December 8, 2021
Summary
This study presents a real-time electronic system for recognizing twelve hand gestures, including rotations and scale changes. This technology aims to improve communication for individuals who are deaf or hard of hearing by connecting them to computers.
Area of Science:
- Human-Computer Interaction
- Computer Vision
- Assistive Technology
Background:
- Effective communication tools are crucial for individuals who are deaf or hard of hearing.
- Existing computer-mediated communication methods can be enhanced with intuitive interfaces.
- Real-time gesture recognition offers a promising avenue for novel human-computer interaction.
Purpose of the Study:
- To develop and describe an electronic system capable of recognizing twelve distinct manual gestures in real time.
- To enable seamless human-computer interaction through the interpretation of hand movements.
- To create a foundational technology for improved communication accessibility for the deaf and hard of hearing community.
Main Methods:
- Implementation of an electronic system utilizing an Analog Devices ADSP BF-533 Ez-Kit Lite evaluation card.
- Development of algorithms to recognize manual motions, including hand rotations, translations, and scale changes within the camera's view.
- Operation within a controlled environment with regulated lighting and background conditions for optimal performance.
Main Results:
- Successful real-time recognition of twelve different manual gestures was achieved.
- The system accommodates dynamic hand movements such as rotations, translations, and scale variations.
- A proposed final stage involves displaying an associated letter for each recognized gesture.
Conclusions:
- The developed electronic system demonstrates the feasibility of real-time, multi-gesture recognition.
- This technology has the potential to significantly enhance computer-based communication for individuals with hearing impairments.
- Further applications and integration into user-friendly interfaces are recommended for broader adoption.
