Related Experiment Video
Updated: Jan 13, 2026

Capturing Dynamic Finger Gesturing with High-resolution Surface Electromyography and Computer Vision
Published on: March 28, 2025
GECO: A Real-Time Computer Vision-Assisted Gesture Controller for Advanced IoT Home System
Murilo C Lopes1, Paula A Silva2, Ludwing Marenco3,4
1Inatel Competence Center (ICC), National Institute of Telecommunications, João de Camargo Avenue 510, P.O. Box 05, Santa Rita do Sapucaí 37540-000, MG, Brazil.
None:
This paper introduces GECO, a real-time, computer vision-assisted gesture controller for IoT-based smart home systems. The platform uses a markerless MediaPipe interface that combines gesture-driven navigation and command execution, enabling intuitive control of multiple domestic devices. The system integrates binary and analog gestures, such as continuous light dimming based on thumb-index angles, while operating on-device through a private MQTT network. Technical evaluations across multiple Android devices have demonstrated ultra-low latency times (<50 ms), enabling real-time responsiveness. A user experience study with seventeen participants reported high intuitiveness (9.5/10), gesture accuracy (9.2/10), and perceived inclusivity, mainly for individuals with speech impairments and low technological literacy. These results position GECO as a lightweight, accessible, and privacy-preserving interaction framework, advancing the integration of artificial intelligence and IoT within smart home environments.
More Related Videos
Related Concept Videos
PI Controller: Design
One-Degree-of-Freedom System
A one-degree-of-freedom system is defined by an independent variable that determines its state and behavior. One example of a one-degree-of-freedom system is a simple harmonic oscillator, such as a...
Design Example: Resistive Touchscreen
When a user touches the screen, the two layers make contact at a specific point known as the touchpoint. This contact reduces the resistance between...
Control Systems
At the heart...
PD Controller: Design
Designing a continuous-data controller requires selecting and linking components like adders and integrators, which are fundamental in Proportional,...

