Related Experiment Video
Updated: Jul 30, 2026

Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind
Published on: March 27, 2013
IoT-powered wearable assist device for visually impaired
Lokesh S1, Sukesh P1, Tejaswini S1
1Department of Electronics and Communication Engineering, SRM Institute of Science and Technology, Kattankulathur, Chengalpattu, Tamilnadu, India.
Purpose:
The objective of this study is to develop and assess a wearable assistive device, enabled by the Internet of Things (IoT), that improves obstacle perception, mobility, and interaction with the environment for those with visual impairments. The technology amalgamates real-time object detection, facial recognition, and obstacle sensing into a unified framework to facilitate autonomous and secure navigation.
Materials And Methods:
An experimental design-and-build methodology was employed to create the prototype utilising an ESP32-CAM module, Arduino microcontroller, ultrasonic sensor, and text-to-speech feedback interface. Deep learning and machine learning algorithms-Support Vector Machine (SVM) for facial detection, ResNet-50 Convolutional Neural Network (CNN) for facial identification, and YOLOv4 for object detection-were employed to facilitate precise, low-latency performance. An evaluation of the system was performed under various environmental conditions utilising conventional criteria such as accuracy, precision, recall, and F1-score.
Results:
The implemented system attained a recognition accuracy surpassing 90% with negligible computational latency, making it appropriate for real-time applications. The hybrid SVM-YOLOv4 model exhibited a harmonious mix of precision and efficiency, facilitating dependable multi-object recognition under various environmental and lighting situations. The quantitative results confirm the strength and flexibility of the proposed wearable device for supportive purposes.
Conclusions:
The IoT-enabled wearable assistive technology demonstrates considerable promise to enhance mobility, environmental awareness, and independence in those with visual impairments. The device combines hardware sensors with advanced computer vision models, linking theoretical innovation to practical rehabilitative applications. Future endeavours will encompass extensive user validation to improve usability, accessibility, and user comfort. Consequences for rehabilitation: Wearable devices driven by IoT can enhance mobility and situational awareness for those with visual impairments. The incorporation of machine learning-derived feedback facilitates safer, autonomous navigation in fluctuating situations. The modular system architecture facilitates adaption for a wider range of assistive and rehabilitation applications. The research enhances the design of cost-effective, intelligent assistive technologies that align with rehabilitative objectives and the creation of inclusive technology.

