Related Experiment Video
Updated: Aug 15, 2025

Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind
Published on: March 27, 2013
An Intelligent Multi-Floor Navigational System Based on Speech, Facial Recognition and Voice Broadcasting Using
Mahib Ullah1, Xingmei Li1, Muhammad Abul Hassan2
1School of Mechanical Engineering and Electronic Information, China University of Geosciences, Wuhan 430074, China.
This study introduces an adaptable indoor navigation system using robots, facial, and speech recognition for multi-story buildings. The novel approach achieved high accuracy, enhancing user experience in locating items like books in libraries.
Area of Science:
- Robotics and Human-Computer Interaction
- Artificial Intelligence and Machine Learning
- Ubiquitous Computing and Navigation Systems
Background:
- Modern technologies like the Internet of Things (IoT) and mobile devices are crucial for navigation in unfamiliar environments.
- Indoor navigation systems are essential for locating specific places within buildings.
- Existing systems benefit from mobile integration, increasing user acceptance and adoption.
Purpose of the Study:
- To present a novel, adaptable, and changeable multistory indoor navigation system.
- To implement the system in diverse environments such as libraries, grocery stores, shopping malls, and official buildings.
- To utilize facial and speech recognition with voice broadcasting for enhanced user interaction.
Main Methods:
- Development of an Android-based platform with separate administrative and robot-deployed applications.
- Integration of robots on each floor for inter-robot and user communication.
- Implementation of facial and speech recognition for user identification and interaction.
- Testing through system evaluation (accuracy of recognition) and user evaluation (usability and helpfulness).
Main Results:
- The proposed system achieved high accuracy rates of 97.92% and 97.88% for voice and face recognition tasks.
- User evaluation in multi-story libraries indicated high user satisfaction and perceived usefulness.
- Users found the robot assistance and automatic recognition features beneficial for navigation.
Conclusions:
- The developed indoor navigation system is effective and adaptable for various multi-story environments.
- The integration of robotics, AI-driven recognition, and mobile technology significantly improves indoor navigation experiences.
- The system demonstrates potential for widespread implementation in public and commercial spaces.
Related Concept Videos
Types of Global Positioning System Surveys
Design Example: Identifying the Locations of Monuments in the Field Using Global Positioning System Device
Introduction to Global Positioning System
Field Application of Global Positioning System
Multi-input and Multi-variable systems
In the absence...
One-Degree-of-Freedom System
A one-degree-of-freedom system is defined by an independent variable that determines its state and behavior. One example of a one-degree-of-freedom system is a simple harmonic oscillator, such as a...

