Detecting physical abilities through smartphone sensors: an assistive technology application

Area of Science:

• Assistive technology research
• Human-computer interaction
• Rehabilitation engineering

Background:

• Promoting assistive technologies is crucial for improving the quality of life for individuals with disabilities.
• Existing assistive technologies often require specific hardware or complex interfaces.
• There is a need for accessible and personalized assistive technology recommendations.

Purpose of the Study:

• To propose the SmartAbility Android Application for recommending assistive technologies.
• To focus on actions that individuals with reduced physical abilities can perform independently.
• To leverage smartphone capabilities for personalized assistive technology suggestions.

Main Methods:

• Utilized Android built-in sensors (accelerometer, gyroscope) and application programming interfaces (APIs) to detect physical abilities.
• Developed a MySQL database to store assistive technologies and their mappings to user abilities.
• Employed the SmartAbility Framework, incorporating findings from feasibility trials and usability evaluations.

Main Results:

• The SmartAbility Application successfully detected user actions like head movements and speaking using smartphone sensors.
• Evaluations with 18 pupils from special educational needs schools indicated "Good Usability" via NASA Task Load Index and System Usability Scale.
• The application effectively maps assistive technologies to physical abilities for tailored recommendations.

Conclusions:

• Android device sensors and APIs can effectively detect user physical abilities for assistive technology recommendations.
• The SmartAbility Application provides a valuable tool for healthcare professionals in rehabilitation and for assistive technology providers.
• Future development includes an application tailored for the education sector, considering cognitive abilities.