AUDIS wear: a smartwatch based assistive device for ubiquitous awareness of environmental sounds

A multitude of assistive devices is available for deaf people (i.e. deaf, deafened, and hard of hearing). Besides hearing and communication aids, devices to access environmental sounds are available commercially. But the devices have two major drawbacks: 1. they are targeted at indoor environments (e.g. home or work), and 2. only specific events are supported (e.g. the doorbell or telephone). Recent research shows that important sounds can occur in all contexts and that the interests in sounds are diverse. These drawbacks can be tackled by using modern information and communication technology that enables the development of new and improved assistive devices. The smartwatch, a new computing platform in the form of a wristwatch, offers new potential for assistive technology. Its design promises a perfect integration into various different social contexts and thus blends perfectly into the user's life. Based on a smartwatch and algorithms from pattern recognition, a prototype for awareness of environmental sounds is presented here. It observes the acoustic environment of the user and detects environmental sounds. A vibration is triggered when a sound is detected and the type of sound is shown on the display. The design of the prototype was discussed with deaf people in semi-structured interviews, leading to a set of implications for the design of such a device.