Audio drawing and working memory in blindness: design, development and validation of a multi-sensory system

Working memory (WM) plays a crucial role in helping individuals perform everyday activities and interact with the external environment. However, despite valuable insights into visual memory mechanisms, the multi-sensory aspects of WM have not been thoroughly investigated, especially in congenitally blind individuals, primarily due to a lack of proper technologies. This work presents an audio-haptic system to study the generation and recall of multi-sensory spatial representations in visually impaired and sighted individuals. Precisely, we developed an audio-tactile tablet composed of a set of spatialized speakers covered by tactile sensors and tri-modal stimulations units providing acoustic, visual, and haptic feedback. Furthermore, we integrated these two systems among each other. Interestingly, visually impaired and sighted adults could easily interact with these devices. Technologies like the ones we developed might be suitable in experimental and clinical settings to study the influence of the different sensory modalities on high-level cognitive skills and the impact of early visual deprivation on such abilities for rehabilitative intervention since the first period of life.