触摸Plot:将数据空间化为声音,使用触摸屏可访问性的感官替代
IEEE transactions on visualization and computer graphics
|November 3, 2023
概括
TACTUALPLOT使用声音帮助盲人探索触摸屏上的数据,为昂贵的触摸图形提供了动态和可访问的替代方案. 这种感官替代方法通过体现的认知增强了空间意识.
科学领域:
- 人与计算机的交互
- 可访问性技术 技术可访问性
- 数据可视化用于视障人士.
背景情况:
- 传统的数据可视化触摸图形是昂贵的,缺乏动态探索能力.
- 可刷新触觉显示器是昂贵的,大多数盲人无法使用.
- 现有的方法限制了盲人用户的交互式数据探索.
研究的目的:
- 引入TACTUALPLOT,一种新的感官替代技术,用于利用听觉反探索分散图.
- 在基于触摸的数据交互中利用体内认知来实现空间意识.
- 为盲人开发可扩展和可访问的数据探索方法.
主要方法:
- 开发了TACTUALPLOT,将触摸交互与触摸屏上的声音反相结合.
- 利用体现认知原则,让用户感知二维触摸位置和空间关系.
- 集成的多指互动和基于手移动速度的自适应采样区域.
- 通过与盲人合作者进行培养性设计会议来获取信息.
主要成果:
- TACTUALPLOT为散射图上的触摸交互提供了听觉反.
- 这项技术可以感知相对指的位置和图表特征.
- 评估TACTUALPLOT与传统的触摸图形在膨胀触摸纸上进行比较.
- 通过触摸和声音展示了一种可扩展的数据探索方法.
结论:
- TACTUALPLOT为静态触觉图形提供了一个可行的,动态的,可访问的替代方案.
- 通过结合触觉和声音的感官替代,增强了视力受损者对数据的探索.
- 该方法支持空间意识和可扩展的数据采样,以改善可访问性.
相关概念视频
01:33Somatosensation
36.7K
The somatosensory system relays sensory information from the skin, mucous membranes, limbs, and joints. Somatosensation is more familiarly known as the sense of touch. A typical somatosensory pathway includes three types of long neurons: primary, secondary, and tertiary. Primary neurons have cell bodies located near the spinal cord in groups of neurons called dorsal root ganglia. The sensory neurons of ganglia innervate designated areas of skin called dermatomes.
36.7K
01:31Hearing
52.4K
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
52.4K
01:23Design Example
332
The innovation of touch-tone telephony revolutionized the telecommunications industry by replacing the traditional rotary dial with a dual-tone multi-frequency (DTMF) signaling system. This system uses a matrix-style keypad with buttons arranged in four rows and three columns, creating 12 distinct signals each assigned to a pair of frequencies. Each button press results in a simultaneous generation of two sinusoidal tones – one from a low-frequency group (697 to 941 Hz) and one from a...
332
01:27Synesthesia
136
Synesthesia is a remarkable condition where stimulation of one sensory or cognitive pathway leads to automatic, involuntary experiences in a second sensory or cognitive pathway. People with synesthesia experience a blending or crossing of their senses, such as sight and sound, leading to cross-modal sensations. In this condition, the stimulation of one sense, such as hearing a number or musical note, triggers an experience of another sense, like sensing a specific color, taste, or smell. People...
136
01:17Auditory Perception
343
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...
343
01:14Design Example: Resistive Touchscreen
323
A device engineer plays a crucial role in designing user interfaces for mobile devices. One such interface is the resistive touchscreen, which fundamentally consists of two metallic layers: a flexible upper layer and a rigid lower layer, separated by a narrow gap. The high resistance between these two layers is a key characteristic of this design.
When a user touches the screen, the two layers make contact at a specific point known as the touchpoint. This contact reduces the resistance between...
When a user touches the screen, the two layers make contact at a specific point known as the touchpoint. This contact reduces the resistance between...
323