视障人士通过多模式反学习虚拟纹理,结合振动和语音
概括
这项研究引入了虚拟纹理学习的多式联络反系统,使盲人和视障人士能够通过振动和音频线索来感知纹理. 该系统通过将触觉感觉与纹理属性联系起来来增强对象认知.
科学领域:
- 人与计算机的交互
- 触觉学是指触觉学,是指触觉学.
- 虚拟现实 虚拟现实 虚拟现实
背景情况:
- 现有的虚拟纹理的触觉染方法是盲人和视力受损者 (BVI) 不能使用的.
- 有效的虚拟纹理感知对于对象认知至关重要,特别是对于BVI个人来说.
- 多模式反系统可以弥合虚拟环境中的感觉差距.
研究的目的:
- 为BVI个人开发和评估一个虚拟纹理学习系统.
- 通过交互式虚拟纹理体验,增强BVI用户的对象认知.
- 创建一个系统,将视觉纹理信息转化为可感知的触觉和听觉反.
主要方法:
- 开发了一个基于Informer的触觉染模型,从纹理图像和动作数据生成振动加速 (VA) 信号.
- 实施了一种使用生成的VA信号的纹理分类方法.
- 集成的音频反向用户广播分类的纹理属性 (类型,材料).
- 进行了用户实验,以比较染模型,并评估不同学习模式中的纹理匹配精度.
主要成果:
- 拟议的染模型准确有效地产生VA信号,提供现实的振动反.
- 该系统成功地使BVI用户能够通过振动和听觉线索来感知虚拟纹理属性.
- 用户实验证明了该系统在增强纹理感知和匹配准确性方面的有效性.
结论:
- 开发的多式联络系统显著改善了BVI个人对虚拟纹理的学习.
- 基于Informer的触觉染模型提供了一种创新的方法来产生有效的触觉反.
- 这项技术有可能通过虚拟体验来增强BVI用户的对象识别和认知能力.
相关概念视频
Sensory Modalities
1.1K
Sensation typically is the process by which the sensory receptors and sense organs detect stimuli from the internal and external environment and transmit this information to the central nervous system for processing.
General senses refer to the broad category of sensory information detected by receptors in the body and can be further grouped into somatic and visceral senses. Somatic sensations include touch, pressure, temperature, and pain and are essential for navigating our environment and...
General senses refer to the broad category of sensory information detected by receptors in the body and can be further grouped into somatic and visceral senses. Somatic sensations include touch, pressure, temperature, and pain and are essential for navigating our environment and...
1.1K
Tactile and Chemical Senses
273
Tactile senses encompass touch, temperature, and pain, each mediated by specific receptors. Touch receptors detect mechanical energy or pressure against the skin. Sensory fibers from these receptors enter the spinal cord and relay information to the brain stem. Here, most fibers cross over to the opposite side of the brain. The touch information then moves to the thalamus, which projects a map of the body's surface onto the somatosensory areas of the parietal lobes in the cerebral cortex.
273
Learning Disabilities
81
Learning disabilities are cognitive disorders caused by neurological impairments that affect cognitive functions like language and reading, without indicating overall intellectual or developmental challenges. These disabilities differ from global intellectual or developmental disabilities as they are limited to distinct cognitive functions. Common learning disabilities include dysgraphia, dyslexia, and dyscalculia, each of which impacts unique aspects of learning.
Dyslexia
Dyslexia is a...
Dyslexia
Dyslexia is a...
81
Design Example: Resistive Touchscreen
271
A device engineer plays a crucial role in designing user interfaces for mobile devices. One such interface is the resistive touchscreen, which fundamentally consists of two metallic layers: a flexible upper layer and a rigid lower layer, separated by a narrow gap. The high resistance between these two layers is a key characteristic of this design.
When a user touches the screen, the two layers make contact at a specific point known as the touchpoint. This contact reduces the resistance between...
When a user touches the screen, the two layers make contact at a specific point known as the touchpoint. This contact reduces the resistance between...
271
Auditory Perception
306
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...
306
Perception of Sound Waves
4.4K
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
4.4K


