学习视觉到听觉感官替代揭示了图像到声音映射的灵活性
Asa Kucinkas1,2, Chrysa Retsa1,2, Peter B L Meijer3
1The Radiology Department, Lausanne University Hospital and University of Lausanne, Lausanne, Switzerland.
NPJ science of learning
|December 3, 2025
概括
结构化映射增强了视觉到听觉感官替代装置 (SSD) 的学习. 传统和反向空间映射都提高了对任意控制的性能,显示了SSD设计的灵活性.
科学领域:
- 神经科学是一个神经科学.
- 人与计算机的交互
- 感官科学 感官科学
背景情况:
- 视觉到听觉感官替代装置 (SSD) 将视觉信息转换为声音.
- vOICe系统将视觉像素映射到声音特征,如音调和时间.
- 现有的映射通常优先考虑视觉数据的技术保存,而不是直观的交叉模式对应.
研究的目的:
- 调查跨模式对应在SSD学习中的作用.
- 为了比较传统 (pitch-elevation,time-azimuth) 与反向 (pitch-azimuth,time-elevation) 空间映射的有效性.
- 用结构化映射与任意控制映射来评估学习.
主要方法:
- 60名有视力的成年人被随机分配到传统,反向或对照组.
- 参与者使用简化的刺激学习了视觉到听觉映射.
- 经过30分钟的培训时间后,评估了对新兴刺激的学习和识别.
主要成果:
- 传统和反向映射组都比控制组学习得快得多.
- 在传统和逆向组之间没有发现学习或表现的显著差异.
- 结构化的空间映射,无论具体的配置如何,都能帮助SSD学习.
结论:
- 通过结构化的空间映射来增强SSD学习的能力.
- 视觉空间信息对声学特征的映射似乎是灵活的,不受天生的跨模式对应的严格约束.
- 基于用户需求和特定应用程序,SSD可以定制.
相关概念视频
Neuroplasticity
1.5K
Neuroplasticity reflects the brain's remarkable capacity to adapt and evolve, responding dynamically to learning, experiences, or injury by reorganizing its neural circuitry. This reorganization involves creating new neural connections and refining old ones through a series of biological processes that contribute to the brain's lifelong development and adaptability.
1.5K
Auditory Pathway
7.0K
Auditory pathways constitute the complex neural circuits responsible for transmitting and interpreting auditory information from the peripheral auditory system to the brain. Sound waves are initially captured by the outer ear, funneled through the ear canal, and reach the tympanic membrane (eardrum). These vibrations are transmitted via the middle ear's ossicles to the inner ear's cochlea.
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking...
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking...
7.0K
Auditory Perception
998
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...
998
Perception of Sound Waves
5.4K
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
5.4K
Sensory Modalities
3.7K
Sensation typically is the process by which the sensory receptors and sense organs detect stimuli from the internal and external environment and transmit this information to the central nervous system for processing.
General senses refer to the broad category of sensory information detected by receptors in the body and can be further grouped into somatic and visceral senses. Somatic sensations include touch, pressure, temperature, and pain and are essential for navigating our environment and...
General senses refer to the broad category of sensory information detected by receptors in the body and can be further grouped into somatic and visceral senses. Somatic sensations include touch, pressure, temperature, and pain and are essential for navigating our environment and...
3.7K
Perceiving Loudness, Pitch, and Location
896
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
896


