音与触摸交叉调音匹配用于短声的短声
IEEE transactions on haptics
|December 1, 2023
概括
这项研究建立了声音和触摸之间的交叉模式映射,将音频强度光谱转换为触觉振动频率,以增强用户体验. 它揭示了这些感官之间的光谱匹配的一般规则.
科学领域:
- 交叉模式感知研究研究.
- 听觉和触觉感官科学是听觉和触觉的科学.
- 人与计算机的互动.
背景情况:
- 音频到触摸的转换增强了各种应用程序中的用户体验.
- 了解交叉模式的一致性是有效的感官替代的关键.
研究的目的:
- 建立声响频谱和触觉振动频率之间的功能关系.
- 开发一个可通用的声触交叉模式音调映射功能.
- 探索听觉和触觉刺激之间的光谱匹配规则.
主要方法:
- 合成单频振幅调制振动以匹配声音强度和时间特征.
- 评估175个不同频率的声音振动对的交叉模拟一致性.
- 使用数据集,估计从声响频谱到和振动频率的映射函数.
主要成果:
- 估计了一种功能关系,将声音强度光谱映射到最佳的触觉音调 (振动频率).
- 交叉验证证实了开发的声音到触摸交叉模式音调映射功能的可靠性.
- 这项研究提供了声音和触觉之间的光谱匹配的第一个一般规则.
结论:
- 该研究成功创建了一种方法,用于将声音特征映射到触觉感受.
- 这些发现有助于设计更直观和一致的多感官用户体验.
- 这项工作开创了可概括的听觉和触觉领域之间的光谱对应的探索.
相关概念视频
Perceiving Loudness, Pitch, and Location
217
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
217
Perception of Sound Waves
4.5K
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
4.5K
Hearing
52.4K
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
52.4K
The Cochlea
45.1K
The cochlea is a coiled structure in the inner ear that contains hair cells—the sensory receptors of the auditory system. Sound waves are transmitted to the cochlea by small bones attached to the eardrum called the ossicles, which vibrate the oval window that leads to the inner ear. This causes fluid in the chambers of the cochlea to move, vibrating the basilar membrane.
45.1K
Echo
514
The human ear cannot distinguish between two sources of sound if they happen to reach within a specific time interval, typically 0.1 seconds apart. More than this, and they are perceived as separate sources.
Imagine the sound is reflected back to the ears. Assuming that the source is very close to the human, the difference between hearing the two sounds—the emitted sound and the reflected sound—may be more than the minimum time for perceiving distinct sounds. If this is the case,...
Imagine the sound is reflected back to the ears. Assuming that the source is very close to the human, the difference between hearing the two sounds—the emitted sound and the reflected sound—may be more than the minimum time for perceiving distinct sounds. If this is the case,...
514
Sound Intensity Level
4.2K
Humans perceive sound by hearing. The human ear helps sound waves reach the brain, which then interprets the waves and creates the perception of hearing. The loudness of the environment in which a person is located determines whether they can distinguish between different sound sources.
The human ear can perceive an extensive range of sound intensity, necessitating the use of the logarithmic scale to define a physical quantity—the intensity level. It is a ratio of two intensities and...
The human ear can perceive an extensive range of sound intensity, necessitating the use of the logarithmic scale to define a physical quantity—the intensity level. It is a ratio of two intensities and...
4.2K


