跨模态感知结合中的时间连贯性:对实时多感官语音识别算法设计的含义
Yonghee Oh1,2, Emily Keller1, Audie Gilchrist1
1Department of Otolaryngology-Head and Neck Surgery and Communicative Disorders, 5170University of Louisville, Louisville, KY 40202, USA.
Multisensory research
|October 30, 2025
概括
这项研究量化了在我们注意到之前,感官输入的时间可以脱离同步. 调查结果揭示了多传感器集成的时间限制,这对于实时处理和辅助设备至关重要.
科学领域:
- 神经科学是一个神经科学.
- 心理学 心理学 心理学
- 人与计算机的交互
背景情况:
- 多感官信息增强了感知,特别是在杂的环境中.
- 了解时间异步是实时多感官处理的关键.
- 以前的研究强调了整合听觉,视觉和触觉刺激的好处.
研究的目的:
- 量化时间异步的平均极限,用于多感官刺激的感知整合.
- 确定时间绑定窗口 (TBW) 和主观同时性点 (PSS) 在听觉视觉,听觉触觉和视觉触觉模式.
- 评估这些时间判断的可靠性.
主要方法:
- 20名成年人通过三种感官模式对100毫秒刺激进行了同时性判断任务.
- 每周在三个单独的测试中验证测试重复测试的可靠性.
- 分析的重点是计算时间绑定窗口 (TBW) 和主观同时性点 (PSS).
主要成果:
- 平均TBW为389 ms (AV),324 ms (AT) 和299 ms (VT) 的时间.
- 平均PSS转移为105毫秒 (AV,向视觉),16毫秒 (AT,向触觉) 和77毫秒 (VT,向视觉).
- 测试复试可靠性在TBW的50毫秒以下,在PSS的30毫秒以下.
结论:
- 结果确定了实时多传感器处理的最小时间延迟.
- 结果为开发先进的多感应辅助设备提供了时间参数.
- 这项研究推动了我们对跨模式时间整合极限的理解.
相关概念视频
01:22Chunking and Rehearsal in Sensory Memory
551
Improving short-term memory can be achieved through techniques like chunking and rehearsal. Chunking involves organizing information into larger, more manageable units. This technique is particularly useful for information that exceeds the typical memory span of between five and nine items. For instance, logging into an online account with a password like "ta89vq0179gz" involves grouping letters and numbers into three chunks—ta89, vq01, and 79gz. It makes large amounts of...
551
01:17Auditory Perception
1.0K
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...
1.0K
01:01Perception of Sound Waves
5.4K
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
5.4K
01:21Perceiving Loudness, Pitch, and Location
921
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
921