相关实验视频
Updated: Jul 16, 2025

07:09
Virtual Reality Experiments with Physiological Measures
Published on: August 29, 2018
12.8K
多感官输入对语音感知和生产使用沉浸式虚拟现实的影响
Ümit Daşdöğen1, Shaheen N Awan2, Pasquale Bottalico3
1Mount Sinai Health System, Department of Otolaryngology, New York, NY.
Journal of voice : official journal of the Voice Foundation
|September 22, 2023
概括
虚拟现实揭示了听觉,视觉和视听输入对语音感知和产生产生重大影响. 增加的感官输入和背景噪音改变了声响,努力和舒适度.
科学领域:
- 听觉感知和语音的生产.
- 人与计算机的互动.
- 声学中的虚拟现实应用.
背景情况:
- 感官输入对语音感知和发声的影响是复杂的.
- 沉浸式虚拟现实 (VR) 为研究这些影响提供了一个新的环境.
- 了解这些相互作用对于语音训练和治疗至关重要.
研究的目的:
- 研究听觉,视觉和综合视听输入对语音感知和产生的影响.
- 利用沉浸式虚拟现实技术来创建受控的感官环境.
- 量化自我感知声质的变化和客观声学措施.
主要方法:
- 31名健康参与者在沉浸式VR中经历了18种感官条件.
- 条件是不同的听觉 (反响) 和视觉 (音量) 刺激,有和没有背景噪音.
- 测量语音感知 (大声,努力,舒适) 和生产 (SPL,光谱时刻).
主要成果:
- 增加的房间音量,扬声器和听众之间的距离,视听输入和背景噪声导致自我感知的声音声音和精力更大,舒适度降低.
- 客观测量显示,声压水平 (SPL) 增加和光谱时刻在不同条件下波动.
- 感官输入,超出听觉线索,明显影响了声乐行为.
结论:
- 听觉,视觉和视听输入显著影响语音感知和制作.
- 这些发现推动了对声乐任务中的感官整合的科学理解.
- 虚拟现实为语音和语音训练提供了一个强大的平台,解决了泛化挑战.
相关概念视频
Auditory Perception
357
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...
357
Perception of Sound Waves
4.5K
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
4.5K
Perceiving Loudness, Pitch, and Location
233
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
233
Factors Affecting Perception
1.6K
Perception is influenced by perceptual set, context, motivation, and emotion. Perceptual set, or perceptual expectancy, refers to the tendency to perceive things in a particular way, influenced by previous experiences and expectations. This phenomenon affects the interpretation of stimuli, creating a set of mental tendencies and assumptions that impact sensory perceptions of sound, taste, touch, and sight.
An illustrative example of a perceptual set is the scenario where an airline pilot told...
An illustrative example of a perceptual set is the scenario where an airline pilot told...
1.6K
Perception
499
Perception is a fundamental psychological process that enables individuals to organize, interpret, and consciously experience sensory information. This process is crucial for understanding and interacting with the world around us. It includes both bottom-up and top-down processing, each playing a distinct role in how we perceive our environment.
Bottom-up processing begins at the sensory level, where receptors detect external environmental stimuli. These could include the tactile sensation of...
Bottom-up processing begins at the sensory level, where receptors detect external environmental stimuli. These could include the tactile sensation of...
499
Sensory Modalities
1.4K
Sensation typically is the process by which the sensory receptors and sense organs detect stimuli from the internal and external environment and transmit this information to the central nervous system for processing.
General senses refer to the broad category of sensory information detected by receptors in the body and can be further grouped into somatic and visceral senses. Somatic sensations include touch, pressure, temperature, and pain and are essential for navigating our environment and...
General senses refer to the broad category of sensory information detected by receptors in the body and can be further grouped into somatic and visceral senses. Somatic sensations include touch, pressure, temperature, and pain and are essential for navigating our environment and...
1.4K

