Related Experiment Video
Updated: Jun 16, 2026
09:01
Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind
Published on: March 27, 2013
14.5K
Using Pupillometry in Virtual Reality as a Tool for Speech-in-Noise Research
Hidde Pielage1,2, Bethany Plain1,2, Sjors van de Ven1
1Amsterdam Universitair Medisch Centrum Location Vrije Universiteit Amsterdam, Otolaryngology-Head and Neck Surgery, Section Ear & Hearing, De Boelelaan 1117, Amsterdam 1081 HV, the Netherlands.
Ear and Hearing
|July 2, 2025
Summary
Virtual reality (VR) head-mounted displays (HMDs) show promise for speech perception research, as pupil measurements within HMDs effectively track listening effort. However, VR simulations need enhancement to effectively study the impact of virtual social presence on auditory perception.
Area of Science:
- Auditory perception research
- Virtual reality applications
- Human-computer interaction
Background:
- Virtual reality (VR) offers a promising environment to bridge the gap between laboratory speech perception studies and real-world listening scenarios.
- Investigating the efficacy of VR head-mounted displays (HMDs) for pupillometric measurements is crucial for advancing speech perception research.
- Understanding how task load and social presence influence listening effort in VR is essential for ecological validity.
Purpose of the Study:
- To evaluate the sensitivity of pupillometric measurements within a VR HMD to changes in listening effort during a speech-in-noise task.
- To assess the potential of VR to simulate the copresence of virtual individuals and its impact on speech perception.
- To determine if manipulating task load and virtual copresence affects physiological and subjective measures of listening effort.
Main Methods:
- Thirty-three participants completed a speech-in-noise task within a VR HMD, with pupil size measured.
- Task load was manipulated by varying the number of sentences to repeat (one vs. two).
- Virtual agents providing feedback or visual distractors were used to simulate copresence, with performance, pupil size, and subjective ratings assessed.
Main Results:
- Task load significantly influenced baseline pupil size, peak pupil dilation, and subjective effort and difficulty ratings.
- Manipulation of virtual copresence did not yield significant effects on any measured outcomes.
- Exploratory analysis suggested a potential link between positive feedback from virtual agents and increased baseline pupil size.
Conclusions:
- VR HMD pupillometry is sensitive to task-induced changes in arousal and listening effort, supporting its use in speech perception research.
- Current VR simulations may require further sophistication to effectively replicate the influence of social copresence on auditory perception.
- Future research should explore the impact of feedback within VR environments on listening effort and pupil responses.
Related Concept Videos
01:01Perception of Sound Waves
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same frequency...
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same frequency...
01:17Auditory Perception
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the cochlea, a...
01:21Perceiving Loudness, Pitch, and Location
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
01:24Facial Feedback Hypothesis
Charles Darwin proposed that facial expressions are an evolutionary adaptation for communication. He argued that these expressions are not influenced by culture but are universal across species. For example, a snarling expression with exposed teeth signals a threat in many animals, including humans. Darwin also suggested that displaying an emotion can intensify the feeling. Smiling, for example, could enhance one's sense of happiness. This idea laid the foundation for understanding the role of...