Related Experiment Video
Updated: May 25, 2026

A Two-interval Forced-choice Task for Multisensory Comparisons
Published on: November 9, 2018
Comparing perceived auditory width to the visual image of a performing ensemble in contrasting bi-modal environments
Daniel L Valente1, Jonas Braasch, Shane A Myrbeck
1Communication Acoustics and Aural Architectural Research Laboratory, School of Architecture, Rensselaer Polytechnic Institute, 110 8th Street, Troy, New York 12180, USA. daniel.valente@boystown.org
Abstract:
Despite many studies investigating auditory spatial impressions in rooms, few have addressed the impact of simultaneous visual cues on localization and the perception of spaciousness. The current research presents an immersive audiovisual environment in which participants were instructed to make auditory width judgments in dynamic bi-modal settings. The results of these psychophysical tests suggest the importance of congruent audio visual presentation to the ecological interpretation of an auditory scene. Supporting data were accumulated in five rooms of ascending volumes and varying reverberation times. Participants were given an audiovisual matching test in which they were instructed to pan the auditory width of a performing ensemble to a varying set of audio and visual cues in rooms. Results show that both auditory and visual factors affect the collected responses and that the two sensory modalities coincide in distinct interactions. The greatest differences between the panned audio stimuli given a fixed visual width were found in the physical space with the largest volume and the greatest source distance. These results suggest, in this specific instance, a predominance of auditory cues in the spatial analysis of the bi-modal scene.
Related Concept Videos
Auditory Perception
Perception of Sound Waves
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same frequency...
Perceiving Loudness, Pitch, and Location
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
Hearing
Factors Affecting Perception
An illustrative example of a perceptual set is the scenario where an airline pilot told...
The Cochlea

