Related Experiment Video
Updated: Aug 19, 2025
11:54
Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface
Published on: May 8, 2021
4.6K
Audiovisual interaction with rate-varying signals.
1Volen Center for Complex Systems, Brandeis University, Waltham, MA, USA.
I-Perception
|December 5, 2022
Summary
Task-irrelevant sounds impact visual perception by altering how we process size and amplitude modulation rates. When auditory and visual stimuli change direction together, perception benefits little, but differs significantly when directions diverge.
Area of Science:
- Cognitive psychology
- Auditory perception
- Visual perception
Background:
- Task-irrelevant auditory stimuli can influence visual perception.
- Audiovisual interactions are complex and depend on stimulus properties.
Purpose of the Study:
- To investigate the limits of audiovisual interaction by modulating the second temporal derivative of visual size and auditory amplitude.
- To determine how shared or differing rate changes in visual and auditory stimuli affect perceptual performance.
Main Methods:
- Subjects judged the rate of size-modulating visual stimuli under different auditory conditions.
- The study analyzed stimulus-response confusion matrices to estimate perceptual similarity spaces.
- Visual stimuli with varying rates were presented with auditory stimuli whose second temporal derivatives also varied.
Main Results:
- Performance showed minimal benefit when visual and auditory stimuli shared the same directional modulation rate change.
- Perceptual performance decreased significantly when visual and auditory stimuli exhibited differing directions of rate change.
- The computational demands of the task may increase vulnerability to distracting auditory stimuli.
Conclusions:
- Audiovisual interactions are sensitive to the dynamic properties of both stimuli, particularly their rate of change.
- Divergent rate changes between auditory and visual stimuli disrupt perception more than congruent changes.
- Task complexity influences the impact of irrelevant auditory stimuli on visual perception.
Related Concept Videos
01:11Sampling Continuous Time Signal
324
In signal processing, a continuous-time signal can be sampled using an impulse-train sampling technique, followed by the zero-order hold method. Impulse-train sampling involves the use of a periodic impulse train, which consists of a series of delta functions spaced at regular intervals determined by the sampling period. When a continuous-time signal is multiplied by this impulse train, it generates impulses with amplitudes corresponding to the signal's values at the sampling points.
In the...
In the...
324
01:22Basic Continuous Time Signals
277
Basic continuous-time signals include the unit step function, unit impulse function, and unit ramp function, collectively referred to as singularity functions. Singularity functions are characterized by discontinuities or discontinuous derivatives.
The unit step function, denoted u(t), is zero for negative time values and one for positive time values, exhibiting a discontinuity at t=0. This function often represents abrupt changes, such as the step voltage introduced when turning a car's...
The unit step function, denoted u(t), is zero for negative time values and one for positive time values, exhibiting a discontinuity at t=0. This function often represents abrupt changes, such as the step voltage introduced when turning a car's...
277
01:17Auditory Perception
416
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...
416
01:21Perceiving Loudness, Pitch, and Location
380
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
380
01:01Perception of Sound Waves
4.6K
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
4.6K
01:10Reconstruction of Signal using Interpolation
295
Signal processing techniques are essential for accurately converting continuous signals to digital formats and vice versa. When a continuous signal is sampled with a period T, the resulting sampled signal exhibits replicas of the original spectrum in the frequency domain, spaced at intervals equal to the sampling frequency. To handle this sampled signal, a zero-order hold method can be applied, which creates a piecewise constant signal by retaining each sample's value until the next...
295