Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Sampling Continuous Time Signal

Sampling Continuous Time Signal

In signal processing, a continuous-time signal can be sampled using an impulse-train sampling technique, followed by the zero-order hold method. Impulse-train sampling involves the use of a periodic impulse train, which consists of a series of delta functions spaced at regular intervals determined by the sampling period. When a continuous-time signal is multiplied by this impulse train, it generates impulses with amplitudes corresponding to the signal's values at the sampling points.
In the...

Basic Continuous Time Signals

Basic Continuous Time Signals

Basic continuous-time signals include the unit step function, unit impulse function, and unit ramp function, collectively referred to as singularity functions. Singularity functions are characterized by discontinuities or discontinuous derivatives.
The unit step function, denoted u(t), is zero for negative time values and one for positive time values, exhibiting a discontinuity at t=0. This function often represents abrupt changes, such as the step voltage introduced when turning a car's...

Auditory Perception

Auditory Perception

The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...

Perceiving Loudness, Pitch, and Location

Perceiving Loudness, Pitch, and Location

The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...

Perception of Sound Waves

Perception of Sound Waves

The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...

Reconstruction of Signal using Interpolation

Reconstruction of Signal using Interpolation

Signal processing techniques are essential for accurately converting continuous signals to digital formats and vice versa. When a continuous signal is sampled with a period T, the resulting sampled signal exhibits replicas of the original spectrum in the frequency domain, spaced at intervals equal to the sampling frequency. To handle this sampled signal, a zero-order hold method can be applied, which creates a piecewise constant signal by retaining each sample's value until the next...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Visual short-term memory, culture, and image structure.

Attention, perception & psychophysics·2025

Same author

Keep your finger on the pulse: Better rate perception and gap detection with vibrotactile compared to visual stimuli.

Attention, perception & psychophysics·2023

Same author

Costs and benefits of audiovisual interactions.

Perception·2022

Same author

Decision-Making and Multisensory Combination Under Time Stress.

Perception·2021

Search research articles

Related Experiment Video

Updated: Aug 19, 2025

Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface

Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface

Published on: May 8, 2021

Audiovisual interaction with rate-varying signals.

Long Yi¹, Robert Sekuler¹

¹Volen Center for Complex Systems, Brandeis University, Waltham, MA, USA.

|December 5, 2022

Summary

Task-irrelevant sounds impact visual perception by altering how we process size and amplitude modulation rates. When auditory and visual stimuli change direction together, perception benefits little, but differs significantly when directions diverge.

Keywords:

audiovisual interaction confusion matrix rate perception similarity space temporal correlation

More Related Videos

A Method for Tracking the Time Evolution of Steady-State Evoked Potentials

A Method for Tracking the Time Evolution of Steady-State Evoked Potentials

Published on: May 25, 2019

A Two-interval Forced-choice Task for Multisensory Comparisons

A Two-interval Forced-choice Task for Multisensory Comparisons

Published on: November 9, 2018

Related Experiment Videos

Last Updated: Aug 19, 2025

Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface

Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface

Published on: May 8, 2021

A Method for Tracking the Time Evolution of Steady-State Evoked Potentials

A Method for Tracking the Time Evolution of Steady-State Evoked Potentials

Published on: May 25, 2019

A Two-interval Forced-choice Task for Multisensory Comparisons

A Two-interval Forced-choice Task for Multisensory Comparisons

Published on: November 9, 2018

Area of Science:

Cognitive psychology
Auditory perception
Visual perception

Background:

Task-irrelevant auditory stimuli can influence visual perception.
Audiovisual interactions are complex and depend on stimulus properties.

Purpose of the Study:

To investigate the limits of audiovisual interaction by modulating the second temporal derivative of visual size and auditory amplitude.
To determine how shared or differing rate changes in visual and auditory stimuli affect perceptual performance.

Main Methods:

Subjects judged the rate of size-modulating visual stimuli under different auditory conditions.
The study analyzed stimulus-response confusion matrices to estimate perceptual similarity spaces.
Visual stimuli with varying rates were presented with auditory stimuli whose second temporal derivatives also varied.

Main Results:

Performance showed minimal benefit when visual and auditory stimuli shared the same directional modulation rate change.
Perceptual performance decreased significantly when visual and auditory stimuli exhibited differing directions of rate change.
The computational demands of the task may increase vulnerability to distracting auditory stimuli.

Conclusions:

Audiovisual interactions are sensitive to the dynamic properties of both stimuli, particularly their rate of change.
Divergent rate changes between auditory and visual stimuli disrupt perception more than congruent changes.
Task complexity influences the impact of irrelevant auditory stimuli on visual perception.