Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Properties of Fourier Transform I01:21

Properties of Fourier Transform I

225
The application of Fourier Transform properties in radio broadcasting is multifaceted, enabling significant advancements in the way signals are transmitted and received. Key areas where these properties are utilized include simultaneous multi-channel transmission, audio clip speed adjustments, live broadcast delays for different time zones, audio frequency adjustments, and signal demodulation.
In radio broadcasting, multiple audio signals often need to be transmitted simultaneously. The Fourier...
225
State Space to Transfer Function01:21

State Space to Transfer Function

295
The conversion of state-space representation to a transfer function is a fundamental process in system analysis. It provides a method for transitioning from a time-domain description to a frequency-domain representation, which is crucial for simplifying the analysis and design of control systems.
The transformation process begins with the state-space representation, characterized by the state equation and the output equation. These equations are typically represented as:
295
Network Function of a Circuit01:25

Network Function of a Circuit

361
Frequency response analysis in electrical circuits provides vital insights into a circuit's behavior as the frequency of the input signal changes. The transfer function, a mathematical tool, is instrumental in understanding this behavior. It defines the relationship between phasor output and input and comes in four types: voltage gain, current gain, transfer impedance, and transfer admittance. The critical components of the transfer function are the poles and zeros.
361
Transfer Function to State Space01:23

Transfer Function to State Space

391
State-space representation is a powerful tool for simulating physical systems on digital computers, necessitating the conversion of the transfer function into state-space form. Consider an nth-order linear differential equation with constant coefficients, like those encountered in an RLC circuit. The state variables are selected as the output and its n−1 derivatives. Differentiating these variables and substituting them back into the original equation produces the state equations.
In an...
391
Transfer Function in Control Systems01:21

Transfer Function in Control Systems

791
The transfer function is a fundamental concept in the analysis and design of linear time-invariant (LTI) systems. It offers a concise way to understand how a system responds to different inputs in the frequency domain. It serves as a bridge between the time-domain differential equations that describe system dynamics and the frequency-domain representation that facilitates easier manipulation and analysis.
To derive the transfer function, consider a general nth-order linear time-invariant...
791
Perceiving Loudness, Pitch, and Location01:21

Perceiving Loudness, Pitch, and Location

417
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
417

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Cochlear aging after synaptopathic noise: age-noise interactions in hair cell loss and axonal degeneration.

Hearing research·2026
Same author

Acoustic Scene-Aware Processing and Auditory Model-Based Compensation Strategies.

Journal of the Association for Research in Otolaryngology : JARO·2026
Same author

Using more realistic speech material to enhance ecological validity in the Everyday Conversational Danish Sentence Test.

The Journal of the Acoustical Society of America·2026
Same author

Phoneme Perception in Children With Bilateral Cochlear Implants or Hearing Aids in Quiet, Noise, and Reverberation.

Ear and hearing·2026
Same author

A comparison of hearing abilities in memory clinic patients with mild cognitive impairment and cognitively intact older adults.

Journal of Alzheimer's disease : JAD·2026
Same author

Investigating the impact of background noise on collaborative decision-making using an individual-weighted voting model.

Cognitive research: principles and implications·2026
Same journal

Detection, communication, and individual identification with deep audio embeddings: A case study with North Atlantic right whales.

PLoS computational biology·2026
Same journal

Exploring the structural lexicon of the Proteome via Metric Geometry.

PLoS computational biology·2026
Same journal

Linking retinal sampling in neural encoding models to temporal profiles of visual processing in humans.

PLoS computational biology·2026
Same journal

CAdir: Joint clustering of cells and genes for single-cell transcriptomics with visualization-driven cluster quality assessment.

PLoS computational biology·2026
Same journal

Systematic design of auxotrophic strains and media conditions to probe metabolic functions in E. coli.

PLoS computational biology·2026
Same journal

Neuronal excitability and parameter variability in the Hodgkin-Huxley model.

PLoS computational biology·2026
See all related articles

Related Experiment Video

Updated: Sep 4, 2025

Transmission of Multiple Signals through an Optical Fiber Using Wavefront Shaping
09:43

Transmission of Multiple Signals through an Optical Fiber Using Wavefront Shaping

Published on: March 20, 2017

10.0K

Modulation transfer functions for audiovisual speech.

Nicolai F Pedersen1, Torsten Dau1, Lars Kai Hansen2

  • 1Hearing Systems, Department of Health Technology, Technical University of Denmark, Kgs. Lyngby, Denmark.

Plos Computational Biology
|July 19, 2022
PubMed
Summary
This summary is machine-generated.

Audiovisual speech synchrony reveals distinct facial motion patterns linked to speech rhythm. Natural speech shows correlations between acoustic envelope fluctuations and both mouth (3-4 Hz) and head (1-2 Hz) movements, suggesting a motor basis for speech timing.

More Related Videos

Foreign Accent and Forensic Speaker Identification in Voice Lineups: The Influence of Acoustic Features Based on Prosody
09:09

Foreign Accent and Forensic Speaker Identification in Voice Lineups: The Influence of Acoustic Features Based on Prosody

Published on: September 27, 2024

522
A Protocol for Comprehensive Assessment of Bulbar Dysfunction in Amyotrophic Lateral Sclerosis ALS
12:43

A Protocol for Comprehensive Assessment of Bulbar Dysfunction in Amyotrophic Lateral Sclerosis ALS

Published on: February 21, 2011

34.9K

Related Experiment Videos

Last Updated: Sep 4, 2025

Transmission of Multiple Signals through an Optical Fiber Using Wavefront Shaping
09:43

Transmission of Multiple Signals through an Optical Fiber Using Wavefront Shaping

Published on: March 20, 2017

10.0K
Foreign Accent and Forensic Speaker Identification in Voice Lineups: The Influence of Acoustic Features Based on Prosody
09:09

Foreign Accent and Forensic Speaker Identification in Voice Lineups: The Influence of Acoustic Features Based on Prosody

Published on: September 27, 2024

522
A Protocol for Comprehensive Assessment of Bulbar Dysfunction in Amyotrophic Lateral Sclerosis ALS
12:43

A Protocol for Comprehensive Assessment of Bulbar Dysfunction in Amyotrophic Lateral Sclerosis ALS

Published on: February 21, 2011

34.9K

Area of Science:

  • Speech processing
  • Auditory-visual perception
  • Human-computer interaction

Background:

  • Temporal synchrony between facial movements and speech acoustics is crucial for audiovisual speech perception.
  • While low-frequency acoustic envelope fluctuations (below 10 Hz) correlate with facial motion, precise temporal relationships across different facial regions remain unclear.

Purpose of the Study:

  • To investigate the precise temporal scales of synchronization between speech envelope modulations and facial motion in natural audiovisual speech.
  • To identify distinct temporal patterns in facial movements corresponding to different speech rhythm scales.

Main Methods:

  • Utilized regularized canonical correlation analysis (rCCA) to model speech envelope filters.
  • Employed advanced video-based 3D facial landmark estimation on a large dataset (∼4000 speakers).
  • Learned modulation transfer functions (MTFs) to correlate speech envelope with facial motion across speakers.

Main Results:

  • Identified two distinct temporal scales of audiovisual speech synchrony: 3-4 Hz correlated with mouth movements and 1-2 Hz with global face/head motion.
  • These timescales emerged specifically in natural audiovisual speech statistics across many speakers.
  • Controlled speech tasks revealed only the 3-4 Hz modulations, suggesting slower rhythms are unique to natural speech.

Conclusions:

  • Natural audiovisual speech exhibits distinct temporal regularities at syllable (3-4 Hz) and phrase (1-2 Hz) timescales, linked to specific facial motion patterns.
  • The emergence of slower 1-2 Hz regularities only in crossmodal statistics suggests a potential motor origin for phrase-level speech timing.