Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Perception of Sound Waves01:01

Perception of Sound Waves

4.5K
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
4.5K
Signal Flow Graphs01:18

Signal Flow Graphs

217
Signal-flow graphs offer a streamlined and intuitive approach to representing control systems, providing an alternative to traditional block diagrams. These graphs use branches to symbolize systems and nodes to represent signals, effectively illustrating the relationships and interactions within the system.
In a signal-flow graph, branches denote the system's transfer functions, while nodes represent the signals. The direction of signal flow is indicated by arrows, with the corresponding...
217
Perceiving Loudness, Pitch, and Location01:21

Perceiving Loudness, Pitch, and Location

211
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
211
Parallel Processing01:20

Parallel Processing

150
The brain processes sensory information rapidly due to parallel processing, which involves sending data across multiple neural pathways at the same time. This method allows the brain to manage various sensory qualities, such as shapes, colors, movements, and locations, all concurrently. For instance, when observing a forest landscape, the brain simultaneously processes the movement of leaves, the shapes of trees, the depth between them, and the various shades of green. This enables a quick and...
150

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

The visome: Using cognitive networks to examine lip-reading errors in English words.

The Journal of the Acoustical Society of America·2026
Same author

Network science in experimental psychology.

Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale·2025
Same author

Some challenges in using multilayer networks to bridge brain and mind.

Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale·2024
Same author

The Effect of the COVID Pandemic on Clinical Psychology Research: A Bibliometric Analysis.

Behavioral sciences (Basel, Switzerland)·2024
Same author

Cognitive modelling of concepts in the mental lexicon with multilayer networks: Insights, advancements, and future challenges.

Psychonomic bulletin & review·2024
Same author

Speech, Language, and Hearing in the 21st Century: A Bibliometric Review of <i>JSLHR</i> From 2001 to 2021.

Journal of speech, language, and hearing research : JSLHR·2023
Same journal

Invaders taking over-Mollusc faunal change in volcanic barrier lakes of the Albertine Rift biodiversity hotspot.

PloS one·2026
Same journal

AI-driven molecular diversification and ligand-based optimization of macitentan derivatives targeting VEGFR1 and endothelin signaling pathways.

PloS one·2026
Same journal

Performance patterns and records in the world aquatics masters championships: Where do the most frequently represented nations among the top-ten masters swimmers come from?

PloS one·2026
Same journal

Modeling diurnal Temperature-Rainfall relationships under multicollinearity using PLS-SEM: A case study of Ghana.

PloS one·2026
Same journal

Organizational culture, social capital, and emergency capacity in primary healthcare institutions: A cross-sectional structural equation modeling study comparing ordinary and older communities.

PloS one·2026
Same journal

Impact of kidney function on the metabolome in the general population.

PloS one·2026
See all related articles

Related Experiment Video

Updated: Jun 29, 2025

Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology
05:38

Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology

Published on: June 29, 2021

2.4K

Using network science to examine audio-visual speech perception with a multi-layer graph.

Michael S Vitevitch1, Lorin Lachs2

  • 1University of Kansas, Lawrence, KS, United States of America.

Plos One
|March 29, 2024
PubMed
Summary
This summary is machine-generated.

This study introduces the AV-net, a model for visual speech perception (lip-reading), showing how auditory and visual information interact to improve word recognition. The model aids in understanding lip-reading and developing assistive technologies.

More Related Videos

Using Eye Movements Recorded in the Visual World Paradigm to Explore the Online Processing of Spoken Language
09:27

Using Eye Movements Recorded in the Visual World Paradigm to Explore the Online Processing of Spoken Language

Published on: October 13, 2018

10.0K
Mapping Cortical Dynamics Using Simultaneous MEG/EEG and Anatomically-constrained Minimum-norm Estimates: an Auditory Attention Example
08:45

Mapping Cortical Dynamics Using Simultaneous MEG/EEG and Anatomically-constrained Minimum-norm Estimates: an Auditory Attention Example

Published on: October 24, 2012

14.7K

Related Experiment Videos

Last Updated: Jun 29, 2025

Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology
05:38

Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology

Published on: June 29, 2021

2.4K
Using Eye Movements Recorded in the Visual World Paradigm to Explore the Online Processing of Spoken Language
09:27

Using Eye Movements Recorded in the Visual World Paradigm to Explore the Online Processing of Spoken Language

Published on: October 13, 2018

10.0K
Mapping Cortical Dynamics Using Simultaneous MEG/EEG and Anatomically-constrained Minimum-norm Estimates: an Auditory Attention Example
08:45

Mapping Cortical Dynamics Using Simultaneous MEG/EEG and Anatomically-constrained Minimum-norm Estimates: an Auditory Attention Example

Published on: October 24, 2012

14.7K

Area of Science:

  • Cognitive Science
  • Computational Neuroscience
  • Speech Processing

Background:

  • Visual speech perception, or lip-reading, is crucial for understanding spoken language, especially in noisy environments.
  • Existing models often lack integration of phonological and visual speech information.
  • Understanding the interplay between auditory and visual cues is key to improving speech perception.

Purpose of the Study:

  • To develop and evaluate a multi-layer network (AV-net) simulating visual speech perception.
  • To compare the AV-net's performance with human lip-reading capabilities under various conditions.
  • To investigate the influence of phonological information on visual speech perception.

Main Methods:

  • Created a multi-layer AV-net with auditory and visual layers representing phonological and viseme information, respectively.
  • Conducted computer simulations of activation diffusion for word identification.
  • Compared simulation results with human performance in audio-visual, audio-only, and visual-only conditions.
  • Performed error analysis on human visual-only lip-reading data.

Main Results:

  • The AV-net demonstrated the integration of auditory and visual information for enhanced word identification.
  • Simulation results showed comparable performance to human participants in different presentation conditions.
  • Phonological information significantly influenced visual speech perception in the multi-layer network.

Conclusions:

  • The AV-net model provides insights into the mechanisms of visual speech perception.
  • Findings have implications for lip-reading training and the development of assistive technologies.
  • The study highlights the importance of integrating phonological and visual information for robust speech recognition.