Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Auditory Perception01:17

Auditory Perception

903
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...
903
Perception of Sound Waves01:01

Perception of Sound Waves

5.3K
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
5.3K
Perceiving Loudness, Pitch, and Location01:21

Perceiving Loudness, Pitch, and Location

823
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
823
Automatic Processing and Automatic Social Behavior01:28

Automatic Processing and Automatic Social Behavior

163
Automatic processing refers to the cognitive operations that occur without conscious intent or awareness, playing a fundamental role in shaping social cognition and behavior. These processes enable individuals to navigate complex social environments efficiently by relying on mental shortcuts and pre-existing knowledge structures known as schemas. One of the most influential mechanisms underlying automatic processing is priming, which subtly activates mental representations through exposure to...
163
Hearing01:31

Hearing

56.2K
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
56.2K
Prosopagnosia01:24

Prosopagnosia

610
Prosopagnosia, also known as face blindness, is the inability to recognize faces. In severe cases, individuals with prosopagnosia may not recognize close family members, including parents and spouses, by their faces. For instance, someone with prosopagnosia might walk past their child in a crowd, only realizing their mistake upon noticing their child's distinctive backpack or favorite jacket. Prosopagnosia specifically impairs facial recognition, while the recognition of other objects or...
610

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Conductive hearing loss and normal CT: a clinical perspective.

Neuroradiology·2026
Same author

Comparing Transverse Sinus Stenosis in Lateral Skull Base Cerebrospinal Fluid Leaks to Idiopathic Intracranial Hypertension.

Otology & neurotology : official publication of the American Otological Society, American Neurotology Society [and] European Academy of Otology and Neurotology·2025
Same author

Characterization of middle ear ossicular ligaments using photon counting detector CT.

European journal of radiology·2025
Same author

Imaging features of otosclerosis on photon counting detector CT: a retrospective case series and literature review.

Neuroradiology·2025
Same author

Asymmetric Insertion Depth May Hinder Academic Aptitude in Prelingual Cochlear Implant Children.

Otology & neurotology : official publication of the American Otological Society, American Neurotology Society [and] European Academy of Otology and Neurotology·2025
Same author

Carbon Dioxide (CO 2 ) Laser Glomus Tympanicum Resection: Hearing Outcomes and Recurrence Rates.

Otology & neurotology : official publication of the American Otological Society, American Neurotology Society [and] European Academy of Otology and Neurotology·2025
Same journal

Gender-Affirming Care in Otolaryngology: A State of the Art Review.

Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery·2026
Same journal

Caffeine Consumption and Rhinologic Symptom Severity.

Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery·2026
Same journal

Ethical Considerations in Using the Pernkopf Atlas in Otolaryngology Education Ethics in Practice: Point-Counterpoint.

Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery·2026
Same journal

Preoperative Neutrophil-to-Lymphocyte Ratio Predicts Recurrence in HPV-Associated Oropharyngeal Cancer After Transoral Robotic Surgery.

Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery·2026
Same journal

PEAK-II Trach: A Multi-Institutional Quality Improvement/Simulation Study Assessing Pediatric Emergency Readiness.

Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery·2026
Same journal

Clinical Features, Treatment, and Outcomes for Oropharyngeal Adenoid Cystic Carcinoma: A Systematic Review.

Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery·2026
See all related articles

Related Experiment Video

Updated: Dec 20, 2025

Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception
05:48

Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception

Published on: August 9, 2024

1.9K

Visual Speech Recognition: Improving Speech Perception in Noise through Artificial Intelligence.

Arun M Raghavan1, Noga Lipschitz2, Joseph T Breen2

  • 1University of Cincinnati College of Medicine, Cincinnati, Ohio, USA.

Otolaryngology--Head and Neck Surgery : Official Journal of American Academy of Otolaryngology-Head and Neck Surgery
|May 27, 2020
PubMed
Summary
This summary is machine-generated.

A visual speech recognition program (VSRP) significantly improved speech perception in noise for both normal-hearing and hearing-impaired individuals. The VSRP technology eliminated performance differences between the two groups in high-noise environments.

Keywords:
artificial intelligencecomputer visionhearing losslip readingspeech perceptionspeech-in-noisevisual speech recognition

More Related Videos

Asthma Detection Research Based on Voice Signal Processing and Machine Learning
04:04

Asthma Detection Research Based on Voice Signal Processing and Machine Learning

Published on: July 22, 2025

789
Author Spotlight: Addressing Technical and Subjective Challenges in Measuring Classroom Attention
06:37

Author Spotlight: Addressing Technical and Subjective Challenges in Measuring Classroom Attention

Published on: December 15, 2023

5.1K

Related Experiment Videos

Last Updated: Dec 20, 2025

Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception
05:48

Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception

Published on: August 9, 2024

1.9K
Asthma Detection Research Based on Voice Signal Processing and Machine Learning
04:04

Asthma Detection Research Based on Voice Signal Processing and Machine Learning

Published on: July 22, 2025

789
Author Spotlight: Addressing Technical and Subjective Challenges in Measuring Classroom Attention
06:37

Author Spotlight: Addressing Technical and Subjective Challenges in Measuring Classroom Attention

Published on: December 15, 2023

5.1K

Area of Science:

  • Audiology
  • Speech Science
  • Human-Computer Interaction

Background:

  • Speech perception in noise is challenging for individuals with hearing loss (IWHL).
  • Traditional hearing aids do not fully restore speech understanding in noisy environments.
  • Visual cues can aid speech perception, especially in adverse listening conditions.

Purpose of the Study:

  • To compare speech perception (SP) in noise between normal-hearing (NH) individuals and IWHL.
  • To evaluate the effectiveness of a visual speech recognition program (VSRP) in improving SP.
  • To determine if VSRP can mitigate the SP deficit experienced by IWHL.

Main Methods:

  • A prospective study involving 11 NH and 9 IWHL participants.
  • Speech-in-noise tests (Bamford-Kowal-Bench) were conducted with and without VSRP.
  • VSRP utilized real-time lip movement tracking and a neural network to display speech-text on a screen.

Main Results:

  • NH listeners significantly outperformed IWHL listeners in high-noise conditions without VSRP (38.7% vs 25.0%).
  • VSRP significantly improved SP for both NH (75.5%) and IWHL (70.4%) listeners in high noise.
  • With VSRP, no significant difference in SP was found between NH and IWHL listeners.

Conclusions:

  • Visual speech recognition programs can substantially enhance speech perception in challenging noise levels.
  • VSRP technology effectively bridges the speech perception gap between normal-hearing and hearing-impaired individuals.
  • VSRP represents a promising assistive technology for improving communication for individuals with hearing loss.