Related Experiment Video
Updated: Jul 24, 2026

fMRI Validation of fNIRS Measurements During a Naturalistic Task
Published on: June 15, 2015
Brain activation patterns in normal hearing adults: An fNIRS Study using an adapted clinical speech comprehension
András Bálint1, Wilhelm Wimmer2, Marco Caversaccio1
1Hearing Research Laboratory, ARTORG Center for Biomedical Engineering Research, University of Bern 3008 Bern, Switzerland; Department of ENT - Head and Neck Surgery, Inselspital, Bern University Hospital, University of Bern 3010 Bern, Switzerland.
This study shows how the brain processes auditory and visual speech using functional near-infrared spectroscopy (fNIRS). Findings support using audiovisual speech tasks for hearing research and interventions.
Area of Science:
- Neuroscience
- Auditory and Visual Speech Perception
- Brain Imaging Techniques
Background:
- Understanding speech processing is crucial for hearing impairment interventions.
- Functional near-infrared spectroscopy (fNIRS) is suitable for measuring brain activity during language tasks.
- Validated stimuli and behavioral measures are necessary for accurate fNIRS data interpretation.
Purpose of the Study:
- To investigate brain processing of auditory and visual speech in adults with normal hearing.
- To assess the applicability of a clinically inspired audiovisual speech-comprehension task.
- To establish a baseline for visual cue processing during lipreading.
Main Methods:
- Twenty-six adults with normal hearing underwent fNIRS to measure brain activation.
- Participants listened to sentences in quiet, noise, audiovisual, or visual-only (lipreading) conditions.
- Hearing tests, questionnaires, comprehension questions, and listening effort ratings were collected.
Main Results:
- Auditory speech activated temporal regions; visual speech activated the occipital area.
- Audiovisual speech activated both temporal and occipital regions.
- Increased prefrontal cortex activity was observed in noise conditions, correlating with higher listening effort.
Conclusions:
- The study demonstrated the utility of an audiovisual speech-comprehension task in participants with normal hearing.
- fNIRS effectively measured brain activation patterns during various speech modalities.
- Objective and behavioral data supported and complemented the fNIRS findings.
More Related Videos
10:07Using Fiberless, Wearable fNIRS to Monitor Brain Activity in Real-world Cognitive Tasks
Published on: December 2, 2015
08:10Neuroimaging Field Methods Using Functional Near Infrared Spectroscopy NIRS Neuroimaging to Study Global Child Development: Rural Sub-Saharan Africa
Published on: February 2, 2018