Modality Effects on Lexical Encoding and Memory Representations of Spoken Words

Area of Science:

• Cognitive Psychology
• Neuroscience
• Audiology

Background:

• Older adults with hearing loss often experience challenges with auditory processing.
• Understanding how different speech presentation modalities affect cognitive functions like memory is crucial for this population.

Purpose of the Study:

• To investigate how presentation modality (auditory-visual, auditory-only, visual-only) impacts lexical encoding and working memory in older adults with hearing impairment.
• To compare memory encoding and retrieval speeds across auditory-visual (AV), auditory-only (AO), and visual-only (VO) conditions.
• To determine if the early availability of speech information influences observed memory differences.

Main Methods:

• Two experiments were conducted: a memory-scanning task and a stimulus gating task.
• Participants included older adults (over 60) with mild to moderate sensorineural hearing loss.
• Lexical encoding speed, retrieval speed, and word identification were measured across AV, AO, and VO modalities.

Main Results:

• Significant differences in memory encoding and retrieval speeds were found across modalities, with AV being the fastest and VO the slowest.
• The speed advantage for AV and AO conditions was largely attributed to the time course of stimulus information.
• VO modality showed slower processing, potentially due to higher attentional demands and reduced information availability.

Conclusions:

• Speech presentation modality significantly affects lexical encoding and memory retrieval in older adults with hearing loss.
• Auditory-visual speech offers advantages due to earlier information availability and lower attentional load.
• Working memory for visual-only speech may be hindered by increased attentional demands and less information.