Related Experiment Video
Updated: Mar 29, 2026
07:36
Eye Tracking During Visually Situated Language Comprehension: Flexibility and Limitations in Uncovering Visual Context Effects
Published on: November 30, 2018
16.6K
Semantic congruency but not temporal synchrony enhances long-term memory performance for audio-visual scenes
Hauke S Meyerhoff1, Markus Huff2
1Leibniz-Institut für Wissensmedien, Tübingen, Germany. h.meyerhoff@iwm-kmrc.de.
Memory & Cognition
|December 2, 2015
Summary
Adding sound to visual scenes improves long-term memory, especially when audio and visual information match semantically. Memory remains strong even with some timing differences, showing audio-visual integration
Area of Science:
- Cognitive Psychology
- Neuroscience
- Human Memory Research
Background:
- Human long-term memory for visual information is extensive.
- The role of auditory information in memory for realistic scenes is not fully understood.
Purpose of the Study:
- To investigate how auditory information impacts long-term memory for visual scenes.
- To examine the effects of semantic congruency and temporal synchrony between audio and visual stimuli on memory.
Main Methods:
- Six experiments were conducted using brief filmic clips.
- Presentation modalities included auditory, visual, and audio-visual.
- Semantic congruency and temporal synchrony between audio and visual information were manipulated.
Main Results:
- Audio-visual clips generally led to more accurate memory recall than unimodal clips.
- Memory performance improved with congruent audio-visual information.
- Memory was robust to violations of audio-visual synchrony and sequential presentation, but declined with separated audio-visual tracks.
Conclusions:
- Audio-visual integration enhances memory for scenes, particularly when semantic congruency is present.
- Memory integration is sensitive to semantic content but resilient to modality-specific timing discrepancies.
- These findings highlight the brain's capacity to integrate multisensory information for robust memory formation.
Related Concept Videos
01:22Chunking and Rehearsal in Sensory Memory
733
Improving short-term memory can be achieved through techniques like chunking and rehearsal. Chunking involves organizing information into larger, more manageable units. This technique is particularly useful for information that exceeds the typical memory span of between five and nine items. For instance, logging into an online account with a password like "ta89vq0179gz" involves grouping letters and numbers into three chunks—ta89, vq01, and 79gz. It makes large amounts of...
733
01:30Impact of Schemas
288
Schemas are cognitive structures that provide a framework for interpreting and organizing social information. They help individuals navigate complex environments by offering expectations about people, events, and behaviors. Schemas influence attention, encoding, and retrieval processes, thereby shaping the entire trajectory of information processing in social contexts.Attention and Cognitive LoadDuring initial attention, schemas function as filters that prioritize schema-consistent information,...
288
01:18Long-Term Memory
855
Long-term memory is a relatively permanent type of memory, capable of storing vast amounts of information over extended periods. Its storage capacity is generally considered unlimited.
Long-term memory can be categorized into two primary types: explicit and implicit memory. Explicit memory, also known as declarative memory, involves the conscious recollection of information that we deliberately try to remember, recall, and articulate. This type of memory encompasses specific facts, events, and...
Long-term memory can be categorized into two primary types: explicit and implicit memory. Explicit memory, also known as declarative memory, involves the conscious recollection of information that we deliberately try to remember, recall, and articulate. This type of memory encompasses specific facts, events, and...
855
01:26Higher Mental Functions of Brain: Learning and Memory
2.3K
Memory is one of the most vital higher mental functions of the brain. Memory is closely related to learning because it enables us to retain information and experiences from our past to use them in our present life. It also helps us to remember facts, events, and skills, such as riding a bike or swimming. There are two types of memory — declarative memory, which involves memorizing facts or events, and procedural memory, which enables us to remember how to do something like writing or...
2.3K
01:07Elaborative Rehearsals
503
Elaborative rehearsal is a crucial cognitive strategy that strengthens information encoding in long-term memory by making meaningful connections between new data and pre-existing knowledge. This approach contrasts with maintenance rehearsal, which involves simple repetition without delving into the significance of the information. While maintenance rehearsal might temporarily keep information active in short-term memory, it is less effective for long-term retention.
The effectiveness of...
The effectiveness of...
503
01:23System of Memory
7.9K
Memory is categorized into three major systems: sensory memory, short-term memory (STM), and long-term memory (LTM). These systems differ in their capacity and the duration for which they can hold information. Sensory memory captures raw sensory input from the environment, holding it for just a few seconds or less. For example, on hearing a brief, loud sound, like a car horn honking, the sound seems to linger in the mind for a moment even after it stops. This is an instance of sensory memory...
7.9K