Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Auditory Perception

Auditory Perception

The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...

Visual System

Visual System

Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...

Gestalt Principles of Perception

Gestalt Principles of Perception

Gestalt principles provide a framework for understanding how humans perceive objects as unified wholes within their context. These principles are essential in explaining the cognitive processes that make sense of complex visual stimuli by organizing them into coherent groups. One fundamental principle is proximity, which posits that objects located close to each other are perceived as a collective group. For instance, when dots are positioned near one another, the visual system interprets them...

Structuralism

Structuralism

Structuralism, an early psychological theory developed by Wilhelm Wundt and his student Edward Bradford Titchener, sought to dissect the human mind into its most fundamental components. Wundt's groundbreaking work in his laboratory set the stage for Titchener to define structuralism's goal as cataloging the "atoms" of the mind—sensations, images, and feelings—akin to how chemists identify elements of matter.
Titchener's approach to structuralism was unique. He...

Perception of Sound Waves

Perception of Sound Waves

The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...

Metacognition

Metacognition

Metacognition is a conscious process where individuals are aware of their cognitive and executive processes, such as planning before solving a problem or self-monitoring during reading. For instance, a writer may need help with composing a piece. The situation involves a writer who is working on a piece of writing, but while doing so, they realize that something is missing. They notice that their characters lack depth or details. This realization occurs because the writer is reflecting on their...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

The properties of panels in global comics: frequency and size of 76 K panels in 1,030 comics from 144 countries.

Language resources and evaluation·2026

Same author

Neural dynamics of narrative structure-building in visual stories.

Cortex; a journal devoted to the study of the nervous system and behavior·2026

Same author

Three monkeys or one?: Continuity in the monkey emoji debate.

Acta psychologica·2026

Same author

Whoosh! visual depictions of direction, speed, and temporality: a corpus analysis of motion events in global comics.

Multimodal communication·2025

Same author

The Present and Future of Parallel Architectures of Language and Cognition.

Topics in cognitive science·2025

Same author

Understanding lightbulb moments: Meaning-making in visual morphology from comics and emoji.

Memory & cognition·2025

Search research articles

Related Experiment Video

Updated: Jul 23, 2025

Eye Tracking During Visually Situated Language Comprehension: Flexibility and Limitations in Uncovering Visual Context Effects

Eye Tracking During Visually Situated Language Comprehension: Flexibility and Limitations in Uncovering Visual Context Effects

Published on: November 30, 2018

Sequences in harmony: Cognitive interactions between musical and visual narrative structure.

Morgan T Patrick¹, Neil Cohn², John Mertus³

¹Brown University, United States of America; Northwestern University, United States of America.

Acta Psychologica

|July 13, 2023

Summary

This summary is machine-generated.

Music and visual narratives share brain mechanisms for processing sequences. Tonal music synchronized with coherent comic strips speeds up visual processing, suggesting a common sequence-processing system.

Keywords:

Domain-generality Sequence processing Tonality Visual narrative

More Related Videos

Clinical Practice Protocol of Creative Music Therapy for Preterm Infants and Their Parents in the Neonatal Intensive Care Unit

Clinical Practice Protocol of Creative Music Therapy for Preterm Infants and Their Parents in the Neonatal Intensive Care Unit

Published on: January 7, 2020

Cross-Modal Multivariate Pattern Analysis

Cross-Modal Multivariate Pattern Analysis

Published on: November 9, 2011

Related Experiment Videos

Last Updated: Jul 23, 2025

Eye Tracking During Visually Situated Language Comprehension: Flexibility and Limitations in Uncovering Visual Context Effects

Eye Tracking During Visually Situated Language Comprehension: Flexibility and Limitations in Uncovering Visual Context Effects

Published on: November 30, 2018

Clinical Practice Protocol of Creative Music Therapy for Preterm Infants and Their Parents in the Neonatal Intensive Care Unit

Clinical Practice Protocol of Creative Music Therapy for Preterm Infants and Their Parents in the Neonatal Intensive Care Unit

Published on: January 7, 2020

Cross-Modal Multivariate Pattern Analysis

Cross-Modal Multivariate Pattern Analysis

Published on: November 9, 2011

Area of Science:

Cognitive Neuroscience
Auditory Perception
Visual Perception

Background:

Tonal music and visual narratives are often presented together in media.
Both involve processing ordered sequences over time.
This raises questions about shared cognitive mechanisms for sequence apprehension.

Purpose of the Study:

To investigate whether musical progressions and visual narratives utilize shared sequence processing mechanisms.
To determine if audiovisual stimuli interact during online processing.

Main Methods:

Participants' reaction times were measured while viewing comic strip sequences.
Sequences were presented panel-by-panel, synchronized with musical chord progressions.
Image sequences were either coherent or incoherent, paired with tonal or non-tonal music.

Main Results:

Reaction times were faster for target images in coherent visual sequences compared to incoherent ones.
Reaction times were even faster when coherent images were accompanied by tonal music versus non-tonal chords.
This demonstrates an interaction between sequential structures across music and visual narrative domains.

Conclusions:

The findings provide evidence for a shared, domain-general sequence processing mechanism.
This mechanism appears to operate across both music and visual narrative comprehension.
Audiovisual sequence processing involves integrated domain-general systems.