Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

The Brain, Body, and Behavior Dataset (BBBD): Multimodal Recordings during Educational Videos.

Scientific data·2026

Same author

During natural vision, semantic novelty modulates fixation-related processing in primate cortex.

bioRxiv : the preprint server for biology·2026

Same author

The role of fibration symmetries in geometric deep learning.

Proceedings of the National Academy of Sciences of the United States of America·2026

Same author

Alpha Modulation of Spiking Activity Across Multiple Brain Regions in Mice Performing a Tactile Selective Detection Task.

The European journal of neuroscience·2025

Same author

Superficial Fluctuations in Functional Near-Infrared Spectroscopy during Concurrent Transcranial Magnetic Stimulation.

Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference·2025

Same author

Real-Time Estimation of Overt Attention from Dynamic Features of the Face Using Deep Learning.

Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference·2025

Same journal

Decoding neuronal criticality firing patterns for large brain based EEG models.

NeuroImage·2026

Same journal

Segmentation of the parasagittal dura mater on multi-center 3D-FLAIR MRI.

NeuroImage·2026

Same journal

Spatial frequency channels implement a mental ruler in spatial vision.

NeuroImage·2026

Same journal

Exploring the Link Between Intravoxel Incoherent Motion Measured Brain Diffusivity During Wakefulness and Sleep Macrostructure in the Elderly.

NeuroImage·2026

Same journal

Closed-loop adaptation of transcranial magnetic stimulation intensity with electroencephalography feedback.

NeuroImage·2026

Same journal

Volumetric postmortem MRI of the medial temporal lobe in Alzheimer's disease and related disorders: methodological advances and implications for in vivo biomarker development.

NeuroImage·2026

See all related articles

Search research articles

Related Experiment Video

Updated: Mar 1, 2026

Author Spotlight: Advancing Large-Scale Neural Dynamics Through HD-MEA Technology

Author Spotlight: Advancing Large-Scale Neural Dynamics Through HD-MEA Technology

Published on: March 8, 2024

Extracting multidimensional stimulus-response correlations using hybrid encoding-decoding of neural activity.

Jacek P Dmochowski¹, Jason J Ki¹, Paul DeGuzman²

¹Department of Biomedical Engineering, City College of New York, New York, NY 10031, United States.

|May 27, 2017

Summary

This summary is machine-generated.

This study introduces a new hybrid method using canonical correlation analysis (CCA) to analyze brain activity and stimulus relationships, offering a richer, multidimensional view of neural representations.

More Related Videos

Decoding Natural Behavior from Neuroethological Embedding

Decoding Natural Behavior from Neuroethological Embedding

Published on: October 3, 2025

Cross-Modal Multivariate Pattern Analysis

Cross-Modal Multivariate Pattern Analysis

Published on: November 9, 2011

Related Experiment Videos

Last Updated: Mar 1, 2026

Author Spotlight: Advancing Large-Scale Neural Dynamics Through HD-MEA Technology

Author Spotlight: Advancing Large-Scale Neural Dynamics Through HD-MEA Technology

Published on: March 8, 2024

Decoding Natural Behavior from Neuroethological Embedding

Decoding Natural Behavior from Neuroethological Embedding

Published on: October 3, 2025

Cross-Modal Multivariate Pattern Analysis

Cross-Modal Multivariate Pattern Analysis

Published on: November 9, 2011

Area of Science:

Neuroscience
Cognitive Science
Computational Neuroscience

Background:

Traditional neuroscience methods for analyzing stimulus-response relationships rely on separate encoding or decoding models.
Existing models offer limited dimensionality in understanding neural representations.

Purpose of the Study:

To introduce and validate a hybrid encoding-decoding approach for analyzing multidimensional stimulus-response relationships.
To provide a richer analysis of neural representations by decomposing neural activity into multiple stimulus-related components.

Main Methods:

A hybrid approach combining temporal stimulus filtering (encoding) and spatial neural response filtering (decoding) using canonical correlation analysis (CCA).
Validation using simulated electroencephalographic (EEG) data and real EEG responses to auditory, audiovisual narratives, and video game play.
Analysis of stimulus-response correlations (SRC) under varying conditions, including attention, inter-subject correlations, game difficulty, and dual-task paradigms.

Main Results:

The hybrid CCA method successfully recovered multiple stimulus-driven components from EEG data.
Auditory and visual SRC during narrative experiences were modulated by attention and tracked inter-subject correlations.
During video game play, SRC varied with game difficulty and dual-task load.
A dominant supramodal neural response was observed for both visual and auditory features in naturalistic stimuli.

Conclusions:

The proposed hybrid encoding-decoding method enables a multidimensional analysis of stimulus-response correlations (SRC).
This technique reveals insights into how the brain processes complex, naturalistic stimuli, suggesting a supramodal nature of predominant neural responses.
The findings highlight the utility of measuring multidimensional SRC for a comprehensive understanding of neural representations.