Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Search research articles

Related Experiment Video

Updated: May 19, 2026

Cross-Modal Multivariate Pattern Analysis

Cross-Modal Multivariate Pattern Analysis

Published on: November 9, 2011

Decoding semantics across fMRI sessions with different stimulus modalities: a practical MVPA study.

Hiroyuki Akama¹, Brian Murphy, Li Na

¹Akama Laboratory, Graduate School of Decision Science and Technology, Tokyo Institute of Technology Tokyo, Japan.

Frontiers in Neuroinformatics

|September 1, 2012

Summary

This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Prediction of Zonisamide Concentration in Pediatric Patients With Epilepsy: A Machine Learning Approach.

CNS neuroscience & therapeutics·2026

Same author

Longitudinal cognitive assessment using the Cumulus NeuLogiq platform in amyotrophic lateral sclerosis and frontotemporal dementia.

Scientific reports·2026

Same author

Automated detection of referential features in schizophrenic speech using large language models.

Neuropsychologia·2026

Same author

Construction and interpretability evaluation of a prediction model for radiographic pneumonia in children at outpatient and emergency departments.

International journal of medical informatics·2026

Same author

Transcriptome and alternative splicing analyses uncover immune-centric pathogenesis in periodontitis versus barrier-dysfunction-driven pathogenesis in peri-implantitis.

Gene·2026

Same author

Effects of a Community-Based Multi-Component Intervention on Subjective Well-Being in Older Adults: The Chofu-Digital-Choju Project in Japan.

Geriatrics (Basel, Switzerland)·2026

Same journal

Predicting vasovagal syncope during head-up tilt test: three machine learning approaches.

Frontiers in neuroinformatics·2026

Same journal

Decoding basal ganglia motor circuit dysfunction from handwriting: a physics-informed neural signal interpretation framework for Parkinson's disease screening.

Frontiers in neuroinformatics·2026

Same journal

FUSION-AD: interpretable AI framework for risk assessment and subgroup discovery in Alzheimer's disease.

Frontiers in neuroinformatics·2026

Same journal

A 3D-printed phantom to validate subject orientation in 3D imaging and recordings.

Frontiers in neuroinformatics·2026

Same journal

IntegriLAB: a blockchain-enabled electronic lab notebook for reproducible neuroimaging research.

Frontiers in neuroinformatics·2026

Same journal

Long-range correlations in alpha-band of electroencephalogram: a nonlinear embedding and detrended fluctuation analysis.

Frontiers in neuroinformatics·2026

See all related articles

Neural patterns for concepts show partial overlap across senses. Machine learning models struggle with cross-modal fMRI data due to variability, requiring combined spatio-temporal analysis for better predictions.

Area of Science:

Cognitive Neuroscience
Neuroimaging
Machine Learning

Background:

Conceptual organization theories predict modality-specific neural representations.
Variability in functional magnetic resonance imaging (fMRI) data poses challenges for multivariate pattern analysis (MVPA).

Purpose of the Study:

To investigate the impact of cross-modal and individual variability on machine learning analysis of fMRI data.
To examine the feasibility of cross-modal semantic decoding using fMRI.

Main Methods:

fMRI data collected from Japanese participants performing a word property generation task.
Auditory and visual presentation of semantic categories (land-mammals, work tools) across two sessions.
Multivariate pattern analysis (MVPA) for classification accuracy assessment.

Keywords:

GLM MVPA computational neurolinguistics embodiment fMRI individual variability machine learning

More Related Videos

Using Informational Connectivity to Measure the Synchronous Emergence of fMRI Multi-voxel Information Across Time

Using Informational Connectivity to Measure the Synchronous Emergence of fMRI Multi-voxel Information Across Time

Published on: July 1, 2014

Detecting Pre-Stimulus Source-Level Effects on Object Perception with Magnetoencephalography

Detecting Pre-Stimulus Source-Level Effects on Object Perception with Magnetoencephalography

Published on: July 26, 2019

Related Experiment Videos

Last Updated: May 19, 2026

Cross-Modal Multivariate Pattern Analysis

Cross-Modal Multivariate Pattern Analysis

Published on: November 9, 2011

Using Informational Connectivity to Measure the Synchronous Emergence of fMRI Multi-voxel Information Across Time

Using Informational Connectivity to Measure the Synchronous Emergence of fMRI Multi-voxel Information Across Time

Published on: July 1, 2014

Detecting Pre-Stimulus Source-Level Effects on Object Perception with Magnetoencephalography

Detecting Pre-Stimulus Source-Level Effects on Object Perception with Magnetoencephalography

Published on: July 26, 2019

Main Results:

High within-session classification accuracies (80-90%) for semantic categories.
Reduced cross-session prediction accuracies (65-75%) between auditory and visual tasks.
Neither temporal nor spatial differences alone explained the cross-session performance penalty.

Conclusions:

Combined spatio-temporal patterns are crucial for successful cross-session fMRI decoding.
Feature selection strategies in MVPA may need modification to account for cross-modal variability.
Understanding neural representations across modalities is key for robust brain-computer interfaces.