Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Spatial evolution in temporal dynamics of hemodynamic response function in human superior colliculi with ultra-high-resolution MRI at 9.4T.

Frontiers in neuroscience·2026

Same author

Predicting bilingual aphasia treatment outcomes using digital twins: a double-blind randomized controlled trial.

NPJ digital medicine·2026

Same author

Age-related variations of the hemodynamic response function spatially resolved across human cerebral cortex.

Frontiers in aging neuroscience·2026

Same author

How the Stroop Effect Arises from Optimal Response Times in Laterally Connected Self-Organizing Maps.

CogSci ... Annual Conference of the Cognitive Science Society. Cognitive Science Society (U.S.). Conference·2026

Same author

Laminar multi-contrast fMRI at 7T allows differentiation of neuronal excitation and inhibition underlying positive and negative BOLD responses.

Imaging neuroscience (Cambridge, Mass.)·2025

Same author

How the Stroop Effect Arises from Optimal Response Times in Laterally Connected Self-Organizing Maps.

ArXiv·2025

Same journal

Vowel acoustic parameters in speech assessment and rehabilitation of minimally verbal and speech-motor-impaired autistic children: a narrative review.

Frontiers in human neuroscience·2026

Same journal

Toward clinical translation of TMS-EEG: an integrative review of multidimensional neurophysiological measures.

Frontiers in human neuroscience·2026

Same journal

The causal efficacy of consciousness: a neuroscientific analysis and explanation.

Frontiers in human neuroscience·2026

Same journal

Temporal-oscillatory entrainment: a multi-timescale framework for rhythmic coordination from neural to social frequencies.

Frontiers in human neuroscience·2026

Same journal

Role of AQP4 in ameliorating heat stress-induced cellular injury in a cell line model through active heat acclimation.

Frontiers in human neuroscience·2026

Same journal

Correction: Cognitive state monitoring for neuroadaptive information visualization.

Frontiers in human neuroscience·2026

See all related articles

Search research articles

Related Experiment Video

Updated: Apr 8, 2026

Brain Imaging Investigation of the Neural Correlates of Observing Virtual Social Interactions

Brain Imaging Investigation of the Neural Correlates of Observing Virtual Social Interactions

Published on: July 6, 2011

Accurately decoding visual information from fMRI data obtained in a realistic virtual environment.

Andrew Floren¹, Bruce Naylor², Risto Miikkulainen³

¹Electrical and Computer Engineering Department, The University of Texas at Austin Austin, TX, USA.

Frontiers in Human Neuroscience

|June 25, 2015

Summary

This summary is machine-generated.

This study uses machine learning and functional magnetic resonance imaging (fMRI) to decode brain states in realistic virtual environments (VEs). Advanced methods accurately map cognitive activity, offering new insights into brain function.

Keywords:

fMRI BOLD human vision machine learning natural stimuli virtual environments

More Related Videos

An Open-Source Virtual Reality System for the Measurement of Spatial Learning in Head-Restrained Mice

An Open-Source Virtual Reality System for the Measurement of Spatial Learning in Head-Restrained Mice

Published on: March 3, 2023

Author Spotlight: Insights into Visual Cortex Research Through Wide-View fMRI Mapping

Author Spotlight: Insights into Visual Cortex Research Through Wide-View fMRI Mapping

Published on: December 8, 2023

Related Experiment Videos

Last Updated: Apr 8, 2026

Brain Imaging Investigation of the Neural Correlates of Observing Virtual Social Interactions

Brain Imaging Investigation of the Neural Correlates of Observing Virtual Social Interactions

Published on: July 6, 2011

An Open-Source Virtual Reality System for the Measurement of Spatial Learning in Head-Restrained Mice

An Open-Source Virtual Reality System for the Measurement of Spatial Learning in Head-Restrained Mice

Published on: March 3, 2023

Author Spotlight: Insights into Visual Cortex Research Through Wide-View fMRI Mapping

Author Spotlight: Insights into Visual Cortex Research Through Wide-View fMRI Mapping

Published on: December 8, 2023

Area of Science:

Cognitive Neuroscience
Neuroimaging
Machine Learning

Background:

Three-dimensional virtual environments (VEs) offer realistic conditions for studying human cognition.
Current brain-imaging methods are under-utilized for complex VE research.
Understanding brain states in dynamic environments is crucial for cognitive neuroscience.

Purpose of the Study:

To develop and validate machine learning methods for identifying brain states induced by realistic VEs.
To map the spatial topography of cognitive states on the neocortex.
To explore the potential of real-time fMRI in VEs for applications like PTSD treatment.

Main Methods:

Functional magnetic resonance imaging (fMRI) data collected from subjects in a simulated Middle Eastern combat scenario VE.
Multi-Voxel Pattern Analysis (MVPA) with artificial Neural Networks (NN) applied to analyze complex fMRI data.
Novel NN-based sensitivity analysis developed to quantify voxel contribution to classification.

Main Results:

Machine learning methods achieved high classification accuracy (58-93%) for decoding cognitive states in dynamic VEs.
The study successfully decoded complex cognitive states, such as viewing multiple characters.
Novel sensitivity maps revealed diverse patterns of information relevant to cognitive state classification, outperforming traditional methods.

Conclusions:

Machine learning, particularly MVPA with NNs, is effective for analyzing brain activity in complex VEs.
This approach enhances the capability to study cognition in ecologically valid settings.
The developed methods provide a more detailed understanding of neural correlates of complex cognitive states.