Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Brain Imaging

Brain Imaging

Brain imaging technologies provide critical insights into both the structure and function of the human brain, enabling medical professionals and researchers to diagnose, study, and treat neurological disorders or psychiatric disorders more effectively.
These technologies include computerized axial tomography (CAT or CT scans), positron-emission tomography (PET scans), magnetic resonance imaging (MRI), functional magnetic resonance imaging (fMRI), and Transcranial Magnetic...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Radiation induces an EGFR-dependent lactate-epigenetic program underlying synergy with EGFR inhibition.

Cellular oncology (Dordrecht, Netherlands)·2026

Same author

Exercise-regulated bone-brain axis: A novel perspective on age-related cognitive decline.

Neural regeneration research·2026

Same author

Using a longitudinal k-means clustering method to explore nursing home factors associated with SARS-CoV-2 infection peak and resilience to a COVID-19 surge.

Infection control and hospital epidemiology·2026

Same author

Influenza Vaccination Coverage Among Nursing Home Residents and Health Care Personnel - United States, 2024-25 Influenza Season.

MMWR. Morbidity and mortality weekly report·2026

Same author

Enhancing CNN regressors with contour encoding and self-supervision for improved 3D/2D x-ray to CT registration in spinal surgery navigation.

Biomedical physics & engineering express·2026

Same author

Comparative evaluation of the short-chain fatty acids formate, propionate, and valerate on intestinal barrier maturation and bone development in neonatal mice.

Food & function·2026

Search research articles

Related Experiment Video

Updated: Jan 10, 2026

Concurrent EEG and Functional MRI Recording and Integration Analysis for Dynamic Cortical Activity Imaging

Concurrent EEG and Functional MRI Recording and Integration Analysis for Dynamic Cortical Activity Imaging

Published on: June 30, 2018

Brain-imager: a multimodal framework for image reconstruction and captioning from human brain activity.

Lu Meng^1,2, Zengyu Song³, Jiayang Lu³

¹College of Information Science and Engineering, Northeastern University, Shenyang, 110819, China. menglu1982@gmail.com.

Brain Informatics

|November 26, 2025

Summary

Researchers developed a new framework, Brain-Imager, to reconstruct visual stimuli and captions from brain activity. This approach enhances image and text generation accuracy from neural data, advancing brain decoding capabilities.

Keywords:

Brain captioning Panoptic segmentation Visual decoding dual-stream hypothesis

More Related Videos

Functional Near Infrared Spectroscopy of the Sensory and Motor Brain Regions with Simultaneous Kinematic and EMG Monitoring During Motor Tasks

Functional Near Infrared Spectroscopy of the Sensory and Motor Brain Regions with Simultaneous Kinematic and EMG Monitoring During Motor Tasks

Published on: December 5, 2014

High-resolution Functional Magnetic Resonance Imaging Methods for Human Midbrain

High-resolution Functional Magnetic Resonance Imaging Methods for Human Midbrain

Published on: May 10, 2012

Related Experiment Videos

Last Updated: Jan 10, 2026

Concurrent EEG and Functional MRI Recording and Integration Analysis for Dynamic Cortical Activity Imaging

Concurrent EEG and Functional MRI Recording and Integration Analysis for Dynamic Cortical Activity Imaging

Published on: June 30, 2018

Functional Near Infrared Spectroscopy of the Sensory and Motor Brain Regions with Simultaneous Kinematic and EMG Monitoring During Motor Tasks

Functional Near Infrared Spectroscopy of the Sensory and Motor Brain Regions with Simultaneous Kinematic and EMG Monitoring During Motor Tasks

Published on: December 5, 2014

High-resolution Functional Magnetic Resonance Imaging Methods for Human Midbrain

High-resolution Functional Magnetic Resonance Imaging Methods for Human Midbrain

Published on: May 10, 2012

Area of Science:

Neuroscience
Computer Vision
Artificial Intelligence

Background:

Reconstructing visual stimuli and captions from brain activity provides insights into neural dynamics of perception.
Simultaneously generating accurate and semantically consistent images and captions from neural data remains a challenge for deep generative models.

Purpose of the Study:

To develop a novel framework for reconstructing visual stimuli and captions from brain activity.
To address the challenge of generating detailed and semantically consistent images and captions simultaneously.

Main Methods:

Introduced panoptic segmentation and generative semantics for multi-level data support in brain decoding.
Integrated multi-scale fusion of pixel and structural features for an enhanced "initial guess."
Employed a semantic connection strategy for image reconstruction and fine-tuned visual semantics using language models for high-quality brain captioning with LLMs.

Main Results:

The Brain-Imager framework surpassed current methods in visual decoding and brain captioning tasks.
Demonstrated superior performance in generating accurate and semantically consistent visual stimuli and captions from neural data.

Conclusions:

The Brain-Imager framework establishes a new standard in brain decoding by incorporating multi-level data and semantic guidance.
This work offers novel insights into text-image semantics and human brain visual pathways, with potential for brain-computer interfaces.