Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Higher Mental Functions of the Brain: Language01:10

Higher Mental Functions of the Brain: Language

2.0K
Language is a system of communication that allows the expression of thoughts, ideas, and feelings. The brain processes language in both hemispheres.
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
2.0K
Neural Circuits01:25

Neural Circuits

1.9K
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
1.9K
Visual System01:26

Visual System

1.1K
Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...
1.1K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Spatial transcriptome and single-cell reveal the role of sorbitol metabolism in hepatocellular carcinoma progression and tumor microenvironment.

SLAS technology·2026
Same author

Nitrogen and sulfur dual-doped yellow fluorescent carbon dots: strongly pH/polarity response and cancer cell recognition.

Mikrochimica acta·2026
Same author

Interplay of oxygen vacancies and lanthanide emitters enables reversible upconversion switching.

Nature communications·2026
Same author

La,S-CeO<sub>2</sub>/Ag-based reusable SERS substrate for simultaneous detection of multiple hazardous molecules.

Talanta·2026
Same author

Description of <i>Epidaus nanlingensis</i> sp. nov. (Hemiptera, Reduviidae, Harpactorinae) from Nanling Mountains, China, with an updated key to Chinese species of <i>Epidaus</i> Stål.

Biodiversity data journal·2026
Same author

Multifunctional fluorescent carbon dots with synergistic-mechanism targeted mitochondria and Fe³⁺ detection.

Mikrochimica acta·2026

Related Experiment Video

Updated: Oct 21, 2025

Decoding Natural Behavior from Neuroethological Embedding
08:00

Decoding Natural Behavior from Neuroethological Embedding

Published on: October 3, 2025

103

A neural decoding algorithm that generates language from visual activity evoked by natural images.

Wei Huang1, Hongmei Yan1, Kaiwen Cheng2

  • 1The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, 610054, China.

Neural Networks : the Official Journal of the International Neural Network Society
|September 3, 2021
PubMed
Summary
This summary is machine-generated.

Researchers developed a new AI model to translate visual brain activity (fMRI signals) into language. This breakthrough could significantly aid communication for individuals with aphasia and advance brain-computer interfaces.

Keywords:
Human–computer interactionLanguage decodingNeural decodingProgressive transferVisual activity

More Related Videos

A Novel Experimental and Analytical Approach to the Multimodal Neural Decoding of Intent During Social Interaction in Freely-behaving Human Infants
11:14

A Novel Experimental and Analytical Approach to the Multimodal Neural Decoding of Intent During Social Interaction in Freely-behaving Human Infants

Published on: October 4, 2015

11.1K
Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks
11:18

Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks

Published on: March 2, 2015

10.5K

Related Experiment Videos

Last Updated: Oct 21, 2025

Decoding Natural Behavior from Neuroethological Embedding
08:00

Decoding Natural Behavior from Neuroethological Embedding

Published on: October 3, 2025

103
A Novel Experimental and Analytical Approach to the Multimodal Neural Decoding of Intent During Social Interaction in Freely-behaving Human Infants
11:14

A Novel Experimental and Analytical Approach to the Multimodal Neural Decoding of Intent During Social Interaction in Freely-behaving Human Infants

Published on: October 4, 2015

11.1K
Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks
11:18

Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks

Published on: March 2, 2015

10.5K

Area of Science:

  • Neuroscience
  • Artificial Intelligence
  • Human-Computer Interaction

Background:

  • Decoding neural activity into language is crucial for human-computer interaction and restoring communication for aphasia patients.
  • Advancements in artificial intelligence enable the decoding of neural signals associated with visual activities.

Purpose of the Study:

  • To propose a novel Progressive Transfer Language Decoding Model (PT-LDM) for translating visual fMRI signals into phrases or sentences.
  • To evaluate the model's performance in generating language from visual stimuli.

Main Methods:

  • The PT-LDM integrates an image encoder, an fMRI encoder, and a language decoder.
  • Decoding was performed on functional magnetic resonance imaging (fMRI) signals recorded while participants viewed natural images.

Main Results:

  • The model successfully generated phrases and sentences from visual fMRI data.
  • Evaluation metrics (BLEU, ROUGE, CIDEr) showed significant improvement over baseline methods.
  • Higher visual cortical areas demonstrated better decoding performance compared to lower visual areas.
  • The contribution of visual response patterns to language decoding varied over time.

Conclusions:

  • Neural representations in visual cortices during scene viewing contain semantic information usable for language generation.
  • This research highlights the potential of language-based brain-machine interfaces, particularly for assisting communication in aphasia patients using fMRI signals.