Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Higher Mental Functions of the Brain: Language01:10

Higher Mental Functions of the Brain: Language

2.1K
Language is a system of communication that allows the expression of thoughts, ideas, and feelings. The brain processes language in both hemispheres.
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
2.1K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Spatial transcriptome and single-cell reveal the role of sorbitol metabolism in hepatocellular carcinoma progression and tumor microenvironment.

SLAS technology·2026
Same author

Multiscale structural connectome eigenmodes constrain human brain functional dynamics.

Communications biology·2026
Same author

Mapping the functional connectome between grey matter and white matter.

Communications biology·2026
Same author

Nitrogen and sulfur dual-doped yellow fluorescent carbon dots: strongly pH/polarity response and cancer cell recognition.

Mikrochimica acta·2026
Same author

Interplay of oxygen vacancies and lanthanide emitters enables reversible upconversion switching.

Nature communications·2026
Same author

La,S-CeO<sub>2</sub>/Ag-based reusable SERS substrate for simultaneous detection of multiple hazardous molecules.

Talanta·2026

Related Experiment Video

Updated: Oct 26, 2025

Transcranial Direct Current Stimulation tDCS of Wernicke's and Broca's Areas in Studies of Language Learning and Word Acquisition
12:49

Transcranial Direct Current Stimulation tDCS of Wernicke's and Broca's Areas in Studies of Language Learning and Word Acquisition

Published on: July 13, 2019

17.4K

A dual-channel language decoding from brain activity with progressive transfer training.

Wei Huang1, Hongmei Yan1, Kaiwen Cheng2

  • 1The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation, High-Field Magnetic Resonance Brain Imaging Key Laboratory of Sichuan Province, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China.

Human Brain Mapping
|July 27, 2021
PubMed
Summary
This summary is machine-generated.

Researchers developed a dual-channel language decoding model (DC-LDM) to translate visual cortex neural activity into descriptive text. This AI model accurately captions scenes, offering insights for brain-computer interfaces.

Keywords:
artificial intelligencefunctional magnetic resonance imaginglanguage decodingprogressive transfervisual cortex

More Related Videos

Measuring Statistical Learning Across Modalities and Domains in School-Aged Children Via an Online Platform and Neuroimaging Techniques
08:05

Measuring Statistical Learning Across Modalities and Domains in School-Aged Children Via an Online Platform and Neuroimaging Techniques

Published on: June 30, 2020

7.8K
A Novel Experimental and Analytical Approach to the Multimodal Neural Decoding of Intent During Social Interaction in Freely-behaving Human Infants
11:14

A Novel Experimental and Analytical Approach to the Multimodal Neural Decoding of Intent During Social Interaction in Freely-behaving Human Infants

Published on: October 4, 2015

11.1K

Related Experiment Videos

Last Updated: Oct 26, 2025

Transcranial Direct Current Stimulation tDCS of Wernicke's and Broca's Areas in Studies of Language Learning and Word Acquisition
12:49

Transcranial Direct Current Stimulation tDCS of Wernicke's and Broca's Areas in Studies of Language Learning and Word Acquisition

Published on: July 13, 2019

17.4K
Measuring Statistical Learning Across Modalities and Domains in School-Aged Children Via an Online Platform and Neuroimaging Techniques
08:05

Measuring Statistical Learning Across Modalities and Domains in School-Aged Children Via an Online Platform and Neuroimaging Techniques

Published on: June 30, 2020

7.8K
A Novel Experimental and Analytical Approach to the Multimodal Neural Decoding of Intent During Social Interaction in Freely-behaving Human Infants
11:14

A Novel Experimental and Analytical Approach to the Multimodal Neural Decoding of Intent During Social Interaction in Freely-behaving Human Infants

Published on: October 4, 2015

11.1K

Area of Science:

  • Neuroscience
  • Artificial Intelligence
  • Computer Vision
  • Natural Language Processing

Background:

  • The visual cortex processes visual information through neural activities.
  • Previous methods decoded neural activity into isolated tags, insufficiently capturing scene details.
  • Textual language (sentences/phrases) offers richer image representation than single words.

Purpose of the Study:

  • To develop an AI-based dual-channel language decoding model (DC-LDM) for translating neural activity into descriptive language.
  • To improve the accuracy and vividness of scene descriptions derived from neural signals.
  • To explore the potential of advanced AI in brain-computer interface applications.

Main Methods:

  • Constructed a dual-channel language decoding model (DC-LDM) with five modules: Image-Extractor, Image-Encoder, Nerve-Extractor, Nerve-Encoder, and Language-Decoder.
  • Employed a progressive transfer learning strategy for training the DC-LDM to enhance language decoding performance.
  • Utilized six quantitative indexes, including Word2vec-Cosine similarity (WCS), to evaluate decoded text against annotated image descriptions.

Main Results:

  • The DC-LDM successfully decoded neural activities into accurate and vivid textual descriptions of natural image stimuli.
  • Word2vec-Cosine similarity (WCS) was identified as the most effective metric for evaluating text similarity.
  • Text decoded from higher visual cortex activity showed greater consistency with image descriptions compared to lower visual cortex activity.

Conclusions:

  • The developed DC-LDM demonstrates a significant advancement in translating visual neural activity into meaningful language.
  • Higher visual cortex regions provide more detailed information for accurate scene description decoding.
  • This research offers valuable insights for the development of language-based brain-computer interfaces.