Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Higher Mental Functions of the Brain: Language01:10

Higher Mental Functions of the Brain: Language

3.4K
Language is a system of communication that allows the expression of thoughts, ideas, and feelings. The brain processes language in both hemispheres.
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
3.4K
Brain Waves01:23

Brain Waves

3.8K
Brain waves are electrical signals generated by the neurons in the brain, which are regularly monitored to measure mental activities. Brain waves and their frequency ranges can be measured using an electroencephalogram or EEG. There are four main types of brain waves, each with distinct characteristics:
3.8K
Empathy02:34

Empathy

10.0K
Some researchers suggest that altruism operates on empathy. Empathy is the capacity to understand another person’s perspective, to feel what he or she feels. An empathetic person makes an emotional connection with others and feels compelled to help (Batson, 1991). Empathy can be expressed in several ways, including cognitive, affective, and motor. 
10.0K
Cognitivism01:17

Cognitivism

2.7K
Cognitive psychology emerged as a significant field in the mid-20th century. It focused on understanding humans' internal mental processes. This approach emphasizes how people perceive, remember, think, and solve problems—elements critical to human cognition.
Previously dominated by behaviorism, which prioritized observable behaviors and largely ignored mental processes, psychology transformed in the 1950s. Cognitive psychologists argue that understanding how we think and process...
2.7K
Functional Brain Systems: Limbic System01:15

Functional Brain Systems: Limbic System

6.4K
The limbic system, often called the "emotional brain," is a complex set of structures located deep within the brain. The intricate network of the limbic system supports a wide range of psychological functions, from emotional regulation to memory formation and sensory processing. This functional brain region encompasses specific parts of the diencephalon and the cerebrum, integrating the higher mental functions of the cerebral cortex with the primitive emotional responses of the deep brain...
6.4K
Functional Brain Systems: Reticular Formation01:13

Functional Brain Systems: Reticular Formation

4.2K
The reticular formation is a complex network of gray and white matter located within the brainstem extending from the medulla to the midbrain.
Within the reticular formation, there are several distinct nuclei that can be classified into three broad categories. The Raphe nuclei are located along the midline of the brainstem. They are primarily known for their role in synthesizing and releasing serotonin, a neurotransmitter involved in regulating mood, appetite, sleep, and circadian rhythms. The...
4.2K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Reconstructing visual illusory experiences from human brain activity.

Science advances·2023
Same author

Attention modulates neural representation to render reconstructions according to subjective appearance.

Communications biology·2022
Same author

Peripheral blood metabolome predicts mood change-related activity in mouse model of bipolar disorder.

Molecular brain·2019
Same author

Deep image reconstruction from human brain activity.

PLoS computational biology·2019

Related Experiment Video

Updated: Jan 12, 2026

Cross-Modal Multivariate Pattern Analysis
13:51

Cross-Modal Multivariate Pattern Analysis

Published on: November 9, 2011

20.4K

Mind captioning: Evolving descriptive text of mental content from human brain activity.

Tomoyasu Horikawa1

  • 1Communication Science Laboratories, NTT, Inc., Kanagawa, Japan.

Science Advances
|November 5, 2025
PubMed
Summary

Scientists developed a new brain-to-text method to decode complex visual content from brain activity. This approach generates descriptive text, offering potential communication for those with language impairments.

More Related Videos

Mapping Cortical Dynamics Using Simultaneous MEG/EEG and Anatomically-constrained Minimum-norm Estimates: an Auditory Attention Example
08:45

Mapping Cortical Dynamics Using Simultaneous MEG/EEG and Anatomically-constrained Minimum-norm Estimates: an Auditory Attention Example

Published on: October 24, 2012

15.1K
Perspectives on Neuroscience
26:41

Perspectives on Neuroscience

Published on: July 31, 2007

5.3K

Related Experiment Videos

Last Updated: Jan 12, 2026

Cross-Modal Multivariate Pattern Analysis
13:51

Cross-Modal Multivariate Pattern Analysis

Published on: November 9, 2011

20.4K
Mapping Cortical Dynamics Using Simultaneous MEG/EEG and Anatomically-constrained Minimum-norm Estimates: an Auditory Attention Example
08:45

Mapping Cortical Dynamics Using Simultaneous MEG/EEG and Anatomically-constrained Minimum-norm Estimates: an Auditory Attention Example

Published on: October 24, 2012

15.1K
Perspectives on Neuroscience
26:41

Perspectives on Neuroscience

Published on: July 31, 2007

5.3K

Area of Science:

  • Neuroscience
  • Artificial Intelligence
  • Computational Linguistics

Background:

  • Decoding complex mental content from brain activity is a significant neuroscience challenge.
  • Existing methods struggle with comprehensive descriptions of structured visual semantics from neural data.

Purpose of the Study:

  • To develop a novel brain-to-text method for generating descriptive text from brain activity.
  • To accurately capture viewed and recalled content using semantic features and deep language models.

Main Methods:

  • Constructed linear decoding models to translate brain activity (induced by videos) into semantic features.
  • Optimized candidate descriptions by aligning their semantic features with brain-decoded features via word replacement and interpolation.
  • Utilized deep language models for semantic feature computation.

Main Results:

  • Generated well-structured, accurate descriptions of viewed video content directly from brain activity.
  • Demonstrated successful decoding even without relying on the canonical language network.
  • Showcased generalization to verbalizing recalled content.

Conclusions:

  • The developed method serves as an interpretive interface between mental representations and text.
  • This approach shows potential for nonverbal thought-based brain-to-text communication.
  • It could offer an alternative communication pathway for individuals with conditions like aphasia.