Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Components of Language01:24

Components of Language

249
Language, whether spoken, signed, or written, consists of specific components: lexicon and grammar. The lexicon is the vocabulary of a language, comprising its words. Grammar is the set of rules used to convey meaning through the lexicon. For example, English grammar adds “-ed” to most verbs to indicate past tense. Words are formed by combining phonemes, which are the basic sound units of a language. Different languages have different sets of phonemes (e.g., “ah” vs.
249
Language Development01:22

Language Development

318
Children master language quickly and with relative ease, supported by both biological predisposition and reinforcement. B. F. Skinner (1957) proposed that language is learned through reinforcement, while Noam Chomsky (1965) argued that language acquisition mechanisms are biologically determined.
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
318
Language and Cognition01:27

Language and Cognition

326
Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.
326
Higher Mental Functions of the Brain: Language01:10

Higher Mental Functions of the Brain: Language

751
Language is a system of communication that allows the expression of thoughts, ideas, and feelings. The brain processes language in both hemispheres.
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
751
Encoding01:19

Encoding

133
Information enters the brain through encoding, which is the input of information into the memory system. Once sensory information is received from the environment, the brain labels or codes it. The information is then organized with similar information and connected to existing concepts. Encoding occurs through automatic processing and effortful processing.
Automatic processing involves the encoding of details like time, space, frequency, and the meaning of words, usually done without conscious...
133
Language01:16

Language

195
Language is a unique communication system that uses words and systematic rules to organize and transmit information. Unlike other forms of communication, which may involve postures, movements, odors, or vocalizations, language relies on symbols and grammar. This makes human communication distinct from that of other species, who also communicate but do not use language in the same way humans do.
Corballis and Suddendorf (2007) and Tomasello and Rakoczy (2003) highlight the role of language in...
195

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Effectiveness of pegylated interferon-α combined with antiretroviral therapy on HIV reservoir clearance in acute HIV infection: study protocol for a randomised controlled trial at a tertiary infectious disease hospital in Beijing, China.

BMJ open·2026
Same author

Interfacial Confinement-Programmed Hydrogen Spillover on Ag/CoNiS Boosts Nitrate-to-Ammonia Electrosynthesis.

Advanced materials (Deerfield Beach, Fla.)·2026
Same author

MR Lymphangiography for Diagnosis of Lower Extremity Lymphedema: Suppressing Venous Signal Interference Using Deep Learning.

Radiology·2026
Same author

A Fine-grained Spatiotemporal ECoG Dataset during Speech Perception in Tonal Language.

Scientific data·2026
Same author

Fusion of MRI-radiomics and clinical features to improve pathological T-stage prediction of rectal cancer: a multicenter study.

BMC cancer·2026
Same author

Targeted immunotherapy and tumor immunogenicity in liver transplant recipients: A study on lenvatinib and PD-L1 inhibition.

Pakistan journal of pharmaceutical sciences·2026
Same journal

Yeast β-glucan supplementation supports immunometabolic anti-tumor responses and reverses obesity-induced dysfunction via trained hematopoiesis.

Cell reports·2026
Same journal

Structural and evolutionary divergence of the RAG1/1L N-terminal zinc-coordinating domain.

Cell reports·2026
Same journal

BCAA metabolism promotes lung cancer tumorigenesis by enhancing cholesterol biosynthesis.

Cell reports·2026
Same journal

Yap mediates hippo signaling to balance proliferation and differentiation in the developing glandular stomach epithelium.

Cell reports·2026
Same journal

A non-catalytic function for RAD18 in sustaining glioblastoma proliferation.

Cell reports·2026
Same journal

Synthetic ecology of coastal ecosystems.

Cell reports·2026
See all related articles

Related Experiment Video

Updated: Jun 8, 2025

Eye-tracking to Distinguish Comprehension-based and Oculomotor-based Regressive Eye Movements During Reading
05:54

Eye-tracking to Distinguish Comprehension-based and Oculomotor-based Regressive Eye Movements During Reading

Published on: October 18, 2018

6.1K

A brain-to-text framework for decoding natural tonal sentences.

Daohan Zhang1, Zhenjie Wang2, Youkun Qian1

  • 1Department of Neurosurgery, Huashan Hospital, Shanghai Medical College, Fudan University, Shanghai 200040, China; Shanghai Key Laboratory of Brain Function Restoration and Neural Regeneration, Shanghai 200040, China; National Center for Neurological Disorders, Huashan Hospital, Shanghai Medical College, Fudan University, Shanghai 200040, China.

Cell Reports
|November 1, 2024
PubMed
Summary
This summary is machine-generated.

This study presents a brain-to-text framework for decoding Mandarin Chinese speech from brain activity. The novel approach accurately decodes tones and syllables, significantly improving brain-computer interface (BCI) performance for tonal languages.

Keywords:
BCICP: NeuroscienceECoGMandarinartificial intelligencebrain-computer interfacedeep neural networkselectrocorticographynatural speechneural decodingtonal language

More Related Videos

Transcranial Direct Current Stimulation tDCS of Wernicke's and Broca's Areas in Studies of Language Learning and Word Acquisition
12:49

Transcranial Direct Current Stimulation tDCS of Wernicke's and Broca's Areas in Studies of Language Learning and Word Acquisition

Published on: July 13, 2019

16.8K
Foreign Accent and Forensic Speaker Identification in Voice Lineups: The Influence of Acoustic Features Based on Prosody
09:09

Foreign Accent and Forensic Speaker Identification in Voice Lineups: The Influence of Acoustic Features Based on Prosody

Published on: September 27, 2024

405

Related Experiment Videos

Last Updated: Jun 8, 2025

Eye-tracking to Distinguish Comprehension-based and Oculomotor-based Regressive Eye Movements During Reading
05:54

Eye-tracking to Distinguish Comprehension-based and Oculomotor-based Regressive Eye Movements During Reading

Published on: October 18, 2018

6.1K
Transcranial Direct Current Stimulation tDCS of Wernicke's and Broca's Areas in Studies of Language Learning and Word Acquisition
12:49

Transcranial Direct Current Stimulation tDCS of Wernicke's and Broca's Areas in Studies of Language Learning and Word Acquisition

Published on: July 13, 2019

16.8K
Foreign Accent and Forensic Speaker Identification in Voice Lineups: The Influence of Acoustic Features Based on Prosody
09:09

Foreign Accent and Forensic Speaker Identification in Voice Lineups: The Influence of Acoustic Features Based on Prosody

Published on: September 27, 2024

405

Area of Science:

  • Neuroscience
  • Computational Linguistics
  • Biomedical Engineering

Background:

  • Speech brain-computer interfaces (BCIs) translate brain activity into speech.
  • Tonal languages like Mandarin Chinese pose unique challenges for BCIs due to complex syllabic structures and lexical tones.

Purpose of the Study:

  • To develop a brain-to-text framework for decoding Mandarin Chinese sentences from invasive neural recordings.
  • To address the challenges of decoding tonal nuances in Mandarin speech for BCI applications.

Main Methods:

  • Designed a framework dissecting speech onset, base syllables, and lexical tones.
  • Integrated decoded components with contextual information using Bayesian likelihood and a Viterbi decoder.
  • Utilized invasive neural recordings during naturalistic speech production.

Main Results:

  • Achieved accurate decoding of tones and syllables in Mandarin sentences.
  • Reported a word error rate (WER) of 21% for 10 offline-decoded tonal sentences (40-character vocabulary) across five participants.
  • Reached 93% tone decoding accuracy, surpassing previous intracranial decoders for Mandarin tonal syllables.

Conclusions:

  • The developed framework offers a robust and generalizable approach for brain-to-text decoding of continuous tonal speech.
  • This advancement holds significant potential for improving communication for individuals with speech impairments using tonal languages.