一个脑到文本的框架来解码自然的音调句子
Daohan Zhang1, Zhenjie Wang2, Youkun Qian1
1Department of Neurosurgery, Huashan Hospital, Shanghai Medical College, Fudan University, Shanghai 200040, China; Shanghai Key Laboratory of Brain Function Restoration and Neural Regeneration, Shanghai 200040, China; National Center for Neurological Disorders, Huashan Hospital, Shanghai Medical College, Fudan University, Shanghai 200040, China.
这项研究提出了一个脑到文本框架,用于从大脑活动中解码普通话中文语音. 这种新的方法准确地解读了音调和音节,大大提高了音调语言的大脑计算机接口 (BCI) 的性能.
科学领域:
- 神经科学是一个神经科学.
- 计算语言学 计算语言学
- 生物医学工程 生物医学工程
背景情况:
- 语音大脑-计算机接口 (BCI) 将大脑活动转化为语音.
- 繁体中文等音调语言,由于复杂的音节结构和词汇音调,给BCI带来了独特的挑战.
研究的目的:
- 开发一个脑到文本框架,从侵入性神经记录中解码普通话中文句子.
- 为解决BCI应用程序在普通话语语中解码音色细微差别的挑战.
主要方法:
- 设计了一个框架,剖析语音发作,基本音节和词汇音调.
- 集成解码组件与上下文信息使用贝叶斯概率和维特比解码器.
- 在自然主义语音制作过程中利用侵入性神经记录.
主要成果:
- 在普通话句子中实现了音调和音节的准确解码.
- 在5名参与者中,报告了10个离线解码的音调句子 (40个字符的词汇) 的单词错误率 (WER) 为21%.
- 达到了93%的音调解码精度,超过了以前的普通话音调音节的内解码器.
结论:
- 开发的框架为连续的音调语音的脑到文本解码提供了一个强大的和可泛化的方法.
- 这一进步具有显著的潜力,可以改善使用音调语言的言语障碍患者的沟通.
更多相关视频
12:49Transcranial Direct Current Stimulation tDCS of Wernicke's and Broca's Areas in Studies of Language Learning and Word Acquisition
Published on: July 13, 2019
09:09Foreign Accent and Forensic Speaker Identification in Voice Lineups: The Influence of Acoustic Features Based on Prosody
Published on: September 27, 2024
相关概念视频
Components of Language
Language Development
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
Language and Cognition
Higher Mental Functions of the Brain: Language
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
Encoding
Automatic processing involves the encoding of details like time, space, frequency, and the meaning of words, usually done without conscious...
Language
Corballis and Suddendorf (2007) and Tomasello and Rakoczy (2003) highlight the role of language in...
