从神经解码口语句子进行语音合成
Gopala K Anumanchipalli1,2, Josh Chartier1,2,3, Edward F Chang4,5,6
1Department of Neurological Surgery, University of California San Francisco, San Francisco, CA, USA.
Nature
|April 26, 2019
概括
一个新的脑电脑接口将神经信号解码为可听的语音. 这种语音神经假肢技术有望恢复神经障碍患者的沟通.
科学领域:
- 神经科学
- 生物医学工程
- 语言科学
背景情况:
- 神经障碍会严重影响沟通能力.
- 由于复杂的声道控制, 通过技术恢复语音是一个重大挑战.
研究的目的:
- 开发一种能够从大脑活动中合成可听的语音的神经解码器.
- 在皮质活动中利用动态和声音表示来解码语音.
主要方法:
- 设计了一个基于循环神经网络的解码器来解释神经信号.
- 解码皮质活动到关节运动表现.
- 转化了口音表达成语音.
主要成果:
- 在闭合词汇测试中成功识别和转录了来自神经活动的合成听觉语音.
- 结合中间关节动态提高了性能,特别是有限的数据.
- 解码的关节表示显示了跨扬声器的保存,允许解码器的可转移性.
结论:
- 发明的神经解码器有效地从大脑活动中合成语音.
- 这项技术显示了语音神经假体恢复沟通的可能性.
- 解码器能够使用无声模仿,
相关概念视频
Dehydration Synthesis
149.1K
Overview
Dehydration synthesis (also called a condensation reaction) is the chemical process in which two molecules covalently link together to form a new molecule, along with the release of a water molecule. Many physiologically important compounds form by dehydration synthesis reactions, such as complex carbohydrates, proteins, DNA, and RNA.
Synthesis of carbohydrates
Sugar molecules are covalently linked together by dehydration synthesis. During the reaction, the hydroxyl (-OH) group from...
Dehydration synthesis (also called a condensation reaction) is the chemical process in which two molecules covalently link together to form a new molecule, along with the release of a water molecule. Many physiologically important compounds form by dehydration synthesis reactions, such as complex carbohydrates, proteins, DNA, and RNA.
Synthesis of carbohydrates
Sugar molecules are covalently linked together by dehydration synthesis. During the reaction, the hydroxyl (-OH) group from...
149.1K
Synthesis and Decomposition Reactions
38.1K
Synthesis and decomposition are two types of redox reactions. Synthesis means to make something, whereas decomposition means to break something. The reactions are accompanied by chemical and energy changes.
38.1K
Neural Regulation
43.3K
Digestion begins with a cephalic phase that prepares the digestive system to receive food. When our brain processes visual or olfactory information about food, it triggers impulses in the cranial nerves innervating the salivary glands and stomach to prepare for food.
43.3K
Lagging Strand Synthesis
61.0K
During replication, the complementary strands in double-stranded DNA are synthesized at different rates. Replication first begins on the leading strand. Replication starts later, occurs more slowly, and proceeds discontinuously on the lagging strand.
There are several major differences between synthesis of the leading strand and synthesis of the lagging strand. 1) Leading strand synthesis happens in the direction of replication fork opening, whereas lagging strand synthesis happens in the...
There are several major differences between synthesis of the leading strand and synthesis of the lagging strand. 1) Leading strand synthesis happens in the direction of replication fork opening, whereas lagging strand synthesis happens in the...
61.0K
Transfer RNA Synthesis
13.3K
One of the unique features of tRNA is the presence of modified bases. In some tRNAs, modified bases account for nearly 20% of the total bases in the molecule. Altogether, these unusual bases protect the tRNA from enzymatic degradation by RNases.
Each of these chemical modifications is carried by a specific enzyme, post-transcription. All of these enzymes have unique base and site-specificity. Methylation, the most common chemical modification, is carried by at least nine different enzymes, with...
Each of these chemical modifications is carried by a specific enzyme, post-transcription. All of these enzymes have unique base and site-specificity. Methylation, the most common chemical modification, is carried by at least nine different enzymes, with...
13.3K
Peptidoglycan Synthesis
2.3K
Structure of PeptidoglycanPeptidoglycan is a vital structural component of the bacterial cell wall, providing mechanical strength and shape to the cell. It consists of repeating units of two sugars—N-acetylglucosamine (NAG) and N-acetylmuramic acid (NAM)—linked by β-1,4 glycosidic bonds. These sugar chains are cross-linked by short peptide chains, forming a mesh-like polymer that surrounds the bacterial plasma membrane.Cytoplasmic Phase – Precursor SynthesisPeptidoglycan...
2.3K


