一个瞬间语音合成神经假体神经假体
Maitreyee Wairagkar1, Nicholas S Card1, Tyler Singer-Clark1,2
1Department of Neurological Surgery, University of California Davis, Davis, CA.
bioRxiv : the preprint server for biology
|September 4, 2024
概括
这项研究引入了一种脑对声音神经假体,该神经假体从大脑活动中合成了听起来自然的语音. 这种脑计算机接口 (BCI) 允许的人能够表达性地交流,克服了基于文本的系统的局限性.
科学领域:
- 神经科学是一个神经科学.
- 生物医学工程 生物医学工程
- 语音合成 语音合成
背景情况:
- 大脑计算机接口 (BCI) 为因神经疾病而言语音丧失的个体提供沟通恢复.
- 目前的BCI主要将神经活动转化为文本,缺少语音的表达性质,如语调和散音.
- 从神经信号直接合成语音可以提供一种更自然,更细微的沟通方法.
研究的目的:
- 为实时语音合成展示一种新的"脑到声音"神经假体.
- 解码神经活动,无论是语音内容和语言特征.
- 为了使严重语言障碍的个体能够通过BCI进行表达性沟通.
主要方法:
- 将256个微电极植入一个患有肌缩性侧面硬化症和重症关节障碍症的参与者的腹腔前中心环.
- 开发了一个神经解码器,将皮质内活动转化为合成语音.
- 集成的闭环音频反用于实时语音调制.
- 克服了训练解码器而没有基准真相语音数据的挑战.
主要成果:
- 从神经活动中成功合成可理解和表达的声音.
- 解码和合成 paralinguistic 功能,允许实时调制语调,强调和旋律.
- 实现了精确的语音合成,尽管没有预先录制的演讲训练.
- 证明了参与者使用BCI唱短旋律的能力.
结论:
- "大脑对声音"神经假体是一种可行的技术,可以恢复表达式语音.
- BCI可以解码复杂的神经信号以进行细微的发声,超越基于文本的通信.
- 这项技术具有很大的潜力,可以改善患者的沟通和生活质量.
相关概念视频
Nonconscious Mimicry
3.6K
Nonconscious mimicry occurs when individuals alter their mannerisms to match the behaviors and expressions of those nearby, without intention.
3.6K
Brainstem
7.5K
The brainstem, located inferior to the brain and superior to the spinal cord, serves as a bridge between the cerebrum and the spinal cord. It plays a vital role in relaying information and controlling critical life functions. It comprises three primary regions: the midbrain, pons, and medulla oblongata.
The Midbrain
The midbrain is located beneath the diencephalon and connects the cerebrum with the lower parts of the brain. The cerebral peduncles are prominent midbrain structures that house the...
The Midbrain
The midbrain is located beneath the diencephalon and connects the cerebrum with the lower parts of the brain. The cerebral peduncles are prominent midbrain structures that house the...
7.5K
Brain Waves
4.2K
Brain waves are electrical signals generated by the neurons in the brain, which are regularly monitored to measure mental activities. Brain waves and their frequency ranges can be measured using an electroencephalogram or EEG. There are four main types of brain waves, each with distinct characteristics:
4.2K
Higher Mental Functions of the Brain: Language
6.0K
Language is a system of communication that allows the expression of thoughts, ideas, and feelings. The brain processes language in both hemispheres.
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
6.0K
Neurons as Communicators of the Brain
5.4K
Neurons, the fundamental units of the brain and nervous system, function as the primary transmitters of information throughout the body. Their ability to communicate through electrical and chemical signals is vital for every bodily function, from regulating the heartbeat to processing complex thoughts. Each neuron has three main components: the cell body (soma), dendrites, and an axon, each specialized to facilitate swift and efficient neural communication.
Cell Body
The cell body, also known...
Cell Body
The cell body, also known...
5.4K
Subliminal Perception
1.1K
Subliminal perception refers to the processing of sensory information that occurs below the level of conscious awareness. Researchers study subliminal perception by presenting a stimulus, such as a word or image, very quickly, typically around 50 milliseconds. This rapid presentation is often followed by another stimulus, such as a pattern of dots or lines, which blocks further mental processing of the initial stimulus. As a result, if participants cannot identify the initial stimulus better...
1.1K


