从大脑记录中重建生成性语言
Ziyi Ye1, Qingyao Ai1, Yiqun Liu2
1Tsinghua University, Beijing, China.
Communications biology
|March 2, 2025
概括
这项研究引入了一种新的方法,利用大语言模型 (LLM) 来从大脑活动中重建语言. 这种生成方法提高了准确性,并从功能磁共振成像 (fMRI) 数据中重建了较长的语言刺激.
科学领域:
- 神经科学是一个神经科学.
- 认知科学 认知科学
- 人工智能的人工智能
背景情况:
- 从非侵入性大脑记录中重建语言是一个重大挑战.
- 以前的方法依赖于预先定义的语言候选人的分类.
研究的目的:
- 开发一种使用大型语言模型 (LLM) 的自动回归生成来进行语言重建的新方法.
- 改进重建语言与原始刺激的调整,特别是对于令人惊的内容.
- 为了使大脑记录的扩展语言刺激的重建.
主要方法:
- 使用了功能磁共振成像 (fMRI) 数据.
- 采用使用LLM的自动回归生成方法,直接将解码的大脑表示作为输入.
- 将生成方法与基于分类的方法进行比较.
主要成果:
- 与分类方法相比,生成方法产生了与刺激更紧密地结合的语言重建.
- 这种方法成功地重建了10分钟的语言刺激.
- 该方法表现出与现有技术相比或优于现有技术的性能,并可以估计语义内容生成的可能性.
结论:
- 这项研究证实了脑语言接口在生成框架中的有效性.
- 这种方法提供了一种强大而有效的方法来绘制大脑中的功能语言表示.
- 生成式设置克服了基于脑的语言重建的基于候选人分类的局限性.
相关概念视频
01:10Higher Mental Functions of the Brain: Language
707
Language is a system of communication that allows the expression of thoughts, ideas, and feelings. The brain processes language in both hemispheres.
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
707
01:27Language and Cognition
313
Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.
313