ProtRNA:通过交叉模式转移学习的蛋白质衍生RNA语言模型
Ruoxi Zhang1, Ben Ma2, Gang Xu3
1Fudan University, Shanghai 200433, China.
Cell systems
|August 23, 2025
概括
研究人员将知识从蛋白质语言模型 (PLM) 转移到RNA,从而创建ProtRNA. 这种新的方法增强了RNA序列分析,用更少的数据和更少的参数获得了强有力的结果.
科学领域:
- 生物信息学
- 计算生物学
- 基因组学
背景情况:
- 像ESM-2这样的蛋白语言模型擅长分析蛋白序列.
- 由于RNA序列的有限性和保存性较低,RNA语言模型面临挑战.
- 生物序列模式之间的有效知识转移是一个开放的研究问题.
研究的目的:
- 调查PLM中的信息是否可以有效地转移到改善RNA序列分析.
- 开发一个解决低资源RNA数据挑战的模型.
- 在生物语言模型中评估跨模式转移学习的表现.
主要方法:
- 开发了一种采用跨模式转移学习策略的ProtRNA模型.
- 调整ESM-2蛋白语言模型以处理RNA序列.
- 从RNA数据中获取蛋白序列的进化和物理化学信息.
主要成果:
- 在各种下游RNA任务中,ProtRNA表现出同等或更高的性能.
- 与基线RNA语言模型相比,该模型使用的可训练参数 (1/8) 和训练数据 (1/6) 显著减少.
- 成功调整了一种高性能PLM用于"低资源"生物序列模式.
结论:
- 跨模式转移学习是增强RNA语言模型的可行和有效策略.
- ProtRNA展示了利用资源丰富的领域 (蛋白质) 的知识,以应对资源不足的领域 (RNA) 的挑战.
- 这种方法为开发更有效,更强大的生物语言模型提供了有希望的方向.
更多相关视频
05:48Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception
Published on: August 9, 2024
1.6K
08:05Measuring Statistical Learning Across Modalities and Domains in School-Aged Children Via an Online Platform and Neuroimaging Techniques
Published on: June 30, 2020
7.7K
相关概念视频
02:07Improving Translational Accuracy
2.7K
2.7K
02:35Transfer RNA Synthesis
2.9K
2.9K
01:22Language Development
447
Children master language quickly and with relative ease, supported by both biological predisposition and reinforcement. B. F. Skinner (1957) proposed that language is learned through reinforcement, while Noam Chomsky (1965) argued that language acquisition mechanisms are biologically determined.
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
447
01:27Language and Cognition
440
Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.
440
01:24Components of Language
392
Language, whether spoken, signed, or written, consists of specific components: lexicon and grammar. The lexicon is the vocabulary of a language, comprising its words. Grammar is the set of rules used to convey meaning through the lexicon. For example, English grammar adds “-ed” to most verbs to indicate past tense. Words are formed by combining phonemes, which are the basic sound units of a language. Different languages have different sets of phonemes (e.g., “ah” vs.
392
01:10Higher Mental Functions of the Brain: Language
1.0K
Language is a system of communication that allows the expression of thoughts, ideas, and feelings. The brain processes language in both hemispheres.
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
1.0K