Retentive Network促进了长序列的高效RNA语言建模
Yi Shen1, Guangshuo Cao2, Yueming Hu1
1Department of Bioinformatics, College of Life Sciences, Zhejiang University, Hangzhou, China.
Communications biology
|March 12, 2026
概括
RNAret,一种新的RNA语言模型,克服了长RNA序列的变压器限制. 这种高效的模型在预测RNA相互作用,结构和分类方面表现出色,推进了RNA生物学理解.
科学领域:
- 计算生物学 计算生物学
- 生物信息学是一种生物信息学.
- 基因组学就是基因组学.
背景情况:
- RNA序列的潜在特征对于理解它们的功能至关重要.
- 变压器模型广泛用于核酸语言建模,但具有O(n2) 复杂性,限制了长序列处理.
研究的目的:
- 提出RNAret,一个高效的RNA语言模型,具有O (n) 复杂度.
- 为了实现长RNA序列的有效处理,用于特征提取和生物见解.
主要方法:
- 开发基于保留网络机制的RNAret.
- 在2980万个RNA序列上使用自我监督的蒙面语言建模预训RNAret.
- 实现了训练并行性,低计算开销和长序列处理.
主要成果:
- RNAret在RNA-RNA相互作用预测方面表现出卓越的性能.
- 在RNA二次结构预测方面取得了高精度.
- 在mRNA/lncRNA分类任务中表现出有效性.
结论:
- RNAret是一个强大的RNA语言模型,具有O (n) 复杂度,适合长序列.
- 该模型有效地从RNA序列中提取潜在特征.
- RNAret对于推进RNA生物学研究具有显著的潜力.
相关概念视频
RNA-seq
12.4K
RNA sequencing, or RNA-Seq, is a high-throughput sequencing technology used to study the transcriptome of a cell. Transcriptomics helps to interpret the functional elements of a genome and identify the molecular constituents of an organism. Additionally, it also helps in understanding the development of an organism and the occurrence of diseases.
Before the discovery of RNA-seq, microarray-based methods and Sanger sequencing were used for transcriptome analysis. However, while...
Before the discovery of RNA-seq, microarray-based methods and Sanger sequencing were used for transcriptome analysis. However, while...
12.4K
RNA Structure
29.7K
29.7K
RNA Structure
79.9K
Overview
The basic structure of RNA consists of a five-carbon sugar and one of four nitrogenous bases. Although most RNA is single-stranded, it can form complex secondary and tertiary structures. Such structures play essential roles in the regulation of transcription and translation.
Different Types of RNA Have the Same Basic Structure
There are three main types of ribonucleic acid (RNA): messenger RNA (mRNA), transfer RNA (tRNA), and ribosomal RNA (rRNA). All three RNA types consist of a...
The basic structure of RNA consists of a five-carbon sugar and one of four nitrogenous bases. Although most RNA is single-stranded, it can form complex secondary and tertiary structures. Such structures play essential roles in the regulation of transcription and translation.
Different Types of RNA Have the Same Basic Structure
There are three main types of ribonucleic acid (RNA): messenger RNA (mRNA), transfer RNA (tRNA), and ribosomal RNA (rRNA). All three RNA types consist of a...
79.9K
RNA Structure
8.0K
The basic structure of RNA consists of a string of ribonucleotides attached by phosphodiester bonds. Although most RNA is single-stranded, it can form complex secondary and tertiary structures. Such structures play essential roles in the regulation of transcription and translation.
Different Types of RNA Have the Same Basic Structure
There are three main types of ribonucleic acid (RNA) involved in protein synthesis: messenger RNA (mRNA), transfer RNA (tRNA), and ribosomal RNA (rRNA). All three...
Different Types of RNA Have the Same Basic Structure
There are three main types of ribonucleic acid (RNA) involved in protein synthesis: messenger RNA (mRNA), transfer RNA (tRNA), and ribosomal RNA (rRNA). All three...
8.0K
lncRNA - Long Non-coding RNAs
10.1K
In humans, more than 80% of the genome gets transcribed. However, only around 2% of the genome codes for proteins. The remaining part produces non-coding RNAs which includes ribosomal RNAs, transfer RNAs, telomerase RNAs, and regulatory RNAs, among other types. A large number of regulatory non-coding RNAs have been classified into two groups depending upon their length – small non-coding RNAs, such as microRNA, which are less than 200 nucleotides in length, and long non-coding RNA...
10.1K
lncRNA - Long Non-coding RNAs
3.8K
3.8K


