ERNIE-RNA:一种具有结构增强表示的RNA语言模型
Weijie Yin1, Zhaoyu Zhang1, Shuo Zhang1
1MOE Key Laboratory of Bioinformatics and Bioinformatics Division, Center for Synthetic and Systems Biology, Department of Automation, Beijing National Research Center for Information Science and Technology, Tsinghua University, Beijing, China.
Nature communications
|November 18, 2025
概括
ERNIE-RNA是一种新的RNA语言模型,集成了结构信息,用于增强RNA序列分析. 该模型在预测RNA结构和功能方面实现了最先进的性能.
科学领域:
- 计算生物学 计算生物学
- 生物信息学是一种生物信息学.
- 基因组学就是基因组学.
背景情况:
- 现有的RNA语言模型 (RLM) 往往忽略了RNA序列中的关键结构信息.
- 这种监督导致不完整的特征提取和在各种生物任务上低于最佳的性能.
研究的目的:
- 引入ERNIE-RNA,一种增强的RNA语言模型,包含基配对限制.
- 为了证明ERNIE-RNA在捕获RNA结构特征和改善下游任务性能方面的卓越能力.
主要方法:
- ERNIE-RNA是建立在一个修改的双向编码器表示从变压器 (BERT) 架构.
- 该模型利用注意力机制来捕获RNA结构信息,从而实现零射击预测.
主要成果:
- 与RNAfold和RNAstructure等传统方法相比,ERNIE-RNA的注意力图显示了捕获RNA结构特征的增强能力.
- 精心调整的ERNIE-RNA在RNA结构和功能预测任务中取得了最先进的结果.
- 该模型展示了在预训练期间全面RNA架构表示的自然发展.
结论:
- ERNIE-RNA为各种RNA研究应用提供了多功能功能.
- 将基于知识的先验集成到类似BERT的框架中,可以显著提高生物序列的语言模型性能.
相关概念视频
RNA Structure
78.7K
Overview
The basic structure of RNA consists of a five-carbon sugar and one of four nitrogenous bases. Although most RNA is single-stranded, it can form complex secondary and tertiary structures. Such structures play essential roles in the regulation of transcription and translation.
Different Types of RNA Have the Same Basic Structure
There are three main types of ribonucleic acid (RNA): messenger RNA (mRNA), transfer RNA (tRNA), and ribosomal RNA (rRNA). All three RNA types consist of a...
The basic structure of RNA consists of a five-carbon sugar and one of four nitrogenous bases. Although most RNA is single-stranded, it can form complex secondary and tertiary structures. Such structures play essential roles in the regulation of transcription and translation.
Different Types of RNA Have the Same Basic Structure
There are three main types of ribonucleic acid (RNA): messenger RNA (mRNA), transfer RNA (tRNA), and ribosomal RNA (rRNA). All three RNA types consist of a...
78.7K
RNA Structure
7.0K
The basic structure of RNA consists of a string of ribonucleotides attached by phosphodiester bonds. Although most RNA is single-stranded, it can form complex secondary and tertiary structures. Such structures play essential roles in the regulation of transcription and translation.
Different Types of RNA Have the Same Basic Structure
There are three main types of ribonucleic acid (RNA) involved in protein synthesis: messenger RNA (mRNA), transfer RNA (tRNA), and ribosomal RNA (rRNA). All three...
Different Types of RNA Have the Same Basic Structure
There are three main types of ribonucleic acid (RNA) involved in protein synthesis: messenger RNA (mRNA), transfer RNA (tRNA), and ribosomal RNA (rRNA). All three...
7.0K
RNA-seq
11.7K
RNA sequencing, or RNA-Seq, is a high-throughput sequencing technology used to study the transcriptome of a cell. Transcriptomics helps to interpret the functional elements of a genome and identify the molecular constituents of an organism. Additionally, it also helps in understanding the development of an organism and the occurrence of diseases.
Before the discovery of RNA-seq, microarray-based methods and Sanger sequencing were used for transcriptome analysis. However, while...
Before the discovery of RNA-seq, microarray-based methods and Sanger sequencing were used for transcriptome analysis. However, while...
11.7K
Nucleic Acid Structure
8.4K
The pentose sugar in DNA is deoxyribose, while in RNA the pentose sugar is ribose. The difference between the sugars is the presence of the hydroxyl group on the ribose's second carbon and a hydrogen on the deoxyribose's second carbon. The phosphate residue attaches to the hydroxyl group of the 5′ carbon of one sugar and the hydroxyl group of the 3′ carbon of the sugar of the next nucleotide, which forms a 5′ to 3′ phosphodiester linkage.
DNA Structure
DNA...
DNA Structure
DNA...
8.4K
RNA Stability
35.6K
Intact DNA strands can be found in fossils, while scientists sometimes struggle to keep RNA intact under laboratory conditions. The structural variations between RNA and DNA underlie the differences in their stability and longevity. Because DNA is double-stranded, it is inherently more stable. The single-stranded structure of RNA is less stable but also more flexible and can form weak internal bonds. Additionally, most RNAs in the cell are relatively short, while DNA can be up to 250 million...
35.6K
RNA Editing
9.7K
RNA editing is a post-transcriptional modification where a precursor mRNA (pre-mRNA) nucleotide sequence is changed by base insertion, deletion, or modification. The extent of RNA editing varies from a few hundred bases, in mitochondrial DNA of trypanosomes, to a just single base, in nuclear genes of mammals. Even a single base change in the pre-mRNA can convert a codon for one amino acid into the codon for another amino acid or a stop codon. This type of re-coding can significantly affect the...
9.7K


