基于多个序列对齐的RNA语言模型及其对结构推理的应用
Yikun Zhang1,2, Mei Lang3, Jiuhong Jiang3
1School of Electronic and Computer Engineering, Peking University, Shenzhen 518055, China.
Nucleic acids research
|November 9, 2023
概括
我们开发了RNA-MSM,一种使用多个序列对齐的无监督RNA语言模型,捕获结构信息并优于预测RNA结构和功能的现有方法.
科学领域:
- 计算生物学 计算生物学
- 生物信息学是一种生物信息学.
- 分子生物学分子生物学
背景情况:
- 与蛋白质相比,解释RNA序列具有挑战性,因为它们的信息含量较低.
- 现有的RNA语言模型,比如基于BERT的模型,很难从不太保全的RNA序列中捕获进化信息.
研究的目的:
- 开发一种无监督的RNA语言模型,有效地利用同源序列.
- 为了证明该模型可以捕获和表示RNA序列内的结构信息.
主要方法:
- 开发了RNA-MSM,这是一个无监督的基于多个序列对齐的RNA语言模型.
- 使用来自RNAcmap管道的同源序列进行训练.
- 评估了模型预测二维基配对概率和一维溶剂可访问性的能力.
主要成果:
- RNA-MSM的注意力图和嵌入包含结构信息,准确地绘制基配对和溶剂可访问性.
- 与最先进的方法相比,微调RNA-MSM显著提高了下游任务的性能.
- 基于BERT的RNA-FM模型的性能比结构预测的简单方法要差.
结论:
- RNA-MSM为RNA序列分析和结构预测提供了一种强大的新方法.
- 预训练的RNA-MSM模型可以适应各种RNA结构和功能相关任务.
- 这种方法解决了现有的RNA语言模型在捕获进化和结构信息方面的局限性.
相关概念视频
Nucleic Acid Structure
6.2K
The pentose sugar in DNA is deoxyribose, while in RNA the pentose sugar is ribose. The difference between the sugars is the presence of the hydroxyl group on the ribose's second carbon and a hydrogen on the deoxyribose's second carbon. The phosphate residue attaches to the hydroxyl group of the 5′ carbon of one sugar and the hydroxyl group of the 3′ carbon of the sugar of the next nucleotide, which forms a 5′ to 3′ phosphodiester linkage.
DNA Structure
DNA...
DNA Structure
DNA...
6.2K
RNA Structure
4.8K
The basic structure of RNA consists of a string of ribonucleotides attached by phosphodiester bonds. Although most RNA is single-stranded, it can form complex secondary and tertiary structures. Such structures play essential roles in the regulation of transcription and translation.
Different Types of RNA Have the Same Basic Structure
There are three main types of ribonucleic acid (RNA) involved in protein synthesis: messenger RNA (mRNA), transfer RNA (tRNA), and ribosomal RNA (rRNA). All three...
Different Types of RNA Have the Same Basic Structure
There are three main types of ribonucleic acid (RNA) involved in protein synthesis: messenger RNA (mRNA), transfer RNA (tRNA), and ribosomal RNA (rRNA). All three...
4.8K
Nucleic Acids
44.3K
Nucleic acids are the most important macromolecules for the continuity of life. They carry the cell's genetic blueprint and carry instructions for its functioning.
DNA and RNA
The two main types of nucleic acids are deoxyribonucleic acid (DNA) and ribonucleic acid (RNA). DNA is the genetic material in all living organisms, ranging from single-celled bacteria to multicellular mammals. It is in the nucleus of eukaryotes and in the organelles, chloroplasts, and mitochondria. In prokaryotes,...
DNA and RNA
The two main types of nucleic acids are deoxyribonucleic acid (DNA) and ribonucleic acid (RNA). DNA is the genetic material in all living organisms, ranging from single-celled bacteria to multicellular mammals. It is in the nucleus of eukaryotes and in the organelles, chloroplasts, and mitochondria. In prokaryotes,...
44.3K
Leaky Scanning
5.1K
During most eukaryotic translation processes, the small 40S ribosome subunit scans an mRNA from its 5' end until it encounters the first start AUG codon. The large 60S ribosomal subunit then joins the smaller one to initiate protein synthesis. The location of the translation initiation is largely determined by the nucleotides near the start codon as there may be multiple translation initiation sites present on the mRNA. Marilyn Kozak discovered that the sequence RCCAUGG (where R...
5.1K
Nucleic acids
163.3K
Nucleic acids are the most important macromolecules for the continuity of life. They carry the cell's genetic blueprint and carry instructions for its functioning.
DNA and RNA
The two main types of nucleic acids are deoxyribonucleic acid (DNA) and ribonucleic acid (RNA). DNA is the genetic material in all living organisms, ranging from single-celled bacteria to multicellular mammals. It is in the nucleus of eukaryotes and in the organelles, chloroplasts, and mitochondria. In prokaryotes,...
DNA and RNA
The two main types of nucleic acids are deoxyribonucleic acid (DNA) and ribonucleic acid (RNA). DNA is the genetic material in all living organisms, ranging from single-celled bacteria to multicellular mammals. It is in the nucleus of eukaryotes and in the organelles, chloroplasts, and mitochondria. In prokaryotes,...
163.3K
RNA-seq
10.0K
RNA sequencing, or RNA-Seq, is a high-throughput sequencing technology used to study the transcriptome of a cell. Transcriptomics helps to interpret the functional elements of a genome and identify the molecular constituents of an organism. Additionally, it also helps in understanding the development of an organism and the occurrence of diseases.
Before the discovery of RNA-seq, microarray-based methods and Sanger sequencing were used for transcriptome analysis. However, while...
Before the discovery of RNA-seq, microarray-based methods and Sanger sequencing were used for transcriptome analysis. However, while...
10.0K


