评估调控基因组学预训练的DNA语言模型的表示能力
Ziqi Tang1, Nirali Somia1, Yiyang Yu2
1Simons Center for Quantitative Biology, Cold Spring Harbor Laboratory, NY, USA.
bioRxiv : the preprint server for biology
|March 11, 2024
概括
基因组语言模型 (gLMs) 对于理解基因调节有前途. 然而,与传统方法相比,当前的预培训策略可能无法显著改善细胞类型特定基因组学任务的预测.
科学领域:
- 计算生物学 计算生物学
- 基因组学就是基因组学.
- 机器学习 机器学习
背景情况:
- 基因组语言模型 (gLMs) 提供非编码基因组中cis-regulatory模式的无监督学习.
- 以前的研究表明,gLM可以提高监管基因组学任务的预测性能.
- 对于gLM表示能够捕捉基本的cis-regulatory生物学的能力仍然未被评估.
研究的目的:
- 评估预先训练有素的gLMs对预测和解释细胞类型特定的功能基因组学数据的表示能力.
- 将gLM性能与传统机器学习方法进行比较.
主要方法:
- 使用预训练的基因组语言模型 (gLMs).
- 在各种DNA和RNA调节数据集上评估了gLM表示.
- 与使用一热编码序列的传统机器学习模型进行性能比较.
主要成果:
- 对预先训练的gLM表示进行测试,与传统的机器学习方法相比,没有产生实质性的优势.
- 当使用gLMs进行细胞类型特定的功能基因组学预测时,性能增长最小.
- 这些发现表明目前的gLM预培训策略对非编码基因组的局限性.
结论:
- 目前的gLMs可能无法有效地捕捉特定基因组任务的复杂的cis-regulatory生物学.
- 传统的机器学习方法在分析功能基因组学数据方面仍然具有竞争力.
- 修改预培训策略对于在非编码基因组研究中推进gLMs至关重要.
相关概念视频
02:13Cooperative Binding of Transcription Regulators
6.4K
Transcriptional regulators bind to specific cis-regulatory sequences in the DNA to regulate gene transcription. These cis-regulatory sequences are very short, usually less than ten nucleotide pairs in length. The short length means that there is a high probability of the exact same sequence randomly occurring throughout the genome. Since regulators can also bind to groups of similar sequences, this further increases the chances of random binding. Transcriptional regulators form...
6.4K
02:02Cis-regulatory Sequences
9.9K
Cis-regulatory sequences are short fragments of non-coding DNA that are present on the same chromosomes as the genes that they regulate. These fragments serve as binding sites for transcriptional regulators, proteins that are responsible for controlling gene transcription and differential gene expression across cell types in eukaryotes. Cis-regulatory sequences can be close to the gene of interest or thousands of bases away in the DNA sequence; however, those sequences that are further away are...
9.9K
01:23Regulation of Expression at Multiple Steps
906
The gene expression in cells is regulated at different stages: (i) transcription, (ii) RNA processing, (iii) RNA localization, and (iv) translation. Transcriptional regulation is mediated by regulatory proteins such as transcription factors, activators, or repressors—these control gene expression by initiating or inhibiting the transcription of genes. Once a precursor or pre-mRNA is produced, it undergoes post-transcriptional modification, including 5' capping, splicing, and the...
906
02:23Master Transcription Regulators
6.9K
Master transcription regulators are regulatory proteins that are predominantly responsible for regulating the expression of multiple genes. Often these genes work in concert to drive a complex process. Activation of a master transcription regulator can lead to a cascade of transcriptional activation necessary for that outcome. These regulators can directly bind to the regulatory sequences of the various genes involved, or they can indirectly regulate transcription by binding to regulatory...
6.9K
02:24Regulation of Expression Occurs at Multiple Steps
22.7K
Gene expression can be regulated at almost every step from gene to protein. Transcription is the step that is most commonly regulated. This involves the binding of proteins to short regulatory sequences on the DNA. This association can either promote or inhibit the transcription of a gene associated with the respective sequence.
Transcription results in the generation of precursor (pre-mRNA) that consists of both exons and introns, which needs further processing before being translated to a...
Transcription results in the generation of precursor (pre-mRNA) that consists of both exons and introns, which needs further processing before being translated to a...
22.7K
02:05DNA as a Genetic Template
21.9K
Two structural features of the DNA molecule provide a basis for the mechanisms of heredity: the four nucleotide bases and its double-stranded nature. The Watson-Crick model of double-helical DNA structure, proposed in 1952, drew heavily upon the X-ray crystallography work of researchers Rosalind Franklin and Maurice Wilkins. Watson, Crick, and Wilkins jointly received the Nobel Prize in Physiology or Medicine for their work in 1962. Franklin was, controversially, excluded from the prize for...
21.9K