PLPMpro:通过基于即时学习的预先训练的语言模型来增强促销器序列预测.
Zhongshen Li1, Junru Jin1, Wentao Long1
1School of Software, Shandong University, Jinan 250101, China; Joint SDU-NTU Centre for Artificial Intelligence Research (C-FAIR), Shandong University, Jinan 250101, China.
Computers in biology and medicine
|August 9, 2023
概括
本研究介绍了PLPMpro,这是一个使用预训练语言模型 (PLM) 进行快速学习的新型模型,用于准确的促进器序列预测. 通过优于现有的方法,PLPMpro显著增强了基因转录分析.
科学领域:
- 生物信息学是一种生物信息学.
- 计算生物学 计算生物学
- 基因组学就是基因组学.
背景情况:
- 促进区域对于基因转录启动至关重要,使其准确的识别成为关键的生物信息学挑战.
- 虽然预训练语言模型 (PLMs) 显示出促进者预测的希望,但它们的全部潜力尚未实现.
研究的目的:
- 介绍PLPMpro,一种新型模型,利用PLM的快速学习来改善促进器序列预测.
- 证明快速学习在增强生物序列分析的PLM能力方面的有效性.
主要方法:
- 开发了PLPMpro,这是一个与预先训练的语言模型整合快速学习的模型.
- 进行了实验,以评估PLPMpro的性能与现有的促进者预测方法相比.
- 对快速学习设置和软模块配置进行了详细分析.
- 利用解释实验来评估预训练模型捕获的生物相关性.
主要成果:
- PLPMpro显著提高了促进子序列的预测准确度.
- 该模型与基于PLM的标准深度学习方法相比,在促进器预测方面表现优越.
- 快速学习被证明有效地提高了PLM的预测能力.
- 解释实验证实PLM能够捕捉到底层的生物语义.
结论:
- 快速学习提供了一种强大的方法来最大限度地提高PLM在生物信息学中的实用性.
- PLPMpro代表了促进者预测的重大进步,为将PLM应用于生物学问题提供了新的视角.
更多相关视频
相关概念视频
02:07Improving Translational Accuracy
11.6K
Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...
11.6K
02:40The Eukaryotic Promoter Region
3.1K
3.1K
01:22Language Development
395
Children master language quickly and with relative ease, supported by both biological predisposition and reinforcement. B. F. Skinner (1957) proposed that language is learned through reinforcement, while Noam Chomsky (1965) argued that language acquisition mechanisms are biologically determined.
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
395
01:26Per-Unit Sequence Models
94
An ideal Y-Y transformer, grounded through neutral impedances, displays per-unit sequence networks akin to those of a single-phase ideal transformer when subjected to balanced positive- or negative-sequence currents. These currents do not produce neutral currents, and their associated voltage drops.
Zero-sequence currents, which are identical in magnitude and phase, generate a neutral current, resulting in voltage drops across the neutral impedance and the low-voltage winding. If the...
Zero-sequence currents, which are identical in magnitude and phase, generate a neutral current, resulting in voltage drops across the neutral impedance and the low-voltage winding. If the...
94
01:47Transcription Initiation
16.5K
Initiation is the first step of transcription in eukaryotes. Prokaryotic RNA Polymerase (RNAP) can bind to the template DNA and start transcribing. On the other hand, transcription in eukaryotes requires additional proteins, called transcription factors, to first bind to the promoter region in the DNA template. This binding helps recruit the specific RNAP that can assemble on the DNA and start transcription.
The promoters and enhancers and their accessory proteins allow tight regulation of...
The promoters and enhancers and their accessory proteins allow tight regulation of...
16.5K
01:22Purposive Learning
142
E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a...
142