MetaTransformer:使用自我注意模型进行深度元基因组测序阅读分类.
Alexander Wichmann1, Etienne Buschong1, André Müller1
1Institute of Computer Science, Johannes Gutenberg University, Staudingerweg 9, 55128 Mainz, Rhineland-Palatinate, Germany.
NAR genomics and bioinformatics
|September 14, 2023
概括
新的深度学习工具MetaTransformer增强了元基因组分析. 与DeepMicrobes相比,它使用自我注意模型进行更快,更有效的记忆物种和属分类.
科学领域:
- 计算生物学是一种计算生物学.
- 基因组学就是基因组学.
- 机器学习是机器学习.
背景情况:
- 深度学习,特别是变压器,在分析基因组序列方面表现有前途.
- 像DeepMicrobes这样的现有工具面临着缓慢运行时间和高内存使用的挑战.
- 超基因组分析需要有效和准确的分类学预测.
研究的目的:
- 介绍MetaTransformer,这是一个用于元基因组分析的新型深度学习工具.
- 提高现有的分类学分类器的速度和内存效率.
- 评估变压器-编码器模型和嵌入方案在元基因组学中的性能.
主要方法:
- 开发了MetaTransformer,这是一个基于自我注意的深度学习工具,利用变压器-编码器模型.
- 研究了不同的嵌入方案,以优化内存消耗和性能.
- 将MetaTransformer与DeepMicrobes的性能进行了比较,以分类物种和属.
主要成果:
- 与DeepMicrobes相比,MetaTransformer实现了更高的物种和品种分类准确度.
- 该工具在较小的内存足迹下,证明了推理时间的2×到5×加快.
- 对于MetaTransformer的训练时间为9小时的属性和16小时的物种预测.
结论:
- 自我注意力模型显著提高了深度学习中的表现,用于元基因组分析.
- "MetaTransformer"提供了一种高效准确的解决方案,用于在元基因组学中进行分类学预测.
- 嵌入方案在优化基因组数据的深度学习模型方面发挥着至关重要的作用.
相关概念视频
02:07Improving Translational Accuracy
11.5K
Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...
11.5K
01:30Classification of Signals
519
In signal processing, signals are classified based on various characteristics: continuous-time versus discrete-time, periodic versus aperiodic, analog versus digital, and causal versus noncausal. Each category highlights distinct properties crucial for understanding and manipulating signals.
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
519
01:30Classification of Neurotransmitters
3.0K
Neurotransmitters play a crucial role in the communication between neurons in the autonomic nervous system. Neurons in the autonomic nervous system can be cholinergic or adrenergic depending on the neurotransmitters synthesized. Cholinergic neurons use acetylcholine as their primary neurotransmitter. This includes all the preganglionic fibers of the sympathetic and pre- and postganglionic fibers of the parasympathetic nervous systems. In addition, neurons of the somatic nervous system also use...
3.0K
03:21RNA-seq
10.0K
RNA sequencing, or RNA-Seq, is a high-throughput sequencing technology used to study the transcriptome of a cell. Transcriptomics helps to interpret the functional elements of a genome and identify the molecular constituents of an organism. Additionally, it also helps in understanding the development of an organism and the occurrence of diseases.
Before the discovery of RNA-seq, microarray-based methods and Sanger sequencing were used for transcriptome analysis. However, while...
Before the discovery of RNA-seq, microarray-based methods and Sanger sequencing were used for transcriptome analysis. However, while...
10.0K