ARTreeFormer:一个更快的基于注意力的自回归模型,用于遗传学推断
Tianyu Xie1, Yicong Mao2, Cheng Zhang1,3
1School of Mathematical Sciences, Peking University, Beijing, China.
PLoS computational biology
|December 4, 2025
概括
这项研究介绍了ARTreeFormer,这是一种使用深度学习进行基因推理的更快方法. 它通过使用固定点代和注意力机制加速树拓建模,提高大数据集的可扩展性.
科学领域:
- 计算生物学 计算生物学
- 进化生物学 进化生物学
- 机器学习 机器学习
背景情况:
- 遗传学推断在建模大树拓空间方面面临着挑战.
- 像ARTree这样的现有方法提供了灵活性,但由于计算效率低下,难以扩展.
- 需要更快,更可扩展的概率模型来推断家族遗传树.
研究的目的:
- 开发一种新的深度学习方法,ARTreeFormer,以加速家族遗传树拓建模.
- 为了提高自回归模型的计算效率,用于基因推断.
- 保持高近似性能,同时显著提高大数据集的速度.
主要方法:
- 引入了ARTreeFormer,它结合了固定点代和注意力机制.
- 开发了一种固定点代算法,用于快速,向量化计算拓节点嵌入,优化为CUDA.
- 实施了基于注意力的全球信息传递方案,以实现高效的代表性学习.
主要成果:
- ARTreeFormer显著加速了ARTree的计算速度.
- 该方法在挑战现实世界的基因推理问题方面表现出有效性和效率.
- 保持了与现有方法相比的优异近似性能.
结论:
- ARTreeFormer提供了一个可扩展和高效的解决方案,用于树木拓的概率模型.
- 固定点代和注意力机制的整合克服了以前自回归模型的可扩展性限制.
- 这一进步有可能对大规模的遗传学分析产生重大影响.
相关概念视频
Gene Evolution - Fast or Slow?
7.9K
The genomes of eukaryotes are punctuated by long stretches of sequence which do not code for proteins or RNAs. Although some of these regions do contain crucial regulatory sequences, the vast majority of this DNA serves no known function. Typically, these regions of the genome are the ones in which the fastest change, in evolutionary terms, is observed, because there is typically little to no selection pressure acting on these regions to preserve their sequences.
In contrast, regions which code...
In contrast, regions which code...
7.9K
Gene Evolution - Fast or Slow?
3.4K
3.4K
Phylogenetic Trees
49.1K
Phylogenetic trees come in many forms. It matters in which sequence the organisms are arranged from the bottom to the top of the tree, but the branches can rotate at their nodes without altering the information. The lines connecting individual nodes can be straight, angled, or even curved.
49.1K
Evolutionary Relationships through Genome Comparisons
6.8K
Genome comparison is one of the excellent ways to interpret the evolutionary relationships between organisms. The basic principle of genome comparison is that if two species share a common feature, it is likely encoded by the DNA sequence conserved between both species. The advent of genome sequencing technologies in the late 20th century enabled scientists to understand the concept of conservation of domains between species and helped them to deduce evolutionary relationships across diverse...
6.8K
Phylogeny
56.6K
Phylogeny is concerned with the evolutionary diversification of organisms or groups of organisms. A group of organisms with a name is called a taxon (singular). Taxa (plural) can span different levels of the evolutionary hierarchy. For instance, the group containing all birds is a taxon (comprising the class Aves), and the group of all species of daisies (the genus Bellis) is a taxon. Phylogenies can likewise include just one genus (i.e., depict species relationships) or span an entire kingdom.
56.6K
The Tree of Life - Bacteria, Archaea, Eukaryotes
37.5K
The “tree of life” describes the evolution of life and the evolutionary relationships between organisms. The root of the tree is the common ancestor to all life on Earth. All other species radiate from this point, much like the branches of a tree. The numerous tips of these branches on the tree of life represent every living, or extant, species. Extinct species, which are species that no longer exist, can be found towards the center of the tree. Currently, these organisms, both...
37.5K


