GenVarLoader:一种加速的数据加载器,用于将深度学习应用到个性化的基因组学中
David Laub1, Aaron Ho2, Jeff Jaureguy1,2
1Bioinformatics and Systems Biology Program, University of California, San Diego, La Jolla, CA, 92093.
bioRxiv : the preprint server for biology
|January 27, 2025
概括
基因组数据处理由GenVarLoader加速,GenVarLoader是一个新的工具,它增强了用于变异效应预测的深度学习模型. 它为个性化基因组学数据集实现了显著的速度和压缩改进.
科学领域:
- 基因组学就是基因组学.
- 生物信息学是一种生物信息学.
- 机器学习 机器学习
背景情况:
- 深度学习序列模型显示了使用个性化基因组学数据预测变异效应的前景.
- 目前的应用程序受到数据存储和检索的大量计算需求的阻碍.
研究的目的:
- 介绍GenVarLoader,这是一个新的系统,旨在克服个性化基因组学数据处理中的计算限制.
- 提高深度学习模型用于变量效应预测的效率.
主要方法:
- 开发GenVarLoader,使用新的内存映射格式来个性化基因组数据.
- 优化数据的位置,以实现高效的存储和检索.
- 与现有的数据存储和访问方法进行比较.
主要成果:
- 与现有的替代方案相比,GenVarLoader 实现了大约 1000 倍更快的吞吐量.
- 该系统显示了大约2000倍更好的压缩比.
- 在大型基因组数据集上更有效地应用深度学习模型.
结论:
- GenVarLoader显著提高了处理个性化基因组数据的计算效率.
- 该工具促进了先进的深度学习模型的实际应用,用于变量效应预测.
- 解决了用于机器学习应用的基因组学数据管理中的关键瓶.
更多相关视频
08:03Heuristic Mining of Hierarchical Genotypes and Accessory Genome Loci in Bacterial Populations
Published on: December 7, 2021
2.1K
09:34A Virtual Machine Platform for Non-Computer Professionals for Using Deep Learning to Classify Biological Sequences of Metagenomic Data
Published on: September 25, 2021
3.9K
相关概念视频
02:02Genomics
35.8K
Genomics is the science of genomes: it is the study of all the genetic material of an organism. In humans, the genome consists of information carried in 23 pairs of chromosomes in the nucleus, as well as mitochondrial DNA. In genomics, both coding and non-coding DNA is sequenced and analyzed. Genomics allows a better understanding of all living things, their evolution, and their diversity. It has a myriad of uses: for example, to build phylogenetic trees, to improve productivity and...
35.8K
02:54Evolutionary Relationships through Genome Comparisons
5.7K
Genome comparison is one of the excellent ways to interpret the evolutionary relationships between organisms. The basic principle of genome comparison is that if two species share a common feature, it is likely encoded by the DNA sequence conserved between both species. The advent of genome sequencing technologies in the late 20th century enabled scientists to understand the concept of conservation of domains between species and helped them to deduce evolutionary relationships across diverse...
5.7K