Related Experiment Video
Updated: May 22, 2026
09:06
High-throughput Identification of Gene Regulatory Sequences Using Next-generation Sequencing of Circular Chromosome Conformation Capture (4C-seq)
Published on: October 5, 2018
Handling the data management needs of high-throughput sequencing data: SpeedGene, a compression algorithm for the
Dandi Qiao1, Wai-Ki Yip, Christoph Lange
1Department of Biostatistics, Harvard School of Public Health, Boston, Massachusetts, USA. dqiao@hsph.harvard.edu
BMC Bioinformatics
|May 18, 2012
Summary
A new algorithm offers significant compression for next-generation sequencing (NGS) data, reducing large genetic datasets to manageable sizes. This method allows for faster data loading without decompression, making advanced genomic analysis accessible on current hardware.
Area of Science:
- Genomics
- Bioinformatics
- Computational Biology
Background:
- Next-generation sequencing (NGS) generates massive datasets, overwhelming current storage and computational capacities.
- Existing data compression methods for genetic data offer insufficient compression rates or demand excessive CPU time for decompression.
- Researchers frequently encounter storage and processing challenges with large-scale genetic data.
Purpose of the Study:
- To introduce a novel and efficient algorithm for storing and managing large-scale next-generation sequencing data.
- To address the limitations of current storage and compression techniques in bioinformatics.
- To enable the analysis of massive genomic datasets on existing hardware infrastructure.
Main Methods:
- Development of a simple, novel algorithm for sequencing data compression.
- Implementation of the algorithm in C++ for direct loading and parallel processing.
- Validation using simulated and real-world next-generation sequencing datasets.
Main Results:
- Achieved compression factors ranging from 16 to several hundred, reducing Gigabytes of SNP data to Megabytes.
- Demonstrated faster data loading times compared to existing compression methods, with no extra decompression time.
- The C++ library facilitates direct data retrieval for integration with other programs.
Conclusions:
- The SpeedGene algorithm facilitates the storage and analysis of next-generation sequencing data within current hardware limitations.
- Eliminates the need for costly system upgrades for handling large genomic datasets.
- Enhances accessibility and efficiency in genomic data processing and analysis.
Related Concept Videos
02:54Evolutionary Relationships through Genome Comparisons
Genome comparison is one of the excellent ways to interpret the evolutionary relationships between organisms. The basic principle of genome comparison is that if two species share a common feature, it is likely encoded by the DNA sequence conserved between both species. The advent of genome sequencing technologies in the late 20th century enabled scientists to understand the concept of conservation of domains between species and helped them to deduce evolutionary relationships across diverse...
03:00Next-generation Sequencing
The first human genome sequencing project cost $2.7 billion and was declared complete in 2003, after 15 years of international cooperation and collaboration between several research teams and funding agencies. Today, with the advent of next-generation sequencing technologies, the cost and time of sequencing a human genome have dropped over 100 fold.
Next-Generation Sequencing Methods
Although all next-generation methods use different technologies, they all share a set of standard features.
Next-Generation Sequencing Methods
Although all next-generation methods use different technologies, they all share a set of standard features.
01:57Sanger Sequencing
DNA sequencing is a fundamental technique that is routinely used in the biological sciences. This method can be applied to a range of questions at different scales - from the sequencing of a cloned DNA fragment or the study of a mutation in a gene up to whole-genome sequencing. However, despite the widespread use of sequencing today, it was not until 1977 that Fredrick Sanger and his collaborators developed the chain-termination method to decode DNA sequences. It relies on the separation of a...
02:02Genomics
Genomics is the science of genomes: it is the study of all the genetic material of an organism. In humans, the genome consists of information carried in 23 pairs of chromosomes in the nucleus, as well as mitochondrial DNA. In genomics, both coding and non-coding DNA is sequenced and analyzed. Genomics allows a better understanding of all living things, their evolution, and their diversity. It has a myriad of uses: for example, to build phylogenetic trees, to improve productivity and...
02:51Multi-species Conserved Sequences
Next-generation sequencing technologies have created large genomic databases of a variety of animals and plants. Ever since the human genome project was completed, scientists studied the genome of primates, mammals, and other phylogenetically distant living beings. Such large-scale studies have provided new insights into the evolutionary relationship between organisms.
Although the genome of each species varies greatly from each other, a few sequences are highly conserved. Such conserved DNA...
Although the genome of each species varies greatly from each other, a few sequences are highly conserved. Such conserved DNA...