FCLQC: fast and concurrent lossless quality scores compressor.
1Department of Electronic and Electrical Engineering, Hongik University, Seoul, Republic of Korea.
BMC Bioinformatics
|December 21, 2021
Summary
This study introduces a Fast and Concurrent Lossless Quality scores Compressor (FCLQC) for DNA sequencing data. FCLQC offers significant speed improvements for lossless compression and decompression while maintaining reasonable compression ratios.
Area of Science:
- Bioinformatics
- Computational Biology
- Genomics
Background:
- Sequencing technology advances have led to massive data growth.
- FASTQ files require efficient compression, especially quality scores.
- Lossless compression is crucial for clinical applications and archiving, but existing methods are slow.
Purpose of the Study:
- To develop a fast, lossless quality score compressor for FASTQ files.
- To enable random access functionality for compressed sequencing data.
- To address the time complexity limitations of current lossless compressors.
Main Methods:
- Development of a Fast and Concurrent Lossless Quality scores Compressor (FCLQC).
- Implementation using concurrent programming in Rust.
- Evaluation of compression speed, decompression speed, and compression ratio.
Main Results:
- FCLQC achieves significant speed improvements over baseline compressors (e.g., 31x faster than LCQS).
- It offers faster compression than general-purpose compressors (e.g., 7-zip) with better compression ratios.
- Random access decompression speed also outperforms existing methods, with performance scaling with the number of threads.
Conclusions:
- FCLQC is a practical lossless compressor for speed-sensitive DNA sequencing data applications.
- Its superior speed makes it suitable for time-critical bioinformatics workflows.
- The tool is available for non-commercial use.
Related Concept Videos
Downsampling
294
When considering a sampled sequence with zero values between sampling instants, one can replace it by taking every N-th value of the sequence. At these integer multiples of N, the original and sampled sequences coincide. This process, known as decimation, involves extracting every N-th sample from a sequence, thereby creating a more efficient sequence.
The Fourier transform of the decimated sequence reveals a combination of scaled and shifted versions of the original spectrum. This...
The Fourier transform of the decimated sequence reveals a combination of scaled and shifted versions of the original spectrum. This...
294
Lossy Lines and Overvoltages
141
Transmission-line series resistance and shunt conductance cause three primary effects: attenuation, distortion, and power losses.
Attenuation
When constant series resistance and shunt conductance are present, voltage and current equations are modified. The propagation constant indicates that voltage and current waves consist of both forward and backward traveling components. These waves attenuate as they propagate, with the attenuation factor related to the resistance and conductance. In a...
Attenuation
When constant series resistance and shunt conductance are present, voltage and current equations are modified. The propagation constant indicates that voltage and current waves consist of both forward and backward traveling components. These waves attenuate as they propagate, with the attenuation factor related to the resistance and conductance. In a...
141
Lossless Lines
191
In electrical engineering, a lossless transmission line is characterized by a purely imaginary propagation constant and a resistive characteristic impedance. The ABCD parameters, which describe the relationship between the input and output voltages and currents, indicate an equivalent π circuit with an imaginary series impedance and a shunt admittance. This results in a transmission line that, when the product of the phase constant (beta) and the length of the line is less than pi,...
191
Upsampling
349
Managing signal sampling rates is essential in digital signal processing to maintain signal integrity. A decimated signal, characterized by a reduced frequency range due to its lower sampling rate, can be upsampled by inserting zeros between each sample. This upsampling process expands the original spectrum and introduces repeated spectral replicas at intervals dictated by the new Nyquist frequency. To refine this zero-inserted sequence, it is passed through a lowpass filter with a cutoff...
349
Reducing Line Loss
215
In a three-phase circuit, line loss is an indicator of energy dissipated as heat due to the resistance of transmission lines. To address this, incorporating transformers into the system—a step-up transformer at the source and a step-down transformer at the load—is a strategic solution. Two three-phase transformers are introduced to improve this.
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss...
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss...
215
Traveling Waves: Lossless Lines
215
The provided content explores the behavior of traveling waves on single-phase lossless transmission lines. It begins with a single-phase two-wire lossless transmission line of length Δx, characterized by a loop inductance LH/m and a line-to-line capacitance C F/m. These parameters result in a series inductance LΔx and a shunt capacitance CΔx.
215


