TERSE/PROLIX (TRPX) - - 一种用于快速无损压缩和解压缩衍射和冷EM数据的新算法
Senik Matinyan1, Jan Pieter Abrahams1
1Biozentrum, University of Basel, Basel, Switzerland.
Acta crystallographica. Section A, Foundations and advances
|September 25, 2023
概括
TERSE/PROLIX (TRPX) 是一种用于结晶学数据的新型无损压缩算法. 它在射和冷电磁数据的速度和压缩效率方面明显优于现有的方法.
科学领域:
- 晶体学 晶体学是指结晶学.
- 数据科学数据科学数据科学
- 生物物理学的生物物理.
背景情况:
- 高通量晶体学产生了大量的数据集,这给数据处理带来了重大挑战.
- 有效的压缩对于存储,传输和分析晶体学数据至关重要.
研究的目的:
- 介绍TERSE/PROLIX (TRPX),一种针对晶体射和冷电子显微镜 (cryo-EM) 数据的新型无损压缩算法.
- 评估TRPX的性能与已建立的压缩算法对比.
主要方法:
- 开发了TERSE/PROLIX (TRPX),一个C++20无损压缩算法.
- 将TRPX与gzip,bzip2,CBF,Zstandard,LZ4和HDF5过器进行比较,使用连续旋转电子衍射和原始冷EM数据.
- 评估压缩效率 (速率) 和速度.
主要成果:
- 在压缩率和速度方面,TRPX显著超过了所有测试的算法.
- TRPX 的速度是比 bzip2 快 60 倍,比 LZ4 快 3 倍以上.
- TRPX文件是字节顺序独立的,需要最小的内存,使硬件实现.
结论:
- TRPX为压缩晶体学和冷电磁数据提供了卓越的解决方案,增强了数据分析和解释.
- 该算法有效地解决了存储和传输方面的问题.
- 在GitHub上,TRPX代码和相关工具是开源的.
更多相关视频
13:43A Robust Single-Particle Cryo-Electron Microscopy cryo-EM Processing Workflow with cryoSPARC, RELION, and Scipion
Published on: January 31, 2022
13.3K
07:56User-friendly, High-throughput, and Fully Automated Data Acquisition Software for Single-particle Cryo-electron Microscopy
Published on: July 29, 2021
3.6K
相关概念视频
Cryo-electron Microscopy
3.4K
Conventional electron microscopy (EM) involves dehydration, fixation, and staining of biological samples, which distorts the native state of biological molecules and results in several artifacts. Also, the high-energy electron beam damages the sample and makes it difficult to obtain high-resolution images. These issues can be addressed using cryo-EM, which uses frozen samples and gentler electron beams. The technique was developed by Jacques Dubochet, Joachim Frank, and Richard Henderson, for...
3.4K
X-ray Crystallography
24.0K
The size of the unit cell and the arrangement of atoms in a crystal may be determined from measurements of the diffraction of X-rays by the crystal, termed X-ray crystallography.
Diffraction
Diffraction is the change in the direction of travel experienced by an electromagnetic wave when it encounters a physical barrier whose dimensions are comparable to those of the wavelength of the light. X-rays are electromagnetic radiation with wavelengths about as long as the distance between neighboring...
Diffraction
Diffraction is the change in the direction of travel experienced by an electromagnetic wave when it encounters a physical barrier whose dimensions are comparable to those of the wavelength of the light. X-rays are electromagnetic radiation with wavelengths about as long as the distance between neighboring...
24.0K
