一个关于渐进式数据压缩和检索的一般框架
IEEE transactions on visualization and computer graphics
|November 3, 2023
概括
数据压缩是科学计算的一个瓶. 这项研究引入了一种渐进式压缩框架,该框架将准确性适应分析需求,改善数据处理而不牺牲结果.
科学领域:
- 科学数据压缩压缩.
- 高性能计算的高性能计算.
- 数据分析和可视化.
背景情况:
- 数据传输瓶阻碍了科学模拟,观测和实验.
- 传统的损耗压缩方法需要严格的容错,限制了对各种数据分析任务的适应性.
- 渐进式数据压缩提供了可适应的准确性,但在许多分析算法和框架中缺乏固有的支持.
研究的目的:
- 为各种数据压缩器和数值表示提供一个新的框架,使得逐渐精确的数据查询成为可能.
- 为了应对适应现有的压缩技术和文件格式以进行渐进式数据处理的挑战.
- 为科学数据分析提供灵活的解决方案,其中准确性要求因任务而异.
主要方法:
- 开发了一种多组件表示,以逐步减少错误.
- 将框架与四个已建立的科学数据压缩器集成.
- 使用来自SDRBench集合的真实世界数据集评估有效性.
主要成果:
- 该框架实现了与独立压缩机可比的精度.
- 压缩和解压缩时间与所要求的组件数量成比例.
- 通过使用足够数量的组件,通过损耗压缩机实现完全无损压缩.
结论:
- 拟议的框架有效地允许在各种压缩机上进行渐进精度数据查询.
- 它为科学计算中的数据传输瓶提供了可扩展和准确的解决方案.
- 该方法通过允许特定任务的准确性控制来提高数据分析的灵活性.
相关概念视频
01:24Data Reporting and Recording
4.7K
Reporting and recording are crucial in data documentation. The timely, thorough, and accurate documentation of facts is essential when recording patient data. Failure to record findings during an assessment or interpretation of a problem will result in loss of information and make the patient document unreliable. The reader is left with general impressions if the information is not specific. A recording is documenting data of the individual's health information in a traceable, secure, and...
4.7K
01:30Buffers: Overview
4.5K
Buffers play a crucial role in stabilizing the pH of a solution by mitigating the effects of small amounts of added acid or base. They consist of a weak acid and its conjugate base or a weak base and its conjugate acid. A solution of acetic acid and sodium acetate is an example of a buffer that consists of a weak acid and its salt: CH3COOH (aq) + CH3COONa (aq). An example of a buffer that consists of a weak base and its salt is a solution of ammonia and ammonium chloride: NH3 (aq) + NH4Cl (aq).
4.5K
01:12Maximum Size of Aggregate
135
The maximum size of aggregate is defined as the aperture of the sieve retaining 15 percent or more of the particles present in the aggregate sample. The aggregate's maximum size impacts the concrete's water requirement, workability, and strength. Larger aggregates reduce the surface area needing cement paste coverage, which can lower water needs, thereby allowing a decrease in the water-to-cement ratio when the desired workability and richness of the mix are to be maintained, which can...
135
01:09Buffers: Buffer Capacity
1.3K
Buffer capacity is the quantitative measure of a buffer to resist the change in pH. As shown in the following equation, the buffer capacity, denoted by 'beta', is expressed as the number of moles of acid or base needed to change the pH of a one-liter buffer solution by 1 unit. Here, Ca and Cb indicate the number of moles of acid and base, respectively. Note that dpH represents the change in pH.
In the graph, pH is plotted as a function of the number of moles of base (Cb) added to a weak...
In the graph, pH is plotted as a function of the number of moles of base (Cb) added to a weak...
1.3K
01:12Chunking
112
Chunking is a powerful cognitive technique that improves short-term memory retention by organizing information into smaller, more manageable units. The brain, limited by working memory capacity, can more easily process and store information when it is divided into "chunks" rather than presented as discrete, unrelated elements. Chunking is especially useful when dealing with large amounts of information, such as numerical sequences, words, or complex ideas.
The principle behind chunking...
The principle behind chunking...
112
01:19Data: Types and Distribution
728
In biostatistics, data are the observations collected for analysis. There are two main types: parametric and non-parametric. Parametric data, which include continuous (e.g., weight) and discrete numerical data (e.g., number of tablets), assume a particular distribution pattern, often the normal distribution. Non-parametric data do not adhere to a specific distribution and typically comprise nominal (e.g., gender) and ordinal categorical data (e.g., pain scale ratings).
Distributions in...
Distributions in...
728