基于离散卷积的地球观测数据处理时间序列的计算框架:全球规模的Landsat历史无云聚合物,空间分辨率为30米
Davide Consoli1, Leandro Parente1, Rolf Simoes1
1OpenGeoHub Foundation, Doorwerth, Netherlands.
PeerJ
|December 9, 2024
概括
我们开发了一个新的框架,TSIRF (时间序列代无重建框架),以有效处理大型地球观测 (EO) 数据集. 这使得无云,重建的全球Landsat数据可用于机器学习和环境分析.
科学领域:
- 地球观测 地球观测
- 地理空间数据科学数据科学
- 计算科学 计算科学
背景情况:
- 大型地球观测 (EO) 时间序列数据,如Landsat和Sentinel档案,是计算密集型和昂贵的处理.
- 分析准备数据 (ARD) 往往仍然含有云,并且太大,无法直接用于建模.
- 处理EO数据的现有解决方案缺乏开放性,性能或灵活性.
研究的目的:
- 开发一个高效和灵活的计算框架来处理大型EO时间序列数据.
- 为了能够创建无云,临时聚合和重建的EO数据集.
- 为环境监测和机器学习应用提供对处理的Landsat数据的开放访问.
主要方法:
- 为各种时间序列处理任务开发了时间序列无代重建框架 (TSIRF).
- 应用TSIRF到全球土地分析和发现 (GLAD) ARDLandsat档案 (1997-2022年).
- 使用 1248 个 Intel® Xeon® Gold 6248R CPU 处理数据,将结果保存为 8 位云优化 GeoTIFF (COG).
主要成果:
- 产生了一个无云的,每两个月汇总的Landsat产品,覆盖全球七个频段.
- 处理了超过2万亿个像素,每次时间序列有156个样本,大约28小时.
- 创建了一个每带/索引数据集的20TB,允许快速和负担得起的访问Landsat历史数据.
结论:
- TSIRF提供了一种高效,灵活和开放的解决方案,用于处理大规模的EO时间序列数据.
- 经过处理的Landsat档案为机器学习模型和生物物理索引映射提供了宝贵的资源.
- 这种开放数据产品有助于无环境监测和分析.
相关概念视频
Convolution: Math, Graphics, and Discrete Signals
229
In any LTI (Linear Time-Invariant) system, the convolution of two signals is denoted using a convolution operator, assuming all initial conditions are zero. The convolution integral can be divided into two parts: the zero-input or natural response and the zero-state or forced response, with t0 indicating the initial time.
To simplify the convolution integral, it is assumed that both the input signal and impulse response are zero for negative time values. The graphical convolution process...
To simplify the convolution integral, it is assumed that both the input signal and impulse response are zero for negative time values. The graphical convolution process...
229
Precipitation Processes
421
The experimental conditions in a gravimetric analysis should be optimized to maximize the particle size and purity of the obtained precipitate. Ideally, the concentration of the precipitating reagent should be low with effective stirring to maintain low relative supersaturation for the growth of large crystals. In homogeneous precipitation, the precipitant is slowly generated by a chemical reaction in the solution to avoid local reagent excesses. For example, urea decomposes gradually to...
421
Methods of Obtaining Topography
53
Topography involves measuring and mapping land elevations, natural features, and artificial structures to create accurate representations of the terrain. Topographic surveying relies on traditional and modern methods, each with distinct advantages and limitations.Traditional Surveying Methods:Transit stadia surveys and plane table surveys were widely used traditional surveying methods. These techniques relied on instruments like theodolites and stadia rods for measuring distances and angles,...
53
Discrete-Time Fourier Series
224
The Discrete-Time Fourier Series (DTFS) is a fundamental concept in signal processing, serving as the discrete-time counterpart to the continuous-time Fourier series. It allows for the representation and analysis of discrete-time periodic signals in terms of their frequency components. Unlike its continuous counterpart, which utilizes integrals, the calculation of DTFS expansion coefficients involves summations due to the discrete nature of the signal.
For a discrete-time periodic signal x[n]...
For a discrete-time periodic signal x[n]...
224
Precipitation Gravimetry
5.3K
Precipitation gravimetry is based on converting an analyte into a sparingly soluble precipitate, which is separated by filtration and weighed. An ideal precipitate should be pure, insoluble, of known composition, and easily filtered from the reaction mixture.
In determining nickel by gravimetric analysis, a precipitant of ethanolic dimethylglyoxime is added to a hot nickel salt solution. This is quickly followed by the dropwise addition of dilute ammonia solution until precipitation occurs. A...
In determining nickel by gravimetric analysis, a precipitant of ethanolic dimethylglyoxime is added to a hot nickel salt solution. This is quickly followed by the dropwise addition of dilute ammonia solution until precipitation occurs. A...
5.3K
GIS Software, Hardware, and Sources of GIS Data
41
A Geographic Information System (GIS) combines specialized software and hardware to effectively manage, analyze, and present spatial and related data. GIS software includes critical functionalities such as a user interface for easy navigation, database management tools for handling spatial and attribute data, and data retrieval features for efficient access. Analytical tools transform raw data into insights, while display functions produce maps and reports in various formats for effective...
41


