诺亚公开数据传播:地球系统数据在云中的petabyte规模数据
Denis S Willett1, Jonathan Brannock1, Jenny Dissen1
1Cooperative Institute for Satellite Earth Systems Studies (CISESS), North Carolina Institute for Climate Studies, North Carolina State University, Asheville, NC, USA.
Science advances
|September 20, 2023
概括
诺亚公开数据传播 (NODD) 计划通过云平台免费向公众提供超过24PB的环境数据. 这一举措加速了地球系统数据科学,使NOAA庞大的数据集易于分析.
科学领域:
- 地球和环境科学 地球和环境科学
- 数据科学是数据科学.
- 云计算是一种云计算.
背景情况:
- 国家海洋和大气管理局 (NOAA) 拥有大量重要的环境数据.
- 公共获取大规模环境数据集对于科学进步和知情决策至关重要.
- 现有的数据传播方法可能无法优化为云原生工作流和petabyte规模的访问.
研究的目的:
- 为了记录NOAA开放数据传播 (NODD) 计划.
- 解释程序的重点是数据来源,关键数据集和利用.
- 为了指导用户在云环境中访问NOAA环境数据.
主要方法:
- 利用亚马逊网络服务 (AWS),微软Azure和谷歌云平台 (GCP) 等云平台进行数据托管.
- 组织并提供各种NOAA数据集,包括卫星图像,雷达,天气模型,观测,海洋数据库和气候记录.
- 实施强大的数据管理,以支持百兆字节规模的访问和数十亿次的每日请求.
主要成果:
- 目前,NODD提供了超过24 petabyte (PB) 的NOAA数据.
- 该平台每天支持数十亿个请求和千兆字节的数据访问.
- 利益相关者每月访问超过5PB的NODD数据.
结论:
- 该NODD程序成功地使开放的,字节规模的地球系统数据科学在云中.
- 持续增长和对高性能数据格式的探索将进一步提高数据可访问性.
- 促进基于云的对NOAA数据的访问加速了科学研究和应用.
相关概念视频
01:23GIS Software, Hardware, and Sources of GIS Data
92
A Geographic Information System (GIS) combines specialized software and hardware to effectively manage, analyze, and present spatial and related data. GIS software includes critical functionalities such as a user interface for easy navigation, database management tools for handling spatial and attribute data, and data retrieval features for efficient access. Analytical tools transform raw data into insights, while display functions produce maps and reports in various formats for effective...
92
01:25Selected Data About Geographic Locations
43
Geographic Information Systems (GIS) rely on two core types of data: spatial data and attribute data.Spatial DataSpatial data defines the physical location of features within a coordinate system, typically expressed in terms of latitude and longitude. It provides precise positioning for elements like roads, rivers, or buildings.Attribute DataAttribute data complements spatial data by adding descriptive information about these features. For example, a road's spatial data includes its start and...
43
01:03Precipitation Gravimetry
6.7K
Precipitation gravimetry is based on converting an analyte into a sparingly soluble precipitate, which is separated by filtration and weighed. An ideal precipitate should be pure, insoluble, of known composition, and easily filtered from the reaction mixture.
In determining nickel by gravimetric analysis, a precipitant of ethanolic dimethylglyoxime is added to a hot nickel salt solution. This is quickly followed by the dropwise addition of dilute ammonia solution until precipitation occurs. A...
In determining nickel by gravimetric analysis, a precipitant of ethanolic dimethylglyoxime is added to a hot nickel salt solution. This is quickly followed by the dropwise addition of dilute ammonia solution until precipitation occurs. A...
6.7K
01:29Applications of GIS: Disaster Management and Emergency Response
105
Geographic Information System (GIS) technology is essential for risk identification, action prioritization, and resource optimization in critical situations like flooding and earthquakes. By integrating spatial and demographic data, GIS provides a comprehensive framework for emergency response.GIS integrates data layers, like rainfall intensity, topography, elevation profiles, and river levels, to model high-risk flood zones. These layers assess areas susceptible to flooding based on their...
105
01:29Levels of Use of a GIS
71
Geographic Information Systems (GIS) operate across three levels of application, each representing an increasing degree of complexity: data management, analysis, and prediction. These levels reflect the expanding functionality and versatility of GIS technology in handling spatial data for diverse purposes.Data ManagementAt its foundational level, GIS serves as a tool for data management, enabling the input, storage, retrieval, and organization of spatial data. This level is often employed in...
71
01:50Global Climate Change
24.5K
Throughout its ~4.5 billion year history, the Earth has experienced periods of warming and cooling. However, the current drastic increase in global temperatures is well outside of the Earth’s cyclic norms, and evidence for human-caused global climate change is compelling. Paleoclimatology, the study of ancient climate conditions, provides ample evidence for human-caused global climate change by comparing recent conditions with those in the past.
24.5K