美国报告的云播种活动 (2000-2025) 的结构化数据集,使用LLM
Jared Joseph Donohue1, Kara D Lamb2
1Data Science Institute, Columbia University, New York, NY, USA. jjd2203@columbia.edu.
Scientific data
|December 11, 2025
概括
一个新的数据集详细介绍了2000-2025年的美国云播种活动,使降水修饰研究成为可能. 这项工作展示了大型语言模型 (LLM),用于从历史环境报告中提取有价值的数据.
科学领域:
- 环境科学 环境科学
- 大气科学 大气科学
- 数据科学数据科学数据科学
背景情况:
- 云播种是一种气候改造技术,自20世纪40年代以来,在美国西部一直用于增加降水量.
- 现有的云播种操作记录是分散的,阻碍了全面的分析和研究.
- 存在对历史云播种努力的结构化,可访问的数据的需求.
研究的目的:
- 创建一个全面的,结构化的数据集美国云播种活动从2000-2025.
- 为了解决缺乏可访问的数据来分析气候变化努力.
- 展示大型语言模型 (LLM) 在提取历史环境数据中的实用性.
主要方法:
- 开发了一个多阶段的PDF-to-text提取管道.
- 利用OpenAI的o3大语言模型 (LLM) 来处理来自NOAA的832份历史报告.
- 经过验证的数据准确性,根据200个记录的手动审查,估计准确率为98.38%.
主要成果:
- 编制了云播种活动的结构化数据集,包括项目细节,日期,位置和方法.
- 通过LLM驱动的提取和手动验证实现了高数据准确性 (98.38%).
- 在Zenodo上公开提供数据集以供研究使用.
结论:
- 创建的数据集填补了云播种研究的关键数据缺口.
- LLM提供了一种强大而可扩展的解决方案,用于从历史环境文件中提取结构化信息.
- 该框架可用于解锁各种科学学科的扫描文档中的数据.
相关概念视频
01:20Cluster Sampling Method
13.9K
Appropriate sampling methods ensure that samples are drawn without bias and accurately represent the population. Because measuring the entire population in a study is not practical, researchers use samples to represent the population of interest.
To choose a cluster sample, divide the population into clusters (groups) and then randomly select some of the clusters. All the members from these clusters are in the cluster sample. For example, if you randomly sample four departments from your...
To choose a cluster sample, divide the population into clusters (groups) and then randomly select some of the clusters. All the members from these clusters are in the cluster sample. For example, if you randomly sample four departments from your...
13.9K
01:03Prediction Intervals
3.1K
The interval estimate of any variable is known as the prediction interval. It helps decide if a point estimate is dependable.
However, the point estimate is most likely not the exact value of the population parameter, but close to it. After calculating point estimates, we construct interval estimates, called confidence intervals or prediction intervals. This prediction interval comprises a range of values unlike the point estimate and is a better predictor of the observed sample value, y.
However, the point estimate is most likely not the exact value of the population parameter, but close to it. After calculating point estimates, we construct interval estimates, called confidence intervals or prediction intervals. This prediction interval comprises a range of values unlike the point estimate and is a better predictor of the observed sample value, y.
3.1K
01:03Precipitation Gravimetry
13.0K
Precipitation gravimetry is based on converting an analyte into a sparingly soluble precipitate, which is separated by filtration and weighed. An ideal precipitate should be pure, insoluble, of known composition, and easily filtered from the reaction mixture.
In determining nickel by gravimetric analysis, a precipitant of ethanolic dimethylglyoxime is added to a hot nickel salt solution. This is quickly followed by the dropwise addition of dilute ammonia solution until precipitation occurs. A...
In determining nickel by gravimetric analysis, a precipitant of ethanolic dimethylglyoxime is added to a hot nickel salt solution. This is quickly followed by the dropwise addition of dilute ammonia solution until precipitation occurs. A...
13.0K
01:16Precipitate Formation and Particle Size Control
5.1K
In precipitation gravimetry, the precipitating agent should react specifically or selectively with the analyte. While a specific reagent reacts with the analyte alone, a selective reagent can react with a limited number of chemical species.
The obtained precipitate should be either a pure substance of known composition or easily converted to one by a simple process, such as ignition or drying. In addition, the precipitate should be insoluble and easily filterable. In general, filterability...
The obtained precipitate should be either a pure substance of known composition or easily converted to one by a simple process, such as ignition or drying. In addition, the precipitate should be insoluble and easily filterable. In general, filterability...
5.1K
01:12Precipitation Processes
4.6K
The experimental conditions in a gravimetric analysis should be optimized to maximize the particle size and purity of the obtained precipitate. Ideally, the concentration of the precipitating reagent should be low with effective stirring to maintain low relative supersaturation for the growth of large crystals. In homogeneous precipitation, the precipitant is slowly generated by a chemical reaction in the solution to avoid local reagent excesses. For example, urea decomposes gradually to...
4.6K
01:17Precipitation and Co-precipitation
4.0K
Precipitation and coprecipitation methods can be used to separate a mixture of ions in a solution. In qualitative inorganic analysis, ions that form sparingly soluble precipitates with the same reagent are separated based on the differences in solubility products. For example, consider the separation of Cu(II) and Fe(II) ions by precipitation as insoluble sulfides. First, copper(II) sulfide is precipitated by the addition of acidic H2S, where the dissociation of H2S is suppressed. Adding H2S...
4.0K