Structured dataset of reported cloud seeding activities in the United States (2000–2025) using a large language model
Jared Joseph Donohue Data Science Institute Columbia University New York, NY, USA [email protected] Kara D. Lamb Department of Earth and Environmental Engineering Columbia University New York, NY, USA [email protected] · 2025
Read Structured dataset of reported cloud seeding activities in the United States (2000–2025) using a large language model by Jared Joseph Donohue Data Science Institute Columbia University New York, NY, USA [email protected] Kara D. Lamb Department of Earth and Environmental Engineering Columbia University New York, NY, USA [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-01555.txt.
Introduction
Donohue and Lamb build a structured data set of cloud seeding work in the United States, in a paper from twenty twenty-five. Cloud seeding tries to boost rain or snow by spraying particles into clouds. It has run in the west since the nineteen forties. But no full data set existed to judge its scope or effects.
They fed eight hundred thirty-two federal reports into a text extraction pipeline. A large language model then pulled key facts into neat fields. Fields cover place, dates, operator, agent used, gear, and stated goals. Hand checks of two hundred records showed accuracy near ninety-eight percent. The data set is free on Zenodo. The method may unlock other old scanned records for science.
Catalog record
| CREATOR | Jared Joseph Donohue Data Science Institute Columbia University New York, NY, USA [email protected] Kara D. Lamb Department of Earth and Environmental Engineering Columbia University New York, NY, USA [email protected] |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 22 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-01555
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Structured dataset of reported cloud seeding activities in the United States (2000–2025) using a large language model Jared Joseph Donohue Data Science Institute Columbia University New York, NY, USA [email protected] Kara D. Lamb Department of Earth and Environmental Engineering Columbia University New York, NY, USA [email protected] Abstract Abstract Cloud seeding, a weather modification technique used to increase precipitation, has been employed in the western United States since the 1940s. However, structured datasets are not currently available to analyze these efforts. To address this gap, we present a structured dataset of reported cloud seeding activities in the U.S. from 2000 to 2025, including the year, season, state, seeding agent, apparatus used for deployment, and purpose. Using OpenAI’s o4-mini large language model (LLM), combined with multi-stage PDF-to-text conversion and response-parsing code, we processed 836 historical reports from the National Oceanic and Atmospheric Administration (NOAA) to extract the data. The resulting dataset achieved 94.72% human-verified accuracy across all fields and is publicly available on Zenodo. Our results help fill the gap in structured cloud seeding data and demonstrate the potential for LLMs to extract structured environmental data from historical documents. More broadly, this work provides a scalable framework for unlocking historical data from scanned documents across scientific domains. Background & Summary Cloud seeding is a weather modification technique used to enhance precipitation, typically in regions affected by drought, water scarcity, or to support snowpack accumulation. In the United States, cloud seeding has been practiced since the 1940s but reporting was not standardized until the Weather Modification Reporting Act of 1972 [ 1 ] . The Act requires individuals and organizations to notify the U.S. Department of Commerce at least 10 days before and after conducting weather modification operations. These reports are submitted to NOAA via email and compiled on the NOAA Weather Modification website [ 2 ] . While the NOAA reports are made publicly available online, they are stored individually as scanned PDFs with inconsistent formatting and structure. This lack of standardization makes it difficult to extract key information at scale, or integrate the reports into other structured datasets. As a result, data on cloud seeding in the U.S., such as locations, dates, purposes, cloud seeding agent, and agent deployment methods, remains largely inaccessible for analysis. To solve this data access problem, we created a structured dataset from 836 NOAA cloud seeding reports spanning from 2000 to 2025. Our work transforms these scattered, inconsistently formatted documents into a single, structured CSV file that enables the analysis of U.S. weather modification activities over time. The dataset has 94.72% accuracy on all extracted fields when compared with the original PDFs. This data extraction method can be extended to similar government-mandated environmental reporting systems, such as those related to water usage, air quality monitoring, or land management—many of which exist in PDF form with highly variable formatting. By transforming previously inaccessible records into structured data, this work lays the groundwork for evidence-based research and policy evaluation in an area of growing environmental interest [ 3 ] . Beyond its methodological contributions, the resulting dataset has potential value across a wide range of applications. Researchers can use it to study long-term patterns in weather modification practices, analyze the use and evolution of different seeding agents and deployment methods, or assess geographic and seasonal trends in operational activity. For example, while there have been several recent research field campaigns that have focused on detailed process level understanding and evaluation of cloud seeding (e.g. the 2017 Seeded and Natural Orographic Wintertime clouds: the Idaho Experiment (SNOWIE) campaign in Western Idaho [ 4 ] ), there has been little qualitative analysis of reported historical operational cloud seeding activities. With recent renewed interest in both traditional weather modification technology (e.g. the UAE’s Rain Enhancement Program and several recent commercial start-ups), as well as in geo-engineering strategies focused on Solar Radiation Management such as Marine Cloud Brightening that use similar intervention strategies to mitigate climate change [ 5 ] , this dataset can provide historical context for weather modification usage in the US. In addition, this dataset can provide insights into current limitations in reporting requirements that impede large-scale evaluation of the environmental and meteorological implications of large-scale weather modification [ 3 ] . Methods Figure 1: NOAA Data Extraction Pipeline Input Data Source Cloud seeding reports were manually downloaded from the NOAA Central Library’s Weather Modification Project Reports archive [ 2 ] . A total of 1,025 PDF files were downloaded, covering all reported weather modification activities in the United States from 2000-2025. Each PDF contains the initial report on the planned cloud seeding project (Form 17-4), a second tabular report describing interim and final details (Form 17-4A), or a combination of both. Form 17-4 contains project-level summaries, including information on the purpose of the project (e.g., precipitation enhancement or hail suppression), the operational period, and the agents and apparatus used. Form 17-4A provides more granular operational details such as the number of seeding hours, the type and amount of agent released, and meteorological conditions on specific dates. Beyond these two forms, many reports include additional supporting materials such as operational maps, meteorological analyses, auxilliary tables, cloud seeding decision logs, and narrative summaries. While these materials provide valuable context for understanding cloud seeding activities, they also increase variability across reports, requiring additional preprocessing and file handling. Preprocessing A custom Python pipeline was developed to organize and preprocess the PDF documents (Figure 1 ). First, all downloaded files were stored in a local directory. In many cases, a single cloud seeding project was documented across multiple submissions, indicated by suffixes such as .M (initial report), .I (interim report), and .F (final report). Since these reports refer to the same geographic area and operational period, they were programmatically consolidated to preserve project-level information and ensure completeness during data extraction. After consolidation, there were 836 unique weather modification projects to process and include in our dataset. The scanned documents included both typed and hand-written text (and sometimes a mix of both in the same document). To convert the merged PDFs into plain text, three approaches were used. For native, text-based documents (57% of documents), text was extracted using the pymupdf Python library [ 6 ] . For scanned or hand-written documents (43% of documents), optical character recognition (OCR) was applied using a combination of pytesseract , an open-source wrapper for the Tesseract OCR engine [ 7 ] (processed 16% of all documents), and llm-whisperer (processed 27% of all documents), a layout-preserving PDF extraction technology which uses both OCR and text-based extraction [ 8 ] . All code for the preprocessing pipeline, including file merging and text extraction, is available in a public GitHub repository [ 9 ] . For each document, the text from Form 17-4 was extracted using a three-tie approach: first attempting pymupdf , then pytesseract , and lastly llm-whisperer . Only Form 17-4 was used because it contained all the key metadata we needed for our dataset, including: purpose, date ranges, description of agent and apparatus used, and the target area. Truncating the input in this way also helped reduce noise and minimize costs. In addition to the extracted text, the original filename was also provided to the model because