Mining for Species, Locations, Habitats, and Ecosystems from Scientific Papers in Invasion Biology: A Large-Scale Exploratory Study with Large Language Models
Jennifer D’Souza, Zachary Laubach, Tarek Al Mustafa, Sina Zarrieß, Robert Frühstückl, Phyllis Illari · 2025
Read Mining for Species, Locations, Habitats, and Ecosystems from Scientific Papers in Invasion Biology: A Large-Scale Exploratory Study with Large Language Models by Jennifer D’Souza, Zachary Laubach, Tarek Al Mustafa, Sina Zarrieß, Robert Frühstückl, Phyllis Illari (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-18287.txt.
Introduction
Jennifer D'Souza and five co-workers wrote a 2025 paper on using large language models to mine invasion biology papers for ecological facts. The targets are species names, places, habitats and ecosystems. Such facts drive forecasts of spread and guide conservation work. Older mining tools stumble on tangled ecological terms.
The team ran general-purpose models with no field-specific tuning. Results show both real promise and clear limits for this kind of extraction. Failure modes on subtle language patterns are cataloged. The study lays groundwork for automatic tools that map invaders from the literature. No fine-tuning was used, by design.
Catalog record
| CREATOR | Jennifer D’Souza, Zachary Laubach, Tarek Al Mustafa, Sina Zarrieß, Robert Frühstückl, Phyllis Illari |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 34 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-18287
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Mining for Species, Locations, Habitats, and Ecosystems from Scientific Papers in Invasion Biology: A Large-Scale Exploratory Study with Large Language Models Jennifer D’Souza, Zachary Laubach, Tarek Al Mustafa, Sina Zarrieß, Robert Frühstückl, Phyllis Illari Abstract This paper presents an exploratory study that harnesses the capabilities of large language models (LLMs) to mine key ecological entities from invasion biology literature. Specifically, we focus on extracting species names, their locations, associated habitats, and ecosystems, information that is critical for understanding species spread, predicting future invasions, and informing conservation efforts. Traditional text mining approaches often struggle with the complexity of ecological terminology and the subtle linguistic patterns found in these texts. By applying general-purpose LLMs without domain-specific fine-tuning, we uncover both the promise and limitations of using these models for ecological entity extraction. In doing so, this study lays the groundwork for more advanced, automated knowledge extraction tools that can aid researchers and practitioners in understanding and managing biological invasions. 1 Introduction Human population growth and expansion are coupled with the intentional and unintentional movement of species beyond their historic ranges. The introduction of nonnative species can have dramatic impacts that cascade across ecological scales from individual plants and animals to populations and communities Roy et al. 2023 . The goal of invasion biology is to identify and understand the impacts of alien species on native flora and fauna across these ecological scales, not only to conserve rare, sensitive, and ecologically valuable native species, but also because intact functional ecosystems provide important economic, public health, and socioemotional services to humans Cassey et al. 2018 ; Jeschke and Heger 2018 . Achieving this goal becomes increasingly challenging though, since alien species introductions operate at a rapid rate and global scale, and in the context of increasing human population growth and climate change. Additionally, the body of research in this domain of ecology is currently growing to an extent that it becomes more and more difficult for invasion biology researchers to build a systematic and shared understanding of the impacts of alien species on ecosystems, or to even comprehensively categorize these species, and their locations, and relationships. This paper explores the potential of recent NLP technologies, such as Information Extraction (IE) approaches based on Large Language Models (LLMs) Amatriain et al. 2023 ; D’Souza 2023 , as a tool that could contribute to predicting future invasions and their consequences. The extraction and categorization of information from scientific publications is a well-known NLP task Augenstein et al. 2017 ; Gábor et al. 2018 ; Luan et al. 2018 ; Brack et al. 2020 ; Dessì et al. 2020 ; D’Souza et al. 2021 ; Liu et al. 2021 ; Kabongo et al. 2021 ; D’Souza and Auer 2022 ; D’Souza 2024 ; Shamsabadi et al. 2024 ; D’Souza et al. 2024 . In the biomedical domain, NER and RE facilitate large-scale biomedical data analysis, such as network biology Zhou et al. 2014 , gene prioritization Aerts et al. 2006 , drug repositioning Wang and Zhang 2013 and the creation of curated databases Li et al. 2015 . In the clinical domain, NER and RE can aid in disease and treatment prediction, readmission prediction, deidentification, and patient cohort identification Miotto et al. 2018 . However, the domain of ecology and invasion biology in particular has hardly been explored and dedicated datasets are scarce. To the best of our knowledge, the small-scale INAS dataset ( Brinner et al. 2022 ) presents the only invasion biology-specific resource that provides annotations of hypotheses for scientific abstracts. This paper presents a study on information extraction (IE) in invasion biology, encompassing both named entity recognition (NER) and relation extraction (RE). We simultaneously build on studies showing that jointly learning NER and RE can enhance overall performance Giorgi et al. 2019 and on recent LLMs which may open new opportunities for IE. Thus, our central question is whether LLMs, with their advanced pattern recognition capabilities, can be effectively applied to a new domain to simultaneously identify entities and infer their relationships. We present an approach that prompts LLMs to identify the following four key entities in invasion biology–viz. species, location, habitat, and ecosystem. Since we cannot evaluate the results quantitatively, we explore them qualitatively with respect to the following questions: (i) do the LLMs extract reasonable species, location, habitat, and ecosystem information and what interactions do they infer? (ii) what relation information is mined?, (iii) what are the benefits of defining LLM workflows to mine large amounts of data? To summarize, this work makes two key contributions: (i) the release of a text data mining corpus of over 10,000 invasion biology papers, including titles, abstracts, full text for nearly 2,000 papers, and structured information extracted by the GPT-4o LLM from the abstracts, to support further research, analysis, and curation ( https://doi.org/10.5281/zenodo.13956882 ); and (ii) a systematic workflow for schema discovery in information extraction tasks, demonstrated in this paper but broadly applicable for leveraging LLMs in open-ended IE objectives. 2 Our Text Data Mining Corpus Before tackling the IE task, we compiled a publication corpus as the unstructured source for scientific information. This section outlines the preparation of this dataset for text mining and IE. 2.1 Defining the Collection We started with the Invasion Biology Corpus Mietchen et al. 2024 , which lists metadata for 49,438 invasion biology papers in Wikidata. Using the papers’ DOIs, we queried the ORKG ASK search engine’s API to retrieve abstracts and full texts. ASK was chosen for its convenient access to over eight million publications Knoth et al. 2023 across diverse scientific fields. 2.2 Corpus Statistics Of the 49,438 DOIs queried, 12,636 were available in the ASK database. Among these, 9,802 had abstracts but not full text, and 2,834 included both. This distribution reflects a common issue: open-access full-text articles are limited, posing a challenge for scientific NLP efforts. As a result, our final dataset—consisting of a larger set of abstracts and a smaller set of full texts—serves as the target collection for text mining and IE. The abstracts range from 10 to 1,608 tokens (average: 235), while the full texts span 28 to 123,958 tokens (average: 7,667), highlighting the greater informational depth of full texts despite their limited availability. 2.3 Bibliometric Analysis Before the IE tasks, we highlight two key bibliometric insights from our corpus. Among 12,636 papers with abstracts, publication years span 52 years, starting in 1950. Full-text availability begins in 1990. Figure 1 shows a snapshot of the past 20 years, with 2016 having the most abstracts (1,183) and 2017 the most full texts (294). Figure 2 highlights the top ten publishers. Additional insights are available in our online repository . Figure 1: Distribution of papers in our corpus with abstracts and with full text over the past 20 years. Figure 2: Distribution of papers, in our corpus, by abstract and full-text availability across the top ten publishers. 3 Information Extraction (IE) with Large Language Models (LLMs) An IE task entails two prerequisites. 1) The collection of papers on the which the IE task should be performed. And 2) the schema which defines the IE extraction targets of interest. Having compiled our publication corpus above, we proceed with IE. Entity Description Species Includes specific named