Visual Text Mining with Progressive Taxonomy Construction for Environmental Studies

Sam Yu-Te Lee, Cheng-Wei Hung, Mei-Hua Yuan, Kwan-Liu Ma · 2025

Read Visual Text Mining with Progressive Taxonomy Construction for Environmental Studies by Sam Yu-Te Lee, Cheng-Wei Hung, Mei-Hua Yuan, Kwan-Liu Ma (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-05731.txt.

Introduction

Sam Yu-Te Lee, Cheng-Wei Hung, Mei-Hua Yuan, and Kwan-Liu Ma build a tool that helps environmental experts sort large text sets, in a 2025 paper. Experts often use a frame that links drivers, pressures, state, impact, and response in society and nature. Sorting papers into that frame by hand is slow, and the sorting scheme itself shifts as experts read.

Their system, GreenMine, uses language model prompts split into three small, checkable steps. Experts can state the scheme in plain words and refine it as they go. A score based on how much the model's answers agree flags shaky labels, and a radial chart shows doubt and topics side by side. A case study with interview transcripts shows the tool in use.

Catalog record

CREATORSam Yu-Te Lee, Cheng-Wei Hung, Mei-Hua Yuan, Kwan-Liu Ma
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE56 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-05731

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Visual Text Mining with Progressive Taxonomy Construction for Environmental Studies Sam Yu-Te Lee, Cheng-Wei Hung, Mei-Hua Yuan, Kwan-Liu Ma Abstract Environmental experts have developed the DPSIR (Driver, Pressure, State, Impact, Response) framework to systematically study and communicate key relationships between society and the environment. Using this framework requires experts to construct a DPSIR taxonomy from a corpus, annotate the documents, and identify DPSIR variables and relationships, which is laborious and inflexible. Automating it with conventional text mining faces technical challenges, primarily because the taxonomy often begins with abstract definitions, which experts progressively refine and contextualize as they annotate the corpus. In response, we develop GreenMine , a system that supports interactive text mining with prompt engineering. The system implements a prompting pipeline consisting of three simple and evaluable subtasks. In each subtask, the DPSIR taxonomy can be defined in natural language and iteratively refined as experts analyze the corpus. To support users evaluate the taxonomy, we introduce an uncertainty score based on response consistency. Then, we design a radial uncertainty chart that visualizes uncertainties and corpus topics, which supports interleaved evaluation and exploration. Using the system, experts can progressively construct the DPSIR taxonomy and annotate the corpus with LLMs. Using real-world interview transcripts, we present a case study to demonstrate the capability of the system in supporting interactive mining of DPSIR relationships, and an expert review in the form of collaborative discussion to understand the potential and limitations of the system. We discuss the lessons learned from developing the system and future opportunities for supporting interactive text mining in knowledge-intensive tasks for other application scenarios. \onlineid 7280 \vgtccategory Research \vgtcinsertpkg \CCScatlist \CCScatTwelve Information systemsInformation systems applicationsData Mining; \CCScatTwelve Human-centered computingVisualizationVisualization systems and tools 1 Introduction Human activities have a profound influence on the environment, which, in turn, shape policy-making and human behavior. The DPSIR framework ( D river, P ressure, S tate, I mpact, R esponse) is commonly used in environmental science to study and communicate the complex relationships between societal and environmental factors. Environmental experts would collect documents and manually mine for insights on DPSIR. As the corpus scales, this process quickly becomes laborious and inefficient. Such a task can be formulated as a text mining operation and automated. The definitions of DPSIR essentially form a “label taxonomy”. Conventionally, the taxonomy can be constructed manually or semi-automatically with clustering techniques [ 40 ] and then used to annotate the corpus with pre-trained models. However, mining with the DPSIR framework is a progressive process. The DPSIR taxonomy often starts with abstract definitions and is gradually enriched as experts investigate the corpus. The investigation usually contains two iterative steps: first, each DPSIR indicator is contextualized with “variables”, such as population or pollution, which constitute the taxonomy; second, relationships between variables are constructed with supporting evidence (e.g., text snippets) from the corpus and documented as insights. Then, experts would investigate the corpus again with new insights in mind and repeat this process until no new insight is derived. Due to this progressive characteristic, it is impractical to construct validation sets with human annotations to validate the taxonomy and insights in each iteration. This unique challenge motivates us to utilize Large Language Models (LLMs) to support experts in this progressive process and use uncertainty metrics to support expert validation. With LLMs, the DPSIR taxonomy can be expressed in natural language and then inserted in expert prompt templates [ 30 ] , which instruct LLMs to mine mentions of DPSIR variables and relationships from the corpus. This allows experts to progressively refine and contextualize the DPSIR taxonomy as they explore the corpus and gain new insights. Building upon this approach, we work closely with environmental experts and identify four technical challenges. First, designing prompts is not trivial for inexperienced users [ 49 , 20 ] , especially when the prompt is applied to a dataset [ 22 ] . Second, mining DPSIR insight from a corpus in a single zero-shot prompt is still too complex even for state-of-the-art AI models (e.g., GPT-4). The mining needs to be decomposed into a prompting pipeline to get satisfactory results. Third, evaluation is still necessary to ensure the reliable performance of the prompt, which is especially challenging without ground truths. Fourth, the mined insights are scattered across the corpus in textual form, which is not ideal for communication. In this work, we address these challenges and develop GreenMine , an LLM-based system that supports human-in-the-loop text mining with the DPSIR framework and visualization of the results. To lower the technical barrier, the system takes expert input for the DPSIR taxonomy in natural language and inserts them into prompt templates for execution. For more accurate results, the system decomposes the mining task into three sequential subtasks that are more manageable and sensible. We design an uncertainty chart that visualizes the uncertainty of the LLM responses and the topic distribution in the supporting evidence. Finally, to support communication, we design a DPSIR graph that organizes the mining results in a graph that can be interactively explored. We present a case study to show the effectiveness of the LLM-based mining support, and an expert review to discuss the system’s potential and limitations. We found that while the system is designed for environmental studies, the technical challenges and solutions have broader applications. We discuss lessons learned and future opportunities for supporting human-in-the-loop text mining in other knowledge-intensive scenarios. We consider our contributions are: • introducing a prompt-based text mining pipeline for human-in-the-loop DPSIR mining from a corpus, • designing a visual analytics system integrating the mining pipeline with uncertainty charts for prompt refinement and a DPSIR graph for collaborative discussion, and • providing lessons learned from the design process that inform other applications with knowledge-intensive tasks. 2 Background The DPSIR framework [ 4 ] provides a holistic approach to studying the connections that exist within and between diverse and complex societal and environmental factors, which is critical to support policymakers in their decision-making. According to the framework, Drivers are the key demands by society and create Pressures on the environment. Accumulation of pressures leads to State changes, which creates Impacts on human society or the environment. Significant impacts may elicit a societal Response and alter the Drivers and Pressures , forming a feedback loop. We refer to them as indicators . Given the diversity and complexity of the indicators, applying the DPSIR framework to study a specific region requires standardization and contextualization of the definitions of each indicator into variables [ 34 ] , so that their relationships can be studied. For example, to study the reef fishing activities in Kenya, Mangi et al. [ 32 ] delineates Drivers into several variables such as population, unemployment, tradition, and culture. Such a delineation is highly dependent on the regional context, making it infeasible to propose a taxonomy that is generally applicable. Environment experts need to manually build the taxonomy from large collections of documents, such as prior research papers, reports, or interview transcripts. From a text mining perspective, the variables are concepts to be extracted, and the mining goal is to progressively add concepts to extract and uncover relationships between concepts. In this work, our collaborating environmental experts apply the DPSIR framework to

Read the complete text