From Theory to Practice: Real-World Use Cases on Trustworthy LLM-Driven Process Modeling, Prediction and Automation DOI: XXXXXXX.XXXXXXX Conference: ACM SIGMOD/PODS International Conference on Management of Data; June 22-27, 2025; Berlin, GER ISBN: XXX-X-XXXX-XXXX-X/XXXX/XX CCS: Information systems

Peter Pfeiffer, Alexander Rombach, Maxim Majlatow, Nijat Mehdiyev · 2025

Read From Theory to Practice: Real-World Use Cases on Trustworthy LLM-Driven Process Modeling, Prediction and Automation DOI: XXXXXXX.XXXXXXX Conference: ACM SIGMOD/PODS International Conference on Management of Data; June 22-27, 2025; Berlin, GER ISBN: XXX-X-XXXX-XXXX-X/XXXX/XX CCS: Information systems by Peter Pfeiffer, Alexander Rombach, Maxim Majlatow, Nijat Mehdiyev (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-03801.txt.

Introduction

Peter Pfeiffer and co-authors share four real world cases from 2025 where language models help run business processes. Classic process tools can be stiff, opaque, and hard to scale, while raw language models bring risks of their own.

The cases span factory work, process design, drug safety watch, and green textile design. In each, process data and human checks keep the model grounded and its steps open to audit. Chat based design opens process maps to non experts, and agent teams weigh rules against green goals. The authors argue for fit to each setting over one fix for all.

Catalog record

CREATORPeter Pfeiffer, Alexander Rombach, Maxim Majlatow, Nijat Mehdiyev
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE41 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-03801

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

From Theory to Practice: Real-World Use Cases on Trustworthy LLM-Driven Process Modeling, Prediction and Automation DOI: XXXXXXX.XXXXXXX Conference: ACM SIGMOD/PODS International Conference on Management of Data; June 22-27, 2025; Berlin, GER ISBN: XXX-X-XXXX-XXXX-X/XXXX/XX CCS: Information systems Extraction, transformation and loading CCS: Information systems Expert systems CCS: Information systems Data analytics CCS: Information systems Process control systems Peter Pfeiffer, Alexander Rombach, Maxim Majlatow, Nijat Mehdiyev Abstract . Traditional Business Process Management struggles with rigidity, opacity, and scalability in dynamic environments, while emerging Large Language Models (LLMs) present transformative opportunities alongside risks. This paper explores four real-world use cases that demonstrate how LLMs, augmented with trustworthy process intelligence, redefine process modeling, prediction, and automation. Grounded in early-stage research projects with industrial partners, the work spans manufacturing, modeling, life-science, and design processes, addressing domain-specific challenges through human-AI collaboration. In manufacturing, an LLM-driven framework integrates uncertainty-aware explainable Machine Learning with interactive dialogues, transforming opaque predictions into auditable workflows. For process modeling, conversational interfaces democratize BPMN design. Pharmacovigilance agents automate drug safety monitoring via knowledge-graph-augmented LLMs. Finally, sustainable textile design employs multi-agent systems to navigate regulatory and environmental trade-offs. We intend to examine tensions between transparency and efficiency, generalization and specialization, and human agency versus automation. By mapping these trade-offs, we advocate for context-sensitive integration — prioritizing domain needs, stakeholder values, and iterative human-in-the-loop workflows over universal solutions. This work provides actionable insights for researchers and practitioners aiming to operationalize LLMs in critical BPM environments. 1. Introduction The integration of Artificial Intelligence (AI) into Business Process Management (BPM) has long been recognized as a pathway to operational efficiency ( Van Der Aalst 2012 ) . Nevertheless, conventional approaches — reliant on manual process modeling, rigid statistical methods, and non-transparent Predictive Process Monitoring (PPM) systems — struggle to address the dynamism and complexity of modern industrial workflows ( Di Francescomarino et al. 2018 ; Maggi et al. 2014 ) . While Process Mining (PM) has enabled organizations to visualize and analyze event logs, critical gaps persist: static models fail to adapt to real-time operational shifts, domain experts face technical barriers ( Kuzior et al. 2023 ; Rizzi et al. 2020 ) , and “black-box” AI systems weaken trust in high-stakes decision-making ( Hassija et al. 2024 ; Rudin et al. 2022 ; Aliyeva and Mehdiyev 2024 ) . These limitations are particularly evident in industries such as manufacturing, healthcare, and sustainable design, where urgent customization, regulatory compliance, and multi-stakeholder collaboration demand flexible, transparent solutions ( Mohseni et al. 2021 ) . Recent advances in Large Language Models (LLMs) and Explainable AI (XAI) signal a transformative shift, framing AI not just as an automation tool but as a collaborative partner in process management ( Sebin et al. 2024 ) . LLMs’ ability to interpret natural language, generate contextual insights, and interact with diverse data sources aligns with the evolving demands of BPM, where adaptability and human-AI collaboration are essential ( Slack et al. 2023 ) . However, realizing this potential requires addressing practical challenges: How can LLMs bridge the expertise gap between process modeling experts and domain specialists? Can AI-driven systems balance automation with accountability in regulated environments? What technical innovations are needed to scale these solutions across industries? This paper addresses these questions through four real-world use cases, each stemming from recently funded research initiatives that explore distinct applications of LLMs in BPM along the BPM lifecycle ( Dumas et al. 2018 ) . Spanning manufacturing, cross-industry process modeling, drug safety monitoring, and sustainable textile design, these projects demonstrate how LLMs can support activities along the entire BPM lifecycle — from discovery and execution to monitoring and optimization — while tackling domain-specific challenges: • In LLM-mediated interaction with trustworthy process predictions , a framework integrating uncertainty-aware Machine Learning (ML), PM, and multi-agent LLMs transforms opaque predictions into auditable, interactive workflows. By grounding explanations in predictions from Manufacturing Execution System (MES) event logs and enabling natural language dialogues, the system empowers users to validate and adapt AI recommendations in real-time. • For conversational process modeling , a chat-based interface allows users to model and refine Business Process Model and Notation (BPMN) models in an interactive manner, democratizing access to process design and optimization. • In pharmacovigilance , knowledge graph (KG)-augmented LLM agents support regulatory experts in drug safety monitoring by synthesizing unstructured reports and structured medical domain knowledge. • For sustainable textile design , a multi-agent LLM system navigates regulatory, environmental, and social trade-offs, empowering designers to align creative choices with circular economy principles. Though distinct in scope, these cases share three transformative themes for BPM. First, they demonstrate human-centric AI , where LLMs act as bridges between technical systems and non-expert users, whether through process visualizations or natural language queries. Second, they emphasize trustworthy automation through XAI techniques — such as uncertainty quantification (UQ) and Retrieval-Augmented Generation (RAG) - that anchor LLM outputs in verifiable data sources. Third, they expose scalability and performance challenges in integrating LLMs into legacy BPM infrastructures, from reconciling XML-based process models with generative AI to reducing errors in KG queries. By presenting these diverse perspectives, this paper contributes to next-generation process management in three ways. Practically, it shows how LLMs address industry pain points like manual process modeling bottlenecks. Methodologically, it highlights hybrid architectures that merge LLMs with traditional ML and participatory design. Theoretically, it challenges the view of LLMs as standalone solutions, advocating instead for their role in human-in-the-loop workflows. The remainder of this paper is structured as follows: Sections 2 – 5 detail the four use cases, emphasizing their technical architectures, LLM integration strategies, and (initial) empirical findings. Section 6 synthesizes challenges and opportunities, framing a research agenda for AI-driven BPM in the LLM era. Finally, section 7 summarizes and concludes the paper. Figure 1. Three-module AI solution that integrates human-centered ML, LLM–based interaction, and an intelligent AI interface Conceptual Framework of Use Case 1: The diagram depicts a three‐module AI solution that integrates human‐centered ML, LLM–based interaction, and an intelligent AI interface. It orchestrates data processing, predictive analytics, UQ, XAI results, and user interaction. The goal is to provide a seamless workflow for production planning and execution, analyzing data and schedules with ML, UQ, and XAI techniques, and returning intelligible, user‐specific outcomes. 2. Use Case 1 - LLM-Mediated Interaction with Trustworthy Process Predictions 2.1. Motivation Modern manufacturing systems generate vast volumes of event data through MES, capturing granular details of production machine states, operator actions, material flows, and quality checks ( Mehdiyev et al. 2024b ) . PM leverages these event logs to reconstruct and analyze production processes, offering insights into bottlenecks, inefficiencies, and deviations from planned schedules. While traditional PM excels at descriptive analytics, its capacity for predictive and prescriptive optimization remains limited, particularly in dynamic environments requiring real-time adaptation to urgent orders, material variability, or machine downtime ( Teinemaa et al. 2019 ) . ML has emerged as a promising tool to augment PM in production scheduling and planning ( Mehdiyev et al. 2024b ) . PPM models, trained on historical event logs, can forecast production durations, optimize resource allocation, and simulate alternative workflows. However, their adoption introduces a critical challenge: the opacity of ML decision-making undermines trust in high-stakes scenarios. Production planners, tasked with validating

Read the complete text