GymPN: A Library for Decision-Making in Process Management Systems
Riccardo Lo Bianco, Remco Dijkman, Willem van Jaarsveld · 2025
Read GymPN: A Library for Decision-Making in Process Management Systems by Riccardo Lo Bianco, Remco Dijkman, Willem van Jaarsveld (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-20404.txt.
Introduction
Riccardo Lo Bianco and co-authors present GymPN in 2025, a software library that helps organizations make better workflow decisions with deep reinforcement learning. Process systems must decide what task runs next, when, and by whom. Earlier tools could not handle partly hidden process states or several decisions at once. GymPN removes both limits, letting models mirror real processes more closely.
The team tested the library on eight typical decision patterns from business practice. It modeled each one easily and learned strong policies. Because it builds on a known framework for process mining, users can plug in their own process data. The library aims at optimal staffing and routing choices in daily operations.
Catalog record
| CREATOR | Riccardo Lo Bianco, Remco Dijkman, Willem van Jaarsveld |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 32 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-20404
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
GymPN: A Library for Decision-Making in Process Management Systems Riccardo Lo Bianco, Remco Dijkman, Willem van Jaarsveld Abstract Process management systems support key decisions about the way work is allocated in organizations. This includes decisions on which task to perform next, when to execute the task, and who to assign the task to. Suitable software tools are required to support these decisions in a way that is optimal for the organization. This paper presents a software library, called GymPN, that supports optimal decision-making in business processes using Deep Reinforcement Learning. GymPN builds on previous work that supports task assignment in business processes, introducing two key novelties: support for partial process observability and the ability to model multiple decisions in a business process. These novel elements address fundamental limitations of previous work and thus enable the representation of more realistic process decisions. We evaluate the library on eight typical business process decision-making problem patterns, showing that GymPN allows for easy modeling of the desired problems, as well as learning optimal decision policies. 1 Introduction Process management systems play a crucial role in supporting organizational decision-making, particularly in determining which task to perform next, when to perform it, and who should perform it. Traditionally, such decisions have been guided by simple heuristics [ 8 , 2 ] . However, these heuristics often fail to capture the complexity and variability of real-world business processes. In recent years, Deep Reinforcement Learning (DRL) has emerged as an alternative to heuristics and is a promising tool to support organizational decision-making. In particular, the use of DRL to optimally assign resources to activities has been an active area of investigation [ 15 ] . Yet, DRL solutions are typically tailored to specific problem formulations, making them difficult to generalize or adapt to new decision-making problems. To address this challenge, the Action-Evolution Petri Net (A-E PN) framework was introduced as an approach to modeling organizational decision-making problems and solving them with DRL [ 10 ] . The original A-E PN framework was later extended with Attributed A-E PN [ 11 ] , introducing the use of Graph Neural Networks (GNNs) to learn policies in more complex settings. Despite these advancements, two key assumptions remained. First, the framework assumes that all information about the state of the process can be used to make a decision. This assumption is often unrealistic, as in many cases only a fraction of the process variables are visible to the decision-making algorithm. Second, the framework enables modeling only one type of decision in a business process at a time. However, this limits the expressive power of the framework, because often multiple decisions need to be made in a single business process. To overcome these limitations, this paper presents GymPN, a Python-based software library that implements and extends the A-E PN framework to overcome these limitations. GymPN introduces two main novelties: (1) support for modeling partial observability of process state, and (2) support for modeling multiple decision types within a single business process. These novel elements allow for a realistic and flexible modeling of business process management problems while retaining the ability to learn optimal decision policies through DRL. Also, since it is released as a Python library, it is easy to install and use. GymPN is built on top of the SimPN library [ 4 ] , extending its core functionalities to support the new A-E PN elements, including the distinction between action and evolution transitions, a customizable reward structure, and utilities for training and evaluating DRL algorithms as well as heuristics. The library encapsulates the entire DRL pipeline, allowing users to define new problems and train agents with minimal configuration, thereby facilitating the discovery and analysis of optimal decision policies across a wide range of business process scenarios. The library is evaluated by applying it to eight typical organizational decision-making problems, showing that it can learn how to solve these problems in an optimal way. Against this background, the remainder of this work is structured as follows: section 2 discusses related DRL frameworks and libraries for organizational decision-making; section 3 presents the main theoretical background of the A-E PN framework; section 4 presents the main novelties that are introduced in GymPN based on the A-E PN framework; section 6 provides a set of typical organizational decision-making problems, showing how GymPN is capable of learning optimal assignment policies in every problem instance; section 5 provides a basic overview of GymPN’s main features from a software perspective; section 6 presents eight typical business process decision-making problems and shows that GymPN allows the learning of optimal solutions to these problems; section 7 presents the conclusions, reflecting on the current limitations and future research steps. 2 Related work The main objective of GymPN is to provide users with an easy way to model and solve business process decision-making problems using DRL. Inspired by the variety of successful DRL-based approaches [ 15 , 12 , 13 ] , GymPN facilitates learning and testing business process decision-making policies, using the Proximal Policy Optimization (PPO) algorithm with minimal technical overhead. In particular, the library draws from the theory of A-E Petri nets proposed in [ 10 ] and extended in [ 11 ] . It further extends this theory with novel elements that allow for the representation of partially observable environments and multiple decisions per business process. By combining a Petri net simulation environment with DRL decision-making capabilities, this work is related to [ 9 ] , which adopts a similar technique with the specific objective of solving job shop scheduling problems. By contrast, GymPN focuses on business process decision-making problems. To facilitate modeling and solving business process decision-making problems, GymPN integrates simulation capabilities with the decision-making capabilities of general sequential decision-making libraries. In table 1 we report some of the most popular packages for sequential decision making that were produced in an academic context, relating them to GymPN. Framework Algorithms Ease of Use Ease of Modelling Agent Type Multi-Action Partial Obs. Gymnasium [ 17 ] DRL High Low Both Yes Yes or-gym [ 7 ] DRL High Low Single No Yes pyknow [ 6 ] Heuristics Medium Medium Single No No POMDPs.jl [ 5 ] Exact, Heuristics, DRL Medium Medium Both No Yes pyomo [ 3 ] Exact, Heuristics Medium Medium Both No No DynaPlex [ 1 ] DRL, Heuristics High Low Single No Yes GymPN DRL, Heuristics High High Single Yes Yes Table 1: Comparison of Business Process Optimization Frameworks. Compared to the basic Gymnasium (which is used internally in GymPN), our library provides a clear set of primitives that greatly simplify the modeling of business process decision-making problems. These primitives include A-E Petri net modeling capabilities, but also popular higher-level modeling languages, such as the Business Process Model and Notation (BPMN) [ 14 ] . Moreover, in GymPN there is no need to specify the state space nor the action space, which greatly reduces the modeling effort. Compared to OR-Gym, which is essentially a collection of Gymnasium environments for operations research, GymPN offers higher flexibility in the modeling phase, while still allowing for easy training and testing of DRL policies. POMDP.jl is suitable for expressing partially observable MDPs but its primitives are only adequate for simple action