Lost in Models? Structuring Managerial Decision Support in Process Mining with Multi-criteria Decision Making
Rob H. Bemthuis · 2025
Read Lost in Models? Structuring Managerial Decision Support in Process Mining with Multi-criteria Decision Making by Rob H. Bemthuis (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-10236.txt.
Introduction
Rob Bemthuis helps managers choose among the many process models that process mining software produces, in a paper published in two thousand twenty-five. Process mining reconstructs how work actually flows inside an organization, but success breeds overload: dozens of models, each partly right, and no clear way to pick.
His answer is multi-criteria decision making, which scores models on several grounds at once. Hard metrics like fitness and precision count alongside soft factors like cultural fit. An illustrative logistics case uses the Analytic Hierarchy Process to structure the trade-offs. The method aligns the choice with managerial objectives instead of a single accuracy number. Early insights suggest the selected models serve both operations and broader management needs. The study is exploratory, laying a foundation for fuller trials. It reframes model selection as a management decision, not just a technical one.
Catalog record
| CREATOR | Rob H. Bemthuis |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 15 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-10236
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Lost in Models? Structuring Managerial Decision Support in Process Mining with Multi-criteria Decision Making Rob H. Bemthuis Abstract Process mining is increasingly adopted in modern organizations, producing numerous process models that, while valuable, can lead to model overload and decision-making complexity. This paper explores a multi-criteria decision-making (MCDM) approach to evaluate and prioritize process models by incorporating both quantitative metrics (e.g., fitness, precision) and qualitative factors (e.g., cultural fit). An illustrative logistics example demonstrates how MCDM, specifically the Analytic Hierarchy Process (AHP), facilitates trade-off analysis and promotes alignment with managerial objectives. Initial insights suggest that the MCDM approach enhances context-sensitive decision-making, as selected models address both operational metrics and broader managerial needs. While this study is an early-stage exploration, it provides an initial foundation for deeper exploration of MCDM-driven strategies to enhance the role of process mining in complex organizational settings. 1 Introduction Recent advances in process mining have improved the ability to capture and analyze complex organizational workflows through event logs. However, this progress has led to an increasing abundance of process models, often overlapping in scope or providing divergent insights for different stakeholders (e.g., operational vs. managerial) [ 6 , 19 , 20 ] . This “model overload” phenomenon presents strategic challenges: rather than supporting decision-making, the sheer volume of (apparently) competing models can obscure key insights and hamper the alignment of process analytics with organizational objectives. As a result, managers may struggle to distinguish relevant models from irrelevant ones, making it difficult to focus on actionable insights (see e.g., [ 1 , 4 , 13 , 15 ] ). While process mining accelerates business process digitalization, its effectiveness depends on deeper integration with organizational goals, key performance indicators, and managerial expertise [ 21 , 26 ] . Achieving this integration across diverse processes and stakeholders necessitates a robust decision support mechanism that balances tacit knowledge with empirical findings. Traditional decision support systems often fall short in this regard, as they struggle to incorporate subjective managerial perspectives alongside quantitative process metrics. Consequently, decision-makers must navigate complex model repositories without structured guidance, increasing the risk of suboptimal or misaligned choices. Multi-Criteria Decision-Making (MCDM) provides a structured framework for evaluating and prioritizing process models by combining quantitative performance metrics with qualitative managerial insights [ 18 ] . As a well-established decision analysis method, MCDM is particularly effective when no single optimal solution exists, enabling decision-makers to navigate trade-offs between competing criteria [ 3 , 23 ] . Applying MCDM to process mining extends beyond evaluating models based solely on fitness or precision, promoting alignment with both strategic and operational objectives. This paper presents an approach for applying MCDM to address model overload in process mining. We propose an approach that synthesizes process mining outputs while integrating an organization’s strategic priorities. By combining objective indicators (e.g., fitness, precision) with managerial assessments, MCDM provides a structured way for evaluating and prioritizing process models. This approach offers two key benefits: aligning model selection with strategic objectives and clarifying trade-offs in multi-stakeholder decision-making. To illustrate the potential of this approach, we present an illustrative example in a logistics context, where the Analytic Hierarchy Process (AHP) is applied as an MCDM approach to filter and prioritize mined process models. Initial findings suggest that MCDM-based methods can reduce model selection complexity, guide resource allocation toward high-impact analyses, and improve communication between technical and managerial stakeholders. While full-scale validation remains an area for future research, we expect that this concept will generate valuable discussions on integrating decision-making theory, managerial insights, and process mining methods. This work proposes a structured approach for more strategic and context-aware use of process models. The remainder of this paper is as follows. Section 2 discusses related work. Section 3 introduces the proposed MCDM approach. In Sect. 4 , we present an illustrative example in the logistics domain, highlighting initial findings and challenges. Section 5 concludes the paper. 2 Related Work The growing number of discovered process models often results in highly complex structures, commonly referred to as “spaghetti models”, and an overwhelming number of variations. These models can obscure meaningful patterns, making it difficult to derive actionable insights [ 17 ] . While filtering and abstraction techniques help manage complexity, they frequently introduce redundant or conflicting perspectives, further complicating their alignment with organizational objectives [ 20 ] . Moreover, beyond the complexity of each individual model, the sheer volume of potentially overlapping or incompatible models can compound decision-making challenges. Research highlights that stakeholder needs contribute to model overload: highly detailed models, though technically accurate, may be too complex for managerial decision-making [ 2 ] . Analysts often struggle to determine which variant best represents the process in a given context, further complicating their evaluations. Several techniques have been proposed to address complexity. Existing solutions focus on model filtering [ 11 ] , abstraction [ 16 , 28 ] , and domain-specific metrics [ 14 ] . Trace clustering [ 25 ] is a well-known method that groups similar traces and removes minor variations to enhance process comprehension. However, finding the right level of abstraction remains a challenge: excessive simplification may obscure critical details, while insufficient abstraction leaves models too complex. Process performance metrics, such as fitness, precision, and generalization [ 10 ] , can assist in selecting promising process models. Furthermore, complexity measures—including control-flow complexity and node/edge counts—help detect overly complex models [ 4 ] . Nonetheless, these techniques primarily enhance structural clarity rather than directly supporting strategic decision-making. Despite advancements in process mining, consolidating multiple discovered models into a coherent, decision-driven framework remains challenging. Most approaches emphasize structural refinement but often neglect managerial preferences, which favor simplicity and strategic relevance over purely technical model quality. Recent studies have explored MCDM techniques in process mining. For example, [ 24 ] applied MCDM to rank industrial machines for maintenance planning, integrating technical indicators with expert judgment. Similarly, [ 12 ] used AHP for process mining technology selection, incorporating uncertainty and sensitivity analysis to improve ranking robustness. While these studies demonstrate MCDM’s potential for process-related decision-making, they focus on technology and asset selection rather than process model evaluation. Our work builds on that foundation by applying MCDM, specifically AHP, to structurally compare and prioritize discovered process models, thereby contributing to alignment with managerial objectives. 3 Proposed Approach This section presents an MCDM approach to assist in selecting and prioritizing process models (typically obtained from large repositories). As illustrated in Fig. 1 , the approach structures decision-making by ranking and selecting models based on multiple, potentially conflicting criteria: Figure 1 : Proposed MCDM approach for process model selection. 1. Problem definition : define the selection objective, identifying the most relevant process model(s) from a set of discovered alternatives. 2. Criteria identification : evaluation relies on two broad categories. Quantitative metrics : process mining measures, such as fitness, precision, generalization, and simplicity. Qualitative metrics : managerial factors, such as decision-support value (e.g., the model’s ability to highlight operational inefficiencies), stakeholder alignment (e.g., relevance to different stakeholder groups), and implementation feasibility (e.g., potential impact). 3. Application of knock-out criteria : models failing key constraints—such as structural completeness, data quality, or regulatory compliance—are eliminated early. 4. Criteria weighting : weights are determined using pairwise comparisons, entropy-based weighting, or