DMN-Guided Prompting: A Low-Code Framework for Controlling LLM Behavior
Shaghayegh Abedi, Amin Jalali · 2025
Read DMN-Guided Prompting: A Low-Code Framework for Controlling LLM Behavior by Shaghayegh Abedi, Amin Jalali (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-11701.txt.
Introduction
Shaghayegh Abedi and Amin Jalali present, in a 2025 paper, a framework that uses Decision Model and Notation, or DMN, to control the behavior of large language models. In most systems, decision logic is written directly into prompts, which makes it hard for end users to change. DMN instead expresses decision logic in a standard, structured format that non-specialists can read and edit.
The framework breaks complex decision logic into smaller components and guides the model through them in a structured pathway. The authors implemented it in a graduate course, where the system generated feedback on student assignments from the assignments and DMN models written by the instructor. The instructor evaluated the feedback, and the approach outperformed chain-of-thought prompting in the case study. Students also rated the feedback as useful in a survey.
Catalog record
| CREATOR | Shaghayegh Abedi, Amin Jalali |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 28 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-11701
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
DMN-Guided Prompting: A Low-Code Framework for Controlling LLM Behavior Shaghayegh Abedi, Amin Jalali Abstract Large Language Models (LLMs) have shown considerable potential in automating decision logic within knowledge-intensive processes. However, their effectiveness largely depends on the strategy and quality of prompting. Since decision logic is typically embedded in prompts, it becomes challenging for end users to modify or refine it. Decision Model and Notation (DMN) offers a standardized graphical approach for defining decision logic in a structured, user-friendly manner. This paper introduces a DMN-guided prompting framework that breaks down complex decision logic into smaller, manageable components, guiding LLMs through structured decision pathways. We implemented the framework in a graduate-level course where students submitted assignments. The assignments and DMN models representing feedback instructions served as inputs to our framework. The instructor evaluated the generated feedback and labeled it for performance assessment. Our approach demonstrated promising results, outperforming chain-of-thought (CoT) prompting. Students also responded positively to the generated feedback, reporting high levels of perceived usefulness in a survey based on the Technology Acceptance Model. 1 Introduction Large Language Models (LLMs) have shown considerable potential in automating decision logic within knowledge-intensive processes [ 12 ] . Their capabilities are increasingly leveraged across multiple domains where complex decisions must be made. However, the effectiveness of LLMs critically depends on the quality of their instructions, a.k.a, prompts. Developing such prompts—commonly known as prompt engineering—is often a trial-and-error process, requiring technical expertise and posing challenges related to transparency, reusability, and maintenance [ 15 , 19 ] . As decision logics evolve, their instructional prompts must also be adapted—a task often non-trivial for business users lacking technical proficiency in developing or adjusting prompts. To address these challenges, we propose a novel prompting strategy that integrates Decision Model and Notation (DMN) into prompt definitions. DMN is a standardized graphical notation for modeling decision logic [ 5 , 1 ] . By leveraging DMN to modularize and guide prompt structures, our strategy enables LLMs to follow structured decision pathways, breaking down complex logic into interpretable and manageable components. This approach reduces the dependency on ad hoc prompt engineering, making it easier to understand, modify, and maintain—particularly in settings where clarity, consistency, and collaboration are essential. We operationalized this idea in a DMN-guided prompting framework configured in a graduate-level course to automatically support generating feedback for students’ assignments while having the instructor in the loop. Students submitted graphical models representing domain-specific decisions. These models were transformed into natural texts, which are given to our framework in addition to instructional DMN rules defined by the course instructor. The framework generated feedback, which was given to students after the instructor labeled them so students could distinguish between correct and incorrect feedback. These labeled data were used to evaluate the approach, and the results show that DMN-guided prompting outperformed equivalent prompts defined purely using chain-of-thought prompting [ 20 ] . In addition, students reported high levels of perceived usefulness, as measured through a survey designed based on the Technology Acceptance Model (TAM) [ 4 ] . The remainder of the paper is organized as follows. Section 2 provides a brief background on Decision Model and Notation (DMN) and prompt engineering, outlining their relevance for guiding the behavior of Large Language Models. Section 3 introduces the proposed DMN-guided prompting framework. Section 4 presents the case study conducted in a graduate-level course, explaining the implementation process, reporting evaluation results, and discussing the strengths and limitations observed in the study. Finally, Section 5 concludes the paper and introduces future directions. 2 Background This section briefly details the “Decision Model and Notation” and “Prompt Engineering”. 2.1 Decision Model and Notation Decision Model and Notation (DMN) is a standard developed by the Object Management Group (OMG) to represent decision logic in a clear, structured, and interpretable format [ 1 ] . It is widely used in business process management to separate decision logic from process flows, enabling organizations to formalize and automate operational decisions transparently. A key advantage of DMN is its accessibility to both business professionals and technical users. It offers graphical and tabular notations that help bridge the gap between informal business rules and executable logic [ 14 , 2 ] . DMN supports decision modeling using the Decision Requirements Diagram (DRD) [ 1 ] . Figure 1: A decision requirements diagram example. Figure 1 presents a sample DRD that will serve as a running example throughout this paper to illustrate our approach (for the complete DMN specification, refer to [ 1 ] ). This diagram specifies the rules for a fictitious loan eligibility process, where the decision is based on the applicant’s Salary and Credit Score , modeled as input data elements. A decision table element, named Loan Approval Rule , encodes the decision logic. The decision output is then passed to a literal expression element, called Loan Approval Result . Literal expressions represent decision logic using textual statements—in this case, defining the message to be displayed to the user based on the decision outcome. Loan Approval is an annotation that does not have any semantics yet enables providing more information about elements in the DMN model. Figure 2: A decision table example. Figure 2 illustrates how the Loan Approval Rule decision table specifies the decision logic. In DMN, a decision table can be used to document the rules governing a decision. Each row in this table represents an individual rule, while columns define the conditions (inputs) and their corresponding outcomes (outputs). This tabular structure is intuitive for many users, resembling familiar tools such as spreadsheets. In our example, the loan will be approved if the applicant’s salary exceeds 50,000 and their credit score is greater than or equal to 700. The rules in this example are evaluated top-down, and the dash symbols in the final row represent a wildcard (“any input value”), which applies when none of the above rules evaluate to true. Figure 3 shows how the literal expression is defined using the Friendly Enough Expression Language (FEEL). Based on the decision outcome, this expression determines the message to be shown to the user. Figure 3: A literal expression example. It is important to note that we only present a simplified DMN example here to introduce the essential concepts relevant to this paper. DMN supports a variety of modeling styles, with detailed specifications provided in [ 1 ] . Overall, DMN offers a modular and interpretable framework for defining decision logic. While it has traditionally been applied in operational and compliance domains, its potential for structuring interactions between domain experts and AI-based systems such as Large Language Models (LLMs) remains largely unexplored. This study investigates how DMN can guide LLMs in generating consistent and correct feedback. 2.2 Prompt Engineering Prompt engineering refers to designing input instructions that effectively guide the behavior of Large Language Models. Because LLMs generate output based on probabilistic patterns learned from large datasets, their responses are susceptible to the wording, structure, and context provided in the prompt. As a result, prompt engineering is critical in ensuring the relevance, accuracy, and clarity of the model’s output [ 13 , 17 ] . A variety of prompting strategies have emerged in recent research. These include zero-shot prompting, where the model is