LLMs for Explainable Business Decision-Making: A Reinforcement Learning Fine-Tuning Approach

Xiang Cheng, Wen Wang, Anindya Ghose · 2026

Read LLMs for Explainable Business Decision-Making: A Reinforcement Learning Fine-Tuning Approach by Xiang Cheng, Wen Wang, Anindya Ghose (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-04208.txt.

Introduction

Xiang Cheng, Wen Wang, and Anindya Ghose tackle a gap in business AI: decisions are given, but the reasons stay opaque. Standard explanation tools list numeric feature weights, which rarely form a coherent story. Language models could tell that story, yet their explanations must stay true to the real drivers, fit different audiences, and be trained without costly human-scored examples.

Their framework, LEXMA, fine-tunes a language model with reinforcement learning in stages. Reflection-aided supervised tuning comes first, then two rounds of group-relative policy tuning that adjust separate settings for correctness and for audience style, using rewards that need no human labels. Tested on mortgage approval, LEXMA beats other language model baselines on accuracy. Human judges rate its expert explanations as more risk-focused and its consumer ones as clearer, more usable, and more polite.

Catalog record

CREATORXiang Cheng, Wen Wang, Anindya Ghose
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE67 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-04208

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

LLMs for Explainable Business Decision-Making: A Reinforcement Learning Fine-Tuning Approach Xiang Cheng, Wen Wang, Anindya Ghose Abstract Artificial Intelligence (AI) models increasingly drive high-stakes consumer interactions, such as credit approvals, yet their decision logic often remains opaque. Prevailing explainable AI techniques rely on post hoc numerical feature attributions, which fail to provide coherent narratives behind model decisions. Large language models (LLMs) present an opportunity to generate natural-language explanations, but three design challenges remain unresolved: explanations must be both decision-correct and faithful to the factors that drive the prediction; they should be able to serve multiple audiences without shifting the underlying decision rule; and they should be trained in a label-efficient way that does not depend on large corpora of human-scored explanations. To address these challenges, we introduce LEXMA (LLM-based EXplanations for Multi-Audience decisions), a reinforcement-learning-based fine-tuning framework that produces narrative-driven, audience-appropriate explanations. LEXMA combines reflection-augmented supervised fine-tuning with two stages of Group Relative Policy Optimization (GRPO). Specifically, it fine-tunes two separate parameter sets to improve decision correctness and satisfy stylistic requirements for different audiences, using reward signals that do not rely on human-annotated explanations. We instantiate LEXMA in the context of mortgage approval decisions. Results demonstrate that LEXMA yields significant improvements in predictive performance compared with other LLM baselines. Moreover, human evaluations show that expert-facing explanations generated by our approach are more risk-focused, and consumer-facing explanations are clearer, more actionable, and more polite. Our study contributes a cost-efficient, systematic LLM fine-tuning approach to enhance explanation quality for business decisions, offering strong potential for scalable deployment of transparent AI systems. keywords Large Language Models, Explainability, Reinforcement Learning, Group Relative Policy Optimization, Multi-Objective Tuning † † manuscriptno: 1 † † runningauthor: Cheng, Wang, and Ghose † † runningtitle: LLMs for Explainable Business Decision-Making † † authors: Robert H. Smith School of Business, University of Maryland {xccheng, wenw}@umd.edu Leonard N. Stern School of Business, New York University [email protected] † † affiliation: † † affiliation: † † affiliation: † † affiliation: 1 Introduction Artificial intelligence (AI) systems increasingly drive high-stakes marketing decisions, including targeting, credit and eligibility assessment, and dynamic pricing ( 6 , 15 , 26 ) . In these settings, a lack of transparency in model behavior can have serious consequences for firms and their stakeholders, such as regulatory penalties, perceived unfairness, and reduced consumer trust ( 29 ) . Consequently, explainable AI, which seeks to make model decision mechanisms understandable to humans ( 22 ) , has become a central concern for organizations and regulators ( 2 , 23 ) . Most established techniques in explainable AI focus on producing numerical feature attributions. For instance, the Shapley additive explanations (SHAP) value method assigns weights to features according to their contribution to model predictions ( 20 ) . Although widely used in practice (e.g., 30 ), these methods have several limitations. For one, attribution methods are predominantly post hoc. They approximate a black-box model that has already been trained, rather than embedding explanatory logic inside the decision-making process itself. This approximation inherently limits their explanatory power and reliability ( 32 ) . Moreover, most attribution techniques implicitly assume structured, tabular inputs with predefined features and therefore cannot naturally handle unstructured inputs such as free text. Finally, most attribution-based explanations are numeric. They highlight which features are important but do not naturally produce coherent, narrative rationales. In marketing settings, this lack of narrative explanation limits the usefulness of AI systems for both consumers and managers, whose perceptions of fairness and transparency shape trust, loyalty, and adoption of algorithmic decisions ( 22 , 28 ) . Recent advances in generative AI, and in large language models (LLMs) in particular, create an opportunity to move beyond numeric explanations by generating natural-language rationales for complex decisions ( 10 , 16 , 36 ) . However, three design challenges remain unresolved in using LLMs to explain decisions. First, explanations must be both decision-correct and decision-aligned. Predictive accuracy is a prerequisite for any useful explanation, yet deep learning models, including LLM-based approaches, often underperform Gradient Boosting methods on tabular data ( 11 ) . At the same time, an LLM that simply predicts and then generates a narrative about its prediction can produce fluent but unfaithful rationales that are not the real basis for its decision ( 33 ) . A practical system therefore needs an architecture and training scheme in which the model can achieve high predictive performance and in which the explanation is tightly coupled to the factors that drive the decision, rather than functioning as a post hoc justification. Second, in many customer-facing contexts, decisions must be communicated to multiple audiences. The same credit decision may be read by loan officers and consumers, who require different levels of detail, terminology, and tone, yet the underlying decision rule must remain stable. Simply re-prompting an LLM with different roles, for example “speak as an underwriter” versus “write to the applicant”, can change both the explanation and the decision, which compromises the robustness of the system ( 2 ) . Third, organizations need a way to improve explanation quality that is label-efficient. Using a large corpus of human-annotated explanations to fine-tune a model is costly; a scalable approach should therefore rely primarily on existing decision labels rather than extensive human-labeled explanation annotations. Motivated by these challenges, we ask the following research question: How can we fine-tune large language models in a cost-efficient way so that they deliver decision-correct, decision-aligned explanations and support audience-specific communication? To illustrate these challenges, consider mortgage approval as a concrete decision context. In typical practice, an AI system screens applications and proposes a preliminary approve or deny recommendation. A loan officer reviews the AI recommendation and makes the final decision. The consumer then receives the decision and relevant explanations. The top panel of Figure 1 depicts this workflow. In this context, each of the three challenges is salient. Decision-correct and decision-aligned explanations are critical because expert reviewers rely on the system’s rationale to triage files. There are inherent multi-audience needs for decision communication: internal professionals require precise, risk-focused rationales that cite case-specific evidence, while consumers need plain, respectful, and actionable guidance that avoids jargon yet remains consistent with the same decision rule. Label-efficiency is also essential, since institutions rarely maintain large corpora of human-written explanations paired with quality scores. The bottom panel of Figure 1 summarizes our objective: to fine-tune a large language model that generates accurate decisions and audience-specific explanations for experts and consumers. Figure 1: Illustration of a Mortgage Decision Workflow and Our Goal To address these challenges, we design LEXMA (LLM-based EXplanations for Multi-Audience decisions), a multi-objective fine-tuning framework for LLM-based explainable decision-making. LEXMA addresses each of the three challenges above. To address the need for decision-correct and decision-aligned explanations, it treats the decision as the end of a joint reasoning and explanation process: the model first produces an internal reasoning trace, then generates a concise, audience-appropriate explanation, and finally issues a prediction that is conditioned on the reasoning and explanation. Training is implemented so that rewards for correct decisions are applied to the entire Reasoning \rightarrow Explanation \rightarrow Prediction trajectory, which encourages explanations that highlight case factors associated with accurate predictions and improves predictive performance. To address the multi-audience requirement,

Read the complete text