Reason2Decide: Rationale-Driven Multi-Task Learning

2025

Read Reason2Decide: Rationale-Driven Multi-Task Learning (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-20074.txt.

Introduction

Quamran Hasan leads a five-author team building clinical AI that must explain itself as it decides. Support systems need sharp predictions. They also need reasons that match those predictions. Self-rationalizing models drift into reasons that do not fit their own outputs. That flaw is called exposure bias. Reason2Decide is a two-stage training frame built against it. It also fights the habit of keeping prediction and explanation apart.

Stage one trains rationale writing. Stage two trains prediction and rationale work jointly. A sampling schedule eases the shift from gold labels to the model's own calls. On three medical data sets, one a private triage set, the method beat fine-tuned rivals. It also beat some zero-shot giants on prediction and on rationale quality. It did so with models forty times smaller than today's foundation models.

Catalog record

YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE47 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-20074

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Reason2Decide: Rationale-Driven Multi-Task Learning Abstract Despite the wide adoption of Large Language Models (LLM)s, clinical decision support systems face a critical challenge: achieving high predictive accuracy while generating explanations aligned with the predictions. Current approaches suffer from exposure bias leading to misaligned explanations. We propose Reason2Decide, a two-stage training framework that addresses key challenges in self-rationalization, including exposure bias and task separation. In Stage-1, our model is trained on rationale generation, while in Stage-2, we jointly train on label prediction and rationale generation, applying scheduled sampling to gradually transition from conditioning on gold labels to model predictions. We evaluate Reason2Decide on three medical datasets, including a proprietary triage dataset and public biomedical QA datasets. Across model sizes, Reason2Decide outperforms other fine-tuning baselines and some zero-shot LLMs in prediction (F1) and rationale fidelity (BERTScore, BLEU, LLM-as-a-Judge). In triage, Reason2Decide is rationale source-robust across LLM-generated, nurse-authored, and nurse-post-processed rationales. In our experiments, while using only LLM-generated rationales in Stage-1, Reason2Decide outperforms other fine-tuning variants. This indicates that LLM-generated rationales are suitable for pretraining models, reducing reliance on human annotations. Remarkably, Reason2Decide achieves these gains with models 40 × 40\times smaller than contemporary foundation models, making clinical reasoning more accessible for resource-constrained deployments while still providing explainable decision support. Keywords: Explainable AI, Explainability, Interpretability, Self-Explainable Models Reason2Decide: Rationale-Driven Multi-Task Learning H M Quamran Hasan, Housam Khalifa Bashier, Jiayi Dai, Mi-Young Kim † , Randy Goebel University of Alberta Edmonton, Alberta, Canada † Camrose, Alberta, Canada {hmquamra, khalifab, dai1, miyoung2, rgoebel}@ualberta.ca Abstract content 1. Introduction The integration of reasoning capabilities with prediction tasks has been a critical research problem in natural language processing (NLP). Existing state-of-the-art language models struggle to balance high predictive accuracy while also generating human-interpretable explanations 17 . Although LLMs have demonstrated strong performance on various question-answering benchmarks 6 ; 23 , their ability to provide rationales that align with their predictions remains limited. This limitation is substantially amplified in healthcare where explanations are essential for trust and adoption. Current approaches for rationale generation face two fundamental challenges. First, the exposure bias problem 22 , which arises when models are trained to generate rationales conditioned only on ground-truth labels, but need to explain their own potentially incorrect predictions during inference. Second, the task separation problem, which occurs when prediction and rationale generation are treated independently rather than as mutually supporting tasks 15 . While multi-task learning has shown promising performance, existing methods have failed to address the train-test discrepancy: models exclusively learn to explain gold-standard labels during training, leaving them unprepared for rationalizing their own prediction during inference. Recent work has acknowledged these challenges and explored various approaches to improve model interpretability. For example, “Chain-of-Thought” (CoT) prompting 26 demonstrates that step-by-step reasoning can improve complex reasoning; similarly, self-consistency techniques 25 show the value of aggregating multiple reasoning paths. However, these methods primarily focus on inference time strategies rather than addressing the fundamental training dynamics that help establish more robust reasoning capabilities. Knowledge distillation approaches 8 and rationale-augmented training 10 have also shown benefits, but do not train models to generate explanations conditioned on their own predictions during training. Here we propose Reason2Decide (Figure 1 ), a framework which trains a single model to jointly predict and generate rationales. Our approach consists of a two-stage training regime, based on insights from curriculum learning 2 and scheduled sampling 1 . The idea is to first learn to model explanation fundamentals and then jointly produce predictions and rationales, where we gradually shift from gold-label conditioning to self-conditioning. Through this process, the model learns to explain its own predictions. This addresses the exposure bias problem while promoting alignment between predictions and rationales. Figure 1 : Overview of Reason2Decide. Stage-1 trains rationale generation. Stage-2 jointly predicts labels and generates label-conditioned explanations with task-level scheduled sampling. A single T5 model is used throughout; inference conditions explanations on the model’s own prediction. The main contributions of this paper are: • We propose Reason2Decide, a two-stage training framework for LLMs that first learns the fundamentals of explanation generation from rationales and then jointly optimizes predictions and rationales in a multi-task setup. • We introduce a scheduled sampling mechanism that gradually transitions from gold labels to predicted label conditioning, mitigating exposure bias in self-rationalization. 2. Related Work Our work builds upon research in rationale generation, multi-task learning, and existing methods to mitigate exposure bias. 2.1. Rationale Generation and Explainable AI A primary goal of Explainable AI (XAI) is making model decisions transparent and interpretable. The development of early XAI methods focused on post-hoc explanation generation by analyzing model internals or feature importance 20 ; 14 . But recently, the field has shifted towards self-explaining models that can learn to generate rationales simultaneously with their predictions 3 . Our work aligns with the latter. For instance, 15 fine-tuned T5 19 models to generate explanations by treating them as a separate task. Similarly, 10 demonstrate that incorporating natural language explanations during training can improve reasoning and generalization. However, these approaches often treat the explanation as a secondary output, which creates a separation between the prediction and its explanation. In contrast, our Reason2Decide framework is designed to align the predictive task with the explanatory one, to help ensure that the explanation is an integral part of the reasoning process. 2.2. Multi-Task Learning and Knowledge Distillation Multi-Task Learning aims to improve generalization by leveraging shared representations across related tasks 21 ; 4 . In NLP, models like T5 are considered multi-task learners by combining diverse problems into a unified text-to-text format. We similarly use this foundation but specifically focus on the alignment between prediction and rationales. Closely related work includes knowledge distillation approaches that use rationales. 8 distills the capabilities of a larger teacher model that generates step-by-step rationales into a smaller student model. While this approach can be effective in improving predictive accuracy, it does not explicitly enforce prediction–explanation coordination. The student model benefits from teacher rationales but is not trained to ensure that its own predictions and explanations are self-consistent. Our method addresses this by explicitly training the coordination between prediction and rationale generation. 2.3. Mitigating Exposure Bias and Scheduled Sampling Exposure bias in self-rationalization occurs when models are trained to generate explanations conditioned on gold labels but at inference time must justify their own predictions. Scheduled sampling 1 addresses the issue by gradual replacement of teacher-forced tokens with model-generated ones. Here, we adapt this principle to the task level, thus treating the model’s predicted label as the conditioning context for rationale generation. Our mechanism systematically transitions from using gold labels to the model’s own predictions, directly mitigating this bias and preparing models for real-world deployment. 3. Methodology Our method addresses the problem of combined prediction and rationale generation, where given an input x (clinical note or biomedical question), a model must predict a discrete label y\in\mathcal{Y} and generate a free-text rationale r which justifies the prediction. To do so, we employ a single encoder-decoder architecture f_{\theta} (T5 variants) that handles both tasks. For example, the model first predicts the label as predict: x \mapsto \hat{y} , then employs the label to condition the rationale as: given label: y^{*} or \hat{y} , explain: x \mapsto \hat{r} , where y^{*} is the gold

Read the complete text