Two-Stage Reasoning-Infused Learning: Improving Classification with LLM-Generated Reasoning

Mads Henrichsen, Rasmus Krebs · 2025

Read Two-Stage Reasoning-Infused Learning: Improving Classification with LLM-Generated Reasoning by Mads Henrichsen, Rasmus Krebs (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-00214.txt.

Introduction

Mads Henrichsen and Rasmus Krebs add spoken style reasoning to text sorting in a 2025 computing paper. Standard sorting models map text straight to a label, with no stated steps in between. That can limit accuracy and makes the choice hard to read. Their method works in two stages, using a language model that writes out its reasoning first.

First they tune a small model to write reasoning for a question and its answer. Then they use it to build a richer training set for a second model, which learns to give reasoning and then the label. On an emotion data set, the new model beat a plain label only model by 8.7 points of accuracy.

Catalog record

CREATORMads Henrichsen, Rasmus Krebs
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE24 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-00214

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Two-Stage Reasoning-Infused Learning: Improving Classification with LLM-Generated Reasoning Mads Henrichsen, Rasmus Krebs Abstract Standard classification models often map inputs directly to labels without explicit reasoning, potentially limiting their performance, robustness, and interpretability. This paper introduces a novel two-stage approach to enhance text classification by leveraging Large Language Model (LLM)-generated reasonings. In the first stage, we fine-tune a Llama-3.2-1B-Instruct model (henceforth Llama-R-Gen ) on a general-purpose reasoning dataset ( syvai/reasoning-gen ) to generate textual reasoning (R) given a question and its answer. In the second stage, this generally trained Llama-R-Gen is used offline to create an augmented training dataset for a downstream generative model. This downstream model, based on Llama-3.2-1B-Instruct, takes only the input text (Q) and is trained to output the generated reasoning (R) immediately followed by the predicted emotion (A). We demonstrate this methodology on the dair-ai/emotion dataset for emotion classification. Our experiments show that the generative model trained to output reasoning and the emotion ( Classifier_Q->RA ) achieves a significant improvement of 8.7 percentage points in accuracy (for emotion prediction) compared to a baseline generative model trained solely to output the emotion ( Classifier_Q->A ), highlighting the strong generalization capabilities of the reasoning generation and the benefit of explicit reasoning training. This work underscores the potential of LLM-generated reasonings for creating richer training datasets, thereby improving the performance of diverse downstream NLP tasks and providing explicit explanations. 1 Introduction Text classification systems are pivotal in numerous applications, from sentiment analysis to spam detection, aiming to categorize text into predefined labels [ 4 ] . However, many contemporary text classification models operate as ”black boxes,” directly mapping text to labels without an explicit intermediate reasoning process [ 8 ] . This lack of transparency can hinder model performance, particularly on complex inputs requiring multi-step inference or nuanced understanding, and makes it difficult to diagnose failures or build trust in the system’s outputs. The ability to reason is a hallmark of human intelligence and is increasingly recognized as a crucial component for advancing artificial intelligence [ 11 ] . While large language models (LLMs) have shown impressive capabilities in generating coherent text and performing in-context learning [ 2 , 10 , 1 ] , explicitly incorporating reasoning into the training paradigm of downstream task models remains an active area of research. In this paper, we propose a two-stage framework to improve text classification performance by infusing training data with LLM-generated reasonings. Our core hypothesis is that training a model to explicitly generate a reasoning path alongside its prediction will enable it to learn more robust representations and make more accurate predictions for the target label. Furthermore, by directly generating this reasoning, our system inherently provides both the predicted label and the explanatory reasoning behind it. While the framework is generally applicable to various text classification tasks, we demonstrate its efficacy on emotion classification using the dair-ai/emotion dataset. The two stages are: 1. Reasoning Generation (Llama-R-Gen): We fine-tune a Llama-3.2-1B-Instruct model ( Llama-R-Gen ) on a general-purpose reasoning dataset. This training teaches the model to generate step-by-step reasoning given a question and its corresponding answer. 2. Reasoning-Generated Classification ( Classifier_Q->RA ): The Llama-R-Gen model is then used offline to create an augmented training dataset for a downstream generative model. This downstream model, based on Llama-3.2-1B-Instruct, is trained to take only the input text (Q) and directly generate a combined sequence of the reasoning (R) and the predicted class (A). This integrated generation ensures that the model outputs both the reasoning and the predicted emotion as a single coherent response. Our contributions are threefold: • We present a methodology for fine-tuning a model on a general reasoning dataset to develop a reasoning generation model, designed to be transferable to new domains. • We introduce a novel dataset augmentation strategy that enriches text classification datasets by creating (Text, Reasoning + Label) pairs, training a downstream generative model to produce explicit reasonings alongside its predictions. • We provide a comprehensive validation of our methodology on the dair-ai/emotion dataset, demonstrating that our reasoning-infused learning approach significantly improves emotion classification accuracy compared to a strong baseline. The remainder of this paper is structured as follows: Section 2 discusses related work. Section 3 details our two-stage methodology. Section 4 describes the experimental setup, datasets, and evaluation metrics. Section 5 presents and analyzes the results. Section 6 discusses the implications and limitations of our findings, and Section 7 concludes the paper. 2 Related Work Our work builds upon several key areas in natural language processing. Chain-of-Thought Prompting. The popularization of Chain-of-Thought (CoT) prompting has shown that eliciting intermediate reasoning steps from LLMs at inference time can significantly improve performance on complex tasks [ 11 , 5 ] . These methods typically apply to very large, general-purpose models in a few-shot or zero-shot setting. In contrast, our work adapts this principle for smaller, fine-tuned models. Instead of prompting for a reasoning path at inference, we pre-generate reasonings to create a richer training dataset, aiming to distill the reasoning capability into a more efficient, task-specific model. Explainable AI (XAI) in NLP. A growing body of research aims to make NLP models more transparent by generating explanations for their predictions. Some approaches train models to extract text snippets as rationales [ 6 ] , while others use human-annotated explanations for supervision, as seen in datasets like e-SNLI [ 3 ] . For example, Rajani et al. 2019 demonstrated that training on human-written explanations can improve model performance and generalization. Our work aligns with this goal but differs in methodology: we use a general-purpose LLM to *generate* explanations automatically, thereby reducing the dependency on costly human annotation and enabling scalability to datasets without existing explanations. Dataset Augmentation. Data augmentation is a standard technique for improving model generalization by increasing training data size and diversity [ 9 ] . Traditional NLP methods include back-translation or synonym replacement. Our approach introduces a novel form of augmentation by synthesizing structured, explanatory content (the reasoning) and prepending it to the target label. This provides a much richer supervisory signal than simple label-to-text mapping, pushing the model to learn the ”why” behind a prediction, not just the ”what.” Learning with Reasonings. Prior work has explored jointly training models to predict labels and generate explanations. Wiegreffe and Pinter 2021 explored various settings for ”learning from explanations,” showing that explanations can serve as a valuable supervisory signal. Our two-stage framework provides a practical and scalable method to achieve this. By first training a dedicated reasoning generator on a broad corpus and then using it to augment data for a separate downstream classifier, we decouple the complex task of general reasoning from the specific classification task, allowing each model to specialize. This modular approach contrasts with end-to-end systems and proves effective for transferring reasoning skills to a new domain. 3 Methodology Our proposed two-stage reasoning-infused learning framework is depicted in Figure 1 . We first train a reasoning generation model and then use its output to construct an augmented training dataset for a downstream generative classifier. Figure 1: Overview of the two-stage reasoning-infused learning framework. Stage 1 involves fine-tuning Llama-R-Gen on a general dataset to learn how to generate reasoning (R) from (Question, Answer) pairs. Stage 2 uses the trained

Read the complete text