CLSGen: A Dual-Head Fine-Tuning Framework for Joint Probabilistic Classification and Verbalized Explanation

WonJin Yoon, Kangyu Zhu, Ian Bulovic, Autumn Sehy, Yanjun Gao Dmitriy Dligach Majid Afshar Timothy A. Miller, [1em] Boston Children’s Hospital, [0.5em] Equal contribution. Work done at BCH; now at TikTok USA(KZ) and Lightcast (AS).[0.5em] {firstname.lastname}@[email protected] , [email protected] , [email protected] · 2026

Read CLSGen: A Dual-Head Fine-Tuning Framework for Joint Probabilistic Classification and Verbalized Explanation by WonJin Yoon, Kangyu Zhu, Ian Bulovic, Autumn Sehy, Yanjun Gao Dmitriy Dligach Majid Afshar Timothy A. Miller, [1em] Boston Children’s Hospital, [0.5em] Equal contribution. Work done at BCH; now at TikTok USA(KZ) and Lightcast (AS).[0.5em] {firstname.lastname}@[email protected] , [email protected] , [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-11801.txt.

Introduction

Yoon and seven colleagues present CLSGen, a fine-tuning method that lets a language model give sound odds for yes-or-no sorting tasks while still writing explanations. Plain discriminative tuning, they note, often wipes out explanation skill through catastrophic forgetting and linguistic collapse. On several test sets, CLSGen beats baselines on sorting scores, and its explanations match its predicted labels closely while staying easy to read.

Catalog record

CREATORWonJin Yoon, Kangyu Zhu, Ian Bulovic, Autumn Sehy, Yanjun Gao Dmitriy Dligach Majid Afshar Timothy A. Miller, [1em] Boston Children’s Hospital, [0.5em] Equal contribution. Work done at BCH; now at TikTok USA(KZ) and Lightcast (AS).[0.5em] {firstname.lastname}@[email protected] , [email protected] , [email protected]
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE44558
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.11801

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

CLSGen: A Dual-Head Fine-Tuning Framework for Joint Probabilistic Classification and Verbalized Explanation WonJin Yoon, Kangyu Zhu, Ian Bulovic, Autumn Sehy, Yanjun Gao Dmitriy Dligach Majid Afshar Timothy A. Miller, [1em] Boston Children’s Hospital, [0.5em] Equal contribution. Work done at BCH; now at TikTok USA(KZ) and Lightcast (AS).[0.5em] {firstname.lastname}@[email protected] , [email protected] , [email protected] Abstract With the recent progress of Large Language Models (LLMs), there is a growing interest in applying these models to solve complex and challenging problems. Modern LLMs, capable of processing long contexts and generating verbalized explanations, offer significant potential in addressing real-world applications. However, a critical hurdle in deploying LLMs for practical decision-making is their inability to provide reliable, quantitative probabilities. While task-specific fine-tuning of LLMs using traditional discriminative objectives (similar to encoder-only models) can yield probability estimates, this often leads to catastrophic forgetting and linguistic collapse. Consequently, the model loses its ability to generate explanations, severely undermining its interpretability and usability. To address this challenge, we propose CLSGen, a novel LLM fine-tuning framework designed for binary classification tasks. The CLSGen framework encompasses a new model architecture, training methodology, and data construction strategy to enable robust probability estimation without sacrificing the model’s inherent explanation-generation capabilities. Experimental results across multiple benchmark datasets demonstrate that models fine-tuned with CLSGen outperform existing baselines in classification metrics (AUROC and F1-score). Regarding explanation, the results showed strong alignment between predicted labels and generated justifications, as well as high readability. 1 Introduction Recently, Large Language Models (LLMs) have demonstrated progress in performance in complex reasoning tasks including those requiring lengthy inputs ( 24 ) , opening the opportunity for expansion of their application into specialized domains such as clinical and biomedical fields. In particular, applications in patient outcome prediction and drug discovery have garnered significant attention, highlighting the immense potential of LLMs in these high-stakes areas ( 22 ; 2 ) . In response to this trend, domain-specific benchmarks such as LCD benchmark ( 29 ) and CliniFact ( 30 ) have been proposed. However, several hurdles remain before these models can be effectively deployed in real-world scenarios. In fields requiring high-stakes decision-making, users demand not only high performance but also (1) Confidence Estimation (how certain the model is) and (2) Explanation (why the model made such a decision) ( 1 ; 31 ) . While modern LLMs have become increasingly capable of providing plausible verbalized explanations, quantifying internal confidence or probability remains an area of active research. In this study, we propose a novel fine-tuning framework, within the specific context of binary classification, that provides both probability and explanation. While various attempts have been made to derive probabilities from LLMs without fine-tuning, each possesses inherent limitations (detailed in the Related Work section). A straightforward approach to producing probabilities, which is well-established in encoder-only model research, is to utilize the model for contextual representation by adding a Sigmoid layer to the final output and fine-tuning with a Binary Cross-Entropy (BCE) loss. However, this method can lead to catastrophic forgetting ( 17 ; 16 ) , where the model loses its original capabilities. In this case, text generation, which constitutes a core advantage of LLMs, can be lost. Consequently, the model becomes unable to provide the verbalized explanations (More details in Section 3 ). To overcome these limitations, we propose a comprehensive fine-tuning framework, CLSGen , that consists of a new model architecture, training methodology, and data construction strategy. Our framework incorporates both classification and data generation into the training objective to ensure the text generation quality is maintained, allowing the model to provide both classification probability and verbalized explanations. The proposed architecture utilizes a decoder-only model equipped with a dual-head structure: a standard language modeling (LM) head for text generation and an additional Sigmoid layer for classification. Regarding data construction, we employ a strategy inspired by weakly supervised learning, utilizing an LLM-based method to generate high-quality target text pairs as training data. We validated our framework on challenging, real-world scenario benchmarks, including datasets characterized by long-context requirements that existing models often struggle to solve. Our models were evaluated through a diverse range of metrics, including classical measures (AUROC, F1-score), statistical measures (Cohen’s Kappa), and qualitative assessments via LLM-as-a-judge. The results demonstrate that our approach outperforms inference-only and baseline fine-tuning methods in classification performance while achieving high scores in both readability and consistency between classification and generation outputs. 2 Related Work 2.1 Probability estimation for LLMs Existing approaches to probability estimation for LLMs can be broadly categorized into single-run and iteration-based methods. Single-run methods derive a confidence score from a single model inference. One instance of this type of method, token probability approaches, extracts confidence from the model’s internal log-probabilities over the predicted label tokens, leveraging the model’s intrinsic calibration ( 12 ; 6 ) . Verbalized probability methods, another single-run type of method, instead prompt the model to explicitly output a numerical confidence score as part of its response ( 26 ; 27 ) . While computationally efficient, both approaches carry known limitations: token probabilities are sensitive to tokenization choices and do not reflect the full reasoning process, whereas verbalized confidence is prone to systematic overconfidence and miscalibration ( 26 ; 27 ; 4 ; 9 ) . Iteration-based methods run the model multiple times to produce a more robust probability estimate. Self-consistency ( 25 ) samples diverse reasoning paths and uses majority voting as a confidence proxy. Semantic entropy ( 13 ) takes a complementary approach by clustering semantically equivalent generations and computing uncertainty over meaning rather than surface form. Tournament-based approaches extend this by performing pairwise comparisons across multiple runs, demonstrating strong discrimination performance ( 28 ; 21 ) ; however, multi-label settings remain largely unexplored. A shared limitation across all iteration-based methods is their high computational cost; moreover, they yield a scalar confidence value without any accompanying verbal explanation, which is critical for high-stakes decision-making. 2.2 Reinforcement Learning based finetuning Reinforcement learning (RL)-based finetuning represents another paradigm for aligning LLM outputs with desired behaviors. Reinforcement Learning from Human Feedback (RLHF) ( 18 ) trains a reward model from human preference annotations and optimizes the language model policy via PPO. Direct Preference Optimization (DPO) ( 19 ) simplifies this pipeline by directly optimizing on preference pairs without a separate reward model. More recently, Group Relative Policy Optimization (GRPO) ( 20 ) eliminates the need for a critic model by using group-level reward normalization, and outcome-reward RL has demonstrated strong results in training reasoning-capable models ( 8 ) . While our approach shares the goal of aligning outputs with desired properties, it differs fundamentally: rather than optimizing a reward signal, we jointly fine-tune classification and generation objectives through a dual-head architecture, avoiding the instability and complexity of RL-based training. 3 Motivation Self-attention is the mechanism for computing sequence representations ( 23 ) . In the early stages of Transformer research, encoder-only models such as BERT predominantly utilized the output of a specific position, typically the first token, [CLS], as a global representation for classification tasks. Similar approaches to provide vectorized representations of tokens or sequences have recently been proposed for decoder-only models as well (e.g., Gemini Embedding ( 15 ) ). However, since LLMs are pre-trained for text generation, fine-tuning a decoder-only LLM

Read the complete text