Calibration-Reasoning Framework for Descriptive Speech Quality Assessment Elizaveta, Mathieu, Milos Abstract Explainable speech quality assessment requires moving beyond Mean Opinion Scores (MOS) to analyze underlying perceptual dimensions. To address this, we introduce a novel post-training method that tailors the foundational Audio Large Language Model for multidimensional reasoning, detection and classification of audio artifacts. First, a calibration stage aligns the model to predict predefined perceptual dimensions. Second, a reinforcement learning stage leverages Group Relative Policy Optimization (GRPO) with dimension-specific rewards to heavily enhance accuracy of descriptions and temporal localization of quality issues. With this approach we reach state-of-the-art results of 0.71 mean PCC score on the multidimensional QualiSpeech benchmark and 13% improvement in MOS prediction driven by RL-based reasoning. Furthermore, our fine-grained GRPO rewards substantially advance the model’s ability to pinpoint and classify audio artifacts in time. Kostenok Salzmann Cernak keywords descriptive speech quality assessment, audio LLMs, post-training † † address: 1 EPFL, Lausanne, Switzerland 2 Logitech, Lausanne, Switzerland † † email: lisakostenok@gmail.com, mathieu.salzmann@epfl.ch, mcernak@logitech.com 1 Introduction Non-intrusive speech quality assessment methods mainly target MOS score, as closest measure of human perception. While deep learning models approximate it with high accuracy [ 12 , 15 , 11 ] , their ”black-box” predictions lack interpretability. Efforts to bridge this gap decompose quality into perceptual dimensions like intelligibility and naturalness [ 7 , 13 , 5 , 21 ] . Although these approaches offer a more nuanced perspective, they are restricted to quantitative assessment; they can neither characterize the specific types of audio artifacts nor localize them within the audio recording. Audio Large Language Models (Audio LLMs) have recently shifted the field toward Explainable MOS – generating descriptive assessments to interpret these scores [ 20 , 8 , 1 , 19 ] . Beyond outputting verifiable numerical values, these models can leverage natural language reasoning to classify artifacts and localize them in time. However, current Explainable MOS systems prioritize conversational fluency over diagnostic precision. Because the descriptive quality assessment task is absent from their pre-training mixtures, their reasoning is often ungrounded; their MOS prediction accuracy typically falls short of traditional score-based methods due to interference from hallucinated or incorrect dimension-wise predictions. To serve as a reliable diagnostic tool rather than a general audio quality summarization, these models require targeted alignment that strictly enforces both dimensional and temporal accuracy. To bridge this gap, we introduce a two-stage post-training methodology comprising a Calibration stage to learn dimension-wise scales, and a Reasoning stage implemented via GRPO [ 17 ] with fine-grained, dimension-specific rewards. When applied to the Audio Flamingo 3 model [ 2 ] , Calibration-Reasoning framework 1 1 1 Audio samples and generated assessments are available at https://calibrationreasoningframework.github.io/audiollmdemo/ ; model weights are hosted at https://huggingface.co/kostl/af3-sqa-grpo , with source code to be released upon publication. sets a new state-of-the-art on QualiSpeech [ 20 ] benchmark, outperforming existing baselines in dimension-wise judgments and the temporal localization of audio artifacts. Figure 1: Overview of end-to-end fine-tuning pipeline. 2 Related Work Current approaches to descriptive speech quality assessment generally rely on coupling a pretrained audio encoder for feature extraction with an LLM for text generation, followed by fine-tuning on dimension-specific annotations. Authors of QualiSpeech [ 20 ] describe a two-stage pipeline (hereafter, QualiSpeech-FT) with Supervised Fine-Tuning (SFT) in both stages, learning dimension-wise scores followed by long-form descriptions. While the classification and detection of audio artifacts improve after the second stage, dimension-wise score prediction slightly degrades. The authors cite the limited reasoning capacity of the Vicuna [ 23 ] LLM backbone as a potential bottleneck in their multimodal system, as it is outperformed by GPT-4o-mini [ 9 ] in deriving MOS from dimension-wise scores. Another method, SpeechQualityLLM [ 8 ] , jointly fine-tunes audio encoder with LLM decoder on NISQA [ 7 ] dataset to predict MOS and dimension-wise scores with justification in natural language. It focuses primarily on evaluations of scores, considering generated descriptions as supplementary and leaving the quality of the textual reasoning unassessed. To improve reasoning relative to SFT, more recent approaches integrate Reinforcement Learning (RL) into the training pipeline. The ALLD framework [ 1 ] utilizes Direct Preference Optimization (DPO)-style [ 10 ] reward, while also increasing the alignment between Audio LLM and expert text-only LLM outputs via token-level distillation. SQ-LLM [ 19 ] applies RL after SFT on long-form descriptions, using GRPO to optimize broad, response-level rewards (e.g., Helpfulness, Accuracy ). While standard for text reasoning, this unified reward structure does not explicitly isolate feedback for individual speech quality dimensions. To address these limitations, our proposed method explicitly optimizes the model using reward signals tied directly to individual quality dimensions. Furthermore, to prevent the reasoning bottlenecks observed in prior work, we build our framework upon a state-of-the-art Audio LLM in the 7–8 billion parameter range. 3 Method Our approach is illustrated in Figure 1 . It consists of two stages: Calibration and Reasoning, which we describe below. 3.1 Calibration First, we fine-tune model for muldimensional judgments using supervised fine-tuning. For each aspect, model learns quality scores on a scale [1, 5], where higher score corresponds to the higher quality, provided with criteria for each score in the prompt. It optimizes the likelihood of ground truth answers with Cross-Entropy loss: \mathcal{L}^{SFT}(\theta)=-\sum_{t=1}^{T}logp_{\theta}(y_{t}|y_{