Diagnosing Capability Gaps in Fine-Tuning Data

Saeid Asgari Taghanaki, Rakshanda Agarwal, Bruce Sun, Rohan Jha, Elias Stengel-Eskin · 2026

Read Diagnosing Capability Gaps in Fine-Tuning Data by Saeid Asgari Taghanaki, Rakshanda Agarwal, Bruce Sun, Rohan Jha, Elias Stengel-Eskin (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-27547.txt.

Introduction

Taghanaki and twelve colleagues present GoalCover, a tool that spots capability gaps in data meant for fine-tuning language models. It breaks a high-level goal into small, separately testable subgoals, scores each sample against every subgoal, and flags missing skills from low-scoring cases. In tests across medical, legal, and code tasks, target subgoals fell by about 26 percent against about 2 percent for others. On a finance summarization task, GoalCover-filtered data lifted the judge reward to 4.12 out of 5, and adding synthetic samples did best.

Catalog record

CREATORSaeid Asgari Taghanaki, Rakshanda Agarwal, Bruce Sun, Rohan Jha, Elias Stengel-Eskin
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE45473
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.27547

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Diagnosing Capability Gaps in Fine-Tuning Data Saeid Asgari Taghanaki, Rakshanda Agarwal, Bruce Sun, Rohan Jha, Elias Stengel-Eskin Abstract Fine-tuning large language models (LLMs) for domain-specific tasks requires training datasets that comprehensively cover the target capabilities a practitioner needs. Yet identifying which capabilities a dataset fails to support, and doing so before an expensive fine-tuning run, remains a largely unsolved problem. We introduce GoalCover , a framework that helps practitioners systematically detect capability gaps in fine-tuning datasets through interactive goal decomposition and automated coverage assessment. GoalCover guides a practitioner through structured decomposition of a high-level goal into atomic, independently evaluable subgoals; assigns each training sample an LLM-based alignment score against every subgoal; and surfaces missing capabilities through automated analysis of low-scoring sample explanations. We validate the framework along two complementary axes. First, through controlled corruption experiments across three domains (medical QA, legal summarization, code generation), we show that GoalCover reliably distinguishes targeted from non-targeted capability impacts: target subgoals degrade by 25.6% on average versus 2.1% for non-target subgoals (Cohen’s d = 1.24 d{=}1.24 ). Second, we demonstrate downstream utility on a financial-summarization Reinforcement Fine-Tuning (RFT) task with Qwen-3-14B: training on GoalCover -filtered data improves the LLM-judge reward from 3.77 to 4.12 (out of 5) over the unfiltered baseline, and combining filtered data with goal-conditioned synthetic samples yields the strongest result (4.20). The two results together show that GoalCover works as a practical pre-fine-tuning diagnostic: it detects capability gaps and produces concrete signal for closing them. 1 Introduction The success of domain-specific LLM fine-tuning depends critically on whether the training dataset actually covers the target capabilities the practitioner cares about ( 23 ; 17 ) . As LLMs are deployed in specialized settings such as clinical decision support, legal document processing, code generation, and scientific research, a recurring problem emerges: a practitioner can articulate a high-level goal (e.g., “generate accurate medical answers with appropriate safety considerations” or “summarize legislation while preserving monetary and regulatory detail”), but has no principled way to determine whether their dataset can support that goal until after a costly fine-tuning run reveals the gap. Figure 1 illustrates the failure mode: aggregate dataset alignment can look reasonable while individual subgoals remain undersupported, surfacing only as predictable production failures. Practitioner goal “Build a medical QA system for clinical decision support.” decompose into atomic subgoals Clinical reasoning Cardiology expertise Drug information Safety warnings Evidence citations Coverage: 0.85 0.18 0.12 0.62 0.71 After fine-tuning: ✓ Reliable ✗ FAILS ✗ FAILS ✓ Reliable ✓ Reliable Average coverage score \approx 0.50 , looks reasonable. Subgoal-level coverage reveals gaps that surface only as predictable production failures. Figure 1: Capability gaps in fine-tuning datasets. The average coverage score across subgoals can look adequate while individual subgoals remain severely undersupported, surfacing only as failures in production. GoalCover provides the missing subgoal-level visibility before fine-tuning begins. Existing dataset-quality methods leave this gap mostly unaddressed. Statistical metrics such as perplexity, BLEU, and distributional analysis provide aggregate signal but cannot localize which target capability is undersupported ( 20 ; 18 ; 14 ) . Expert review is valuable but expensive, subjective, and difficult to scale across the multi-dimensional objectives of modern applications. Post-hoc performance analysis only reveals problems after fine-tuning is complete, forcing iterative cycles of training, evaluation, and dataset refinement that consume substantial compute. This evaluation gap becomes consequential as practitioners invest in fine-tuning for high-stakes applications. A medical assistant that performs well on general clinical questions but fails on cardiology cases due to insufficient cardiac training data could mislead clinicians. A legal summarizer that captures most of a bill but consistently omits monetary appropriations could produce summaries that are legally insufficient. These represent systematic capability gaps rather than mere performance issues: specific sub-components of a goal that lack sufficient training support to enable reliable model behavior. The challenge is compounded by the structure of modern fine-tuning goals. Unlike traditional ML tasks with a single defined metric, practical fine-tuning objectives combine domain knowledge, safety, formatting, and behavioral expectations. A practitioner fine-tuning a medical QA model needs accurate answers and appropriate clinical terminology and safety warnings for contraindications and evidence-based reasoning across multiple specialties. Assessing dataset coverage across these heterogeneous requirements demands a method that operates at subgoal granularity. Recent advances in LLM-based evaluation provide useful foundations ( 29 ; 13 ; 9 ; 6 ) . Inspired by the success of LLM-as-a-Judge across diverse tasks, we are, to our knowledge, the first to apply this paradigm to dataset-goal coverage assessment, with explicit attention to goal specification, scoring criteria, and validation methodology. Practitioner goal \mathcal{G} Phase 1 Goal Clarification Iterative Q \,\to\, R loop until atomic decomposition \mathcal{S}=f_{\mathrm{decompose}}(\mathcal{G},Q,R) Phase 2 Coverage Assessment Score every (x_{i},y_{i},s) pair: A(x_{i},y_{i},s){\in}[0,1] + explanation r_{i} Phase 3 Gap Analysis For s with \bar{A}(s){<}\tau : aggregate explanations of low-scoring samples \mathrm{Gap}_{s}=f_{\mathrm{analyze}}(\mathcal{R}_{\mathrm{low}}) Phase 4 Recommendation Issues + fixes per gap s , plus goal-conditioned synthetic data \mathrm{Rec}_{s}=f_{\mathrm{recommend}}(\mathrm{Gap}_{s}) \mathcal{S} A,\,r \mathrm{Gap}_{s} GoalCover pipeline pre-fine-tuning diagnostic Validation 1: Detection Controlled corruption (§5) Target vs. non-target degradation: 25.6% vs. 2.1% , Cohen’s d{=}1.24 Validation 2: Downstream Utility RFT, Qwen-3-14B + GRPO (§7) Filtered: 3.77 \to 4.12 Filtered + goal-cond. synth.: 4.20 Figure 2: Overview of GoalCover . The four-phase pipeline takes a practitioner’s high-level goal \mathcal{G} , decomposes it into atomic subgoals via an interactive clarification loop, scores every (sample, subgoal) pair, aggregates evaluator explanations from low-scoring samples into capability gaps, and produces remediation recommendations including goal-conditioned synthetic data. We validate the pipeline along two complementary axes: a controlled corruption study (Section 4 ) establishes detection validity, and a downstream RFT study (Section 6 ) establishes utility. GoalCover (Figure 2 ) operates in two phases: (1) an interactive goal-clarification system that helps practitioners decompose objectives into specific, testable subgoals, and (2) an automated coverage pipeline that scores each training sample against each subgoal and surfaces missing capabilities through analysis of the evaluator’s structured explanations. To validate the framework’s detection mechanism without requiring full user studies, we design controlled corruption experiments that simulate realistic gap scenarios by selectively removing target content; we then independently validate downstream utility on a Reinforcement Fine-Tuning (RFT) task where data filtered by GoalCover measurably improves the trained model. GoalCover -filtered data raises the RFT reward from 3.77 to 4.12 (Section 6 ), with the strongest configuration (filtered plus goal-conditioned synthetic data) reaching 4.20. GoalCover addresses three research questions: (i) How can complex fine-tuning goals be decomposed into evaluable subcomponents through structured practitioner interaction? (ii) Can LLM-based evaluators reliably assess training-sample alignment with specific capability requirements? (iii) Does goal-conditioned coverage assessment yield useful signal for improving fine-tuning outcomes? We address these questions through the following contributions, which together define GoalCover as a structured framework for decomposing fine-tuning goals, evaluating data–capability alignment, and validating the resulting gap signal. 1. Structured goal–subgoal decomposition. A principled methodology for breaking complex goals into atomic, independently evaluable subgoals that map to specific model capabilities. The decomposition is structured in the sense that it (a) is produced through a fixed elicitation protocol (clarifying-question-answering loop) rather than an ad-hoc prompt, (b) enforces atomicity and disjointness constraints (Eqs. 1 – 3 ), and (c) is itself indirectly validated by the controlled corruption experiments: a poor decomposition would not yield the clean target/non-target separation we observe.

Read the complete text