SIA: Self Improving AI with Harness & Weight Updates

Prannay Hebbar, Yogendra Manawat, Samuel Verboomen, Alesia Ivanova, Selvam Palanimalai, Kunal Bhatia, Vignesh Baskaran · 2026

Read SIA: Self Improving AI with Harness & Weight Updates by Prannay Hebbar, Yogendra Manawat, Samuel Verboomen, Alesia Ivanova, Selvam Palanimalai, Kunal Bhatia, Vignesh Baskaran (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-27276.txt.

Introduction

Prannay Hebbar and colleagues build a loop in which one language model agent improves another agent on two fronts at once. The feedback agent rewrites the task scaffold and retrains the model weights, instead of changing only one side. Tested on legal classification, GPU kernel tuning, and single-cell RNA cleanup, the combined approach beats updating the scaffold alone on every test.

Catalog record

CREATORPrannay Hebbar, Yogendra Manawat, Samuel Verboomen, Alesia Ivanova, Selvam Palanimalai, Kunal Bhatia, Vignesh Baskaran
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE37412
LICENSEhttp://creativecommons.org/licenses/by-sa/4.0/
RIGHTSCC BY SA
SOURCEarXiv

Source: https://arxiv.org/abs/2605.27276

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

SIA: Self Improving AI with Harness & Weight Updates Prannay Hebbar, Yogendra Manawat, Samuel Verboomen, Alesia Ivanova, Selvam Palanimalai, Kunal Bhatia, Vignesh Baskaran Abstract Keywords: Self-Improving Agents, Test-Time Training, Reinforcement Learning, Harness Engineering, Scaffold Generation Abstract Humans are the bottleneck in building and improving AI. Both the models and the agents that wrap them are written, tuned, and corrected by people. The long-horizon goal of an AI that can figure out how to improve itself remains open. Two largely disjoint research lines attack this bottleneck. The harness-update school has a meta-agent rewrite the scaffold of a task-specific agent (its tools, prompts, retry logic, and search procedure) while the model weights are held fixed. The test-time training school uses hand-written RL pipelines to update the model’s own weights on task feedback while the harness is held fixed. These two silos operate in isolation. We propose SIA , a self-improving loop in which a language-model agent (the Feedback-Agent ) updates both the harness and the weights of a task-specific agent. We evaluate across three contrasting domains: Chinese legal charge classification, low-level GPU kernel optimisation, and single-cell RNA denoising. Combining both levers outperforms scaffold iteration alone on all three benchmarks. SIA-W+H achieves 25.1% over prior SOTA on LawBench, 12.4% faster GPU kernels than prior SOTA (1,017 vs 1,161 \mu s), and 20.4% over prior SOTA on denoising. Harness updates make the model agentic, shaping how it searches and acts, while weight updates build the domain intuition that no prompt or scaffold can instil. 1. Introduction 1.1. Humans are the bottleneck. Today’s progress in AI is rate-limited by humans. The models are designed and post-trained by researchers, and the agents built on top of them are scaffolded, prompted, debugged, and tuned by engineers. The long-horizon goal of the field an AI (model or agent) that can figure out how to improve itself remains open. We treat this paper as one concrete step toward that goal: a system that, given only a task specification and a verifier (both defined in §3), improves both its scaffold and its model weights without further human intervention. 1.2. Two silos of self-improving AI. Research into automated self-improvement has bifurcated into two largely disjoint silos as follows. Silo 1 Harness/scaffold self-improvement. A meta-agent rewrites the scaffold of the task-specific agent its system prompt, tool-dispatch logic, retry policy, and answer-extraction code across generations, while the underlying language-model weights are held fixed. Recent representatives include the Darwin Gödel Machine (Zhang et al., 2025), Meta-Harness (Lee et al., 2026), Hyperagents (Zhang et al., 2026), and the broader line on automated agentic system design (Hu et al., 2024). The recurring empirical observation in this silo is that scaffold edits concentrate on software-engineering hygiene parsing, retries, dispatch and rarely deliver domain-specific reasoning that the base model could not produce given any prompt. Silo 2 Test-time post-training. A hand-written RL pipeline updates the model’s own weights on task feedback at test time, typically with the harness held fixed at a single prompt-and-grader template. Representatives include TTRL (Zuo et al., 2025), the Discover line of test-time training (Yuksekgonul et al., 2026), and the surprising-effectiveness-of-TTT result (Akyürek et al., 2024). Here the gain comes from internal policy change, but the pipeline that delivers it is engineered by humans and does not adapt to the task structure that a scaffolded agent would expose. The gap. These two silos operate in isolation. Harness work leaves the model fixed; test-time training leaves the harness fixed. 1.3. Contributions. • We propose and evaluate a Feedback-Agent that also trains the task-specific agent’s weights, in combination with scaffold updates, to improve performance on arbitrary downstream tasks. The system is task-agnostic: given a task specification and a verifier, it produces both an evolved scaffold and an RL-adapted set of Low-Rank Adaptation (LoRA; Hu et al., 2022) weights. • We empirically demonstrate the combined approach across three contrasting domains law (191-class Chinese charge classification; Fei et al., 2023), systems (Triton kernel optimisation on H100; Novikov et al., 2025), and biology (single-cell RNA denoising; van Dijk et al., 2018) and observe consistent gains over prior SOTA : 25.1% on LawBench (70.1% vs 45.0%), 12.4% faster GPU kernels (1,017 vs 1,161 \mu s), and 20.4% on denoising (0.289 vs 0.240 mse_norm ). • We isolate the harness-only contribution (harness update trajectories across several iterations) and contrast it with the full pipeline (harness + weight updates), demonstrating that weight updates deliver gains beyond what the harness alone achieves. 1.4. Roadmap. §2 states the research questions the paper answers and maps each to a later section. §3 defines the technical vocabulary. §4 places SIA in the landscape of self-improving and test-time-training work. §5 describes the configurable-loop method. §6 presents the per-task results and ablations. §7 discusses what each lever changes. §8 and §9 close with limitations and future work. Figure 1: SIA across three diverse tasks. Each panel compares three operating points: Baseline (first generation, no SIA), SIA-H (harness updates only), and SIA-W+H (harness + weight updates), on LawBench Top-1 accuracy, TriMul CUDA speedup, and scRNA-seq denoising mse_norm . The dashed line marks the previous state-of-the-art. SIA-W+H strictly outperforms SIA-H on all three tasks. 2. Research Questions This paper is organised around two research questions. Each is answered by a specific later section. • RQ1 Overall thesis. We first ask how much harness iteration alone improves a task-specific agent when model weights are held fixed. We then ask whether running both levers together (iteratively updating the harness and the model weights in a single loop) pushes past that harness-only ceiling. Does the combined approach outperform scaffold iteration alone, and does this hold across contrasting domains? • RQ2 Mechanism: what does each lever change? Do weight updates surface domain knowledge that no scaffold edit reaches, and does harness iteration produce qualitatively different (external infrastructure) changes? 3. Background and Preliminaries 3.1. Agent and its components. A task-specific agent is a program that takes a task instance and produces an answer. We decompose it into: • LLM. The underlying language model with weights \theta . We use openai/gpt-oss-120b as the base model throughout. • System prompt. Fixed text prepended to every model call that frames the task. • Tool-dispatch logic. Python code that parses model tool-call outputs and routes them to handlers (file I/O, code execution, dataset lookup, grader calls). • Answer extraction. Code that converts a model response (typically a structured trailing block) into a benchmark-formatted prediction. • Grader. The deterministic verifier the orchestrator invokes to compute the per-instance reward. We call the fixed, non-weight component of the agent the scaffold (equivalently, harness ) throughout. It is the union of the system prompt, tool-dispatch logic, answer extraction, and any supporting infrastructure, every part of the agent that is fixed code rather than model output. 3.2. Meta-agent vs. task-specific agent. A meta-agent is an LLM call whose output is itself an agent. SIA uses two meta-agents: • Meta-Agent ( \mathcal{M} ). Generates the initial scaffold A_{1} from the task specification \mathcal{U} and any reference implementations \mathcal{R} supplied with the benchmark: A_{1}=\mathcal{M}(\mathcal{U},\,\mathcal{R}). • Feedback-Agent ( \mathcal{F} ). Reads the previous generation’s scaffold A_{g} , its execution trajectory \tau_{g} , and performance metrics \mathcal{E}_{g} , and synthesises an improved scaffold: A_{g+1}=\mathcal{F}(A_{g},\,\tau_{g},\,\mathcal{E}_{g},\,\mathcal{U}). The task-specific agent is

Read the complete text