The Interplay of Harness Design and Post-Training in LLM Agents
Kyungmin Kim, Youngbin Choi, Seoyeon Lee, Suhyeon Jun, Dongwoo Kim, Sangdon Park · 2026
Read The Interplay of Harness Design and Post-Training in LLM Agents by Kyungmin Kim, Youngbin Choi, Seoyeon Lee, Suhyeon Jun, Dongwoo Kim, Sangdon Park (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-25447.txt.
Introduction
An agent's success depends not only on its model but on the harness around it: which tools it sees, how they are described, and what extra information rides with each observation. Kyungmin Kim and colleagues make that scaffolding an experimental variable in 2026, extending a standard text world testbed so harness designs can be swapped and environments shifted after training. They then post train agents under different harness choices and measure what carries over.
Training with the harness in mind improved performance both on familiar tasks and under changed task and tool conditions. Under a minimally designed harness, by contrast, post training gains collapsed when the tool environment shifted strongly. The study argues the harness deserves the same design care as the training algorithm, since the two interact rather than merely adding up.
Catalog record
| CREATOR | Kyungmin Kim, Youngbin Choi, Seoyeon Lee, Suhyeon Jun, Dongwoo Kim, Sangdon Park |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 72 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.25447
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
The Interplay of Harness Design and Post-Training in LLM Agents Kyungmin Kim, Youngbin Choi, Seoyeon Lee, Suhyeon Jun, Dongwoo Kim, Sangdon Park Abstract Tool-integrated LLM agents are often wrapped within a harness : the scaffolding that determines which tools are exposed, how they are described, and what auxiliary information accompanies each per-step observation. While agents are routinely post-trained, this scaffolding is typically treated as a fixed engineering detail, with design effort limited to the training-free regime. Moreover, existing post-training algorithms assume a static environment, even though tool environments and tasks often shift upon deployment. To address this gap, we extend ALFWorld (i) to treat the harness as a controllable design dimension and (ii) to support evaluation under task and tool environment shifts. Building on this, we systematically analyze how the harness design influences post-training in both in-distribution and out-of-distribution (OOD) settings. We empirically show that harness-aware post-training not only improves in-distribution performance but also enables agents to robustly adapt to OOD settings. Under a harness with minimal design effort, post-training suffers a drastic performance drop under stronger tool environment shifts, further highlighting the importance of harness-aware post-training under such shifts. † † footnotetext: ∗ Equal contribution. † † footnotetext: † Co-advising. 1 Introduction LLM agents are designed to solve complex problems that often require multi-step reasoning ( 36 ; 28 ; 30 ; 34 ; 32 ) . Among them, tool-integrated agentic systems extend LLM capabilities by proactively interacting with environments through predefined tools ( 25 ; 24 ; 22 ; 18 ) . Accordingly, performance depends not only on producing correct final outputs but also on appropriately invoking tools, which has motivated increasing efforts to post-train pretrained LLMs for effective tool use ( 9 ) . A factor that is often overlooked in this line of work is the harness : the code that wraps the LLM, determining what is stored, retrieved, and presented to it, and what is done with its outputs ( 31 ; 1 ; 21 ) . While the harness is, in principle, an engineering detail, in practice it is a major determinant of overall performance: even with the same task and model, two harnesses that differ only in how they present auxiliary information can produce drastically different success rates ( 34 ; 3 ) . For this reason, harness design has attracted increasing attention, ranging from manually curated prompts ( 11 ; 2 ; 17 ) to recent attempts at automating the design itself ( 15 ; 26 ) . All of these efforts, however, are limited to a training-free regime, treating the harness as a way to elicit better performance, typically from a closed-source model. How harness design interacts with post-training, in contrast, remains largely unexamined. Figure 1: Overview of experimental design, built on our extension of ALFWorld ( 29 ) tailored to tool-integrated agentic tasks. (Left) State of the original text-based ALFWorld environment. (Middle) Harness building blocks for tool-integrated agentic tasks; different combinations of these blocks yield harnesses with varying levels of informativeness. (Right) Agents under each harness are evaluated in zero-shot and post-training regimes, where the latter spans in-distribution and OOD settings. In parallel, most existing post-training approaches for tool-integrated agents implicitly assume a static deployment scenario, in which both the task distribution and the tool environment, defined as the set of tools and their invocation protocols, remain fixed ( 13 ; 19 ; 33 ; 23 ; 10 ; 12 ; 5 ) . In practice, this assumption is often violated: real-world deployments expose agents to shifts in both the task distribution and the tool environment. A first source of shift arises from changes in the task distribution, a standard out-of-distribution (OOD) problem at the input level ( 14 ; 37 ; 35 ) . For example, an agent originally designed for workload scheduling may later be repurposed for itinerary planning, shifting objectives, constraints, and tool usage patterns, which we refer to as task shift . A second, more subtle source stems from changes in the tool environment itself: tools may be updated, modifying invocation protocols while preserving functionality, which we refer to as tool environment shift . This introduces a distinct OOD setting in which the task distribution remains fixed but the action interface itself changes, and it remains comparatively underexplored ( 4 ; 16 ) . In this paper, we ask the following question: how does harness design influence post-training LLM agents in both in-distribution and OOD settings? To this end, we extend ALFWorld ( 29 ) , a text-based planning environment, into a benchmark tailored to tool-integrated agentic tasks. Specifically, we (i) treat the harness as a controllable design dimension and (ii) modularize the benchmark to support evaluation both in-distribution and under tool environment shift and task shift settings ( Fig. 1 ). While existing post-training algorithms attain high success rates on ALFWorld ( 10 ) , we observe that this performance largely stems from harness-aware post-training , where a specific harness is fixed a priori ( Fig. 3 ). In particular, the original benchmark provides the agent with the complete set of feasible tool calls at every step, which constitutes a highly informative harness. Such a harness, however, comes at a cost: it can be constructed only when the transition dynamics of the ALFWorld environment are fully specified. Yet this cost is rarely made explicit in prior work. To address this gap, we provide three harnesses with varying levels of informativeness and empirically examine whether the additional cost of harness design is indispensable for post-training . We empirically show that harness-aware post-training not only improves in-distribution performance but also enables agents to robustly adapt to OOD settings. Notably, models post-trained on harnesses with low design effort suffer from a drastic performance drop under more severe tool environment shift. Furthermore, harness informativeness tends to improve model performance under the task shift scenario, highlighting the importance of harness-aware post-training for the OOD robustness of agents. In addition, we observe that applying a harness only after post-training under low-effort harness yields performance inferior to harness-aware post-training, providing actionable insight into when to apply the harness during post-training. 2 Preliminaries We outline the formulation of multi-step tool-integrated agentic tasks and representative post-training methods, along with the notation used throughout the paper. 2.1 Multi-step Tool-integrated Agentic Tasks Let \mathcal{V} be a token vocabulary. Given a system prompt p\in\mathcal{V}^{\ast} and a user query q\in\mathcal{V}^{\ast} , an LLM agent \pi:\mathcal{S}\rightarrow\mathcal{A} generates a sequence of action tokens a_{t}\coloneqq\pi(s_{t}) at each time step t\in\{1,\dots,T\} . Here, s_{t}\in\mathcal{S} is the state at step t provided to the agent, and T is the total number of tool calling steps. Specifically, s_{t}\coloneqq(p,q,\mathcal{T}_{t-1}) , where \mathcal{T}_{t-1} is a history of tool calling steps up to the (t-1) -th step, and \mathcal{T}_{0} is an empty sequence. The tool environment \texttt{TE}:\mathcal{V}^{*}\to\mathcal{V}^{*} then plays two roles: in the tool calling phase , it returns the tool calling result e_{t}:=\texttt{TE}((s_{t},a_{t})) ; in the state reconstruction phase , it aggregates e_{t} with a_{t} and \mathcal{T}_{t-1} into a history \mathcal{T}_{t}:=\texttt{TE}((s_{t},a_{t},e_{t})) , provided to the agent as the next state s_{t+1}=(p,q,\mathcal{T}_{t}) . As such, the t -th tool calling step can be represented as: \begin{aligned} &\underbrace{s_{t}=(p,q,\mathcal{T}_{t-1})\xrightarrow[\scriptscriptstyle+a_{t}=\pi(s_{t})]{}(p,q,\mathcal{T}_{t-1},a_{t})\xrightarrow[\scriptscriptstyle+e_{t}=\texttt{TE}((s_{t},a_{t}))]{}}_{\text{Tool Calling Phase}}\\ &\underbrace{\rightarrow(p,q,\mathcal{T}_{t-1},a_{t},e_{t})\xrightarrow[\begin{subarray}{c}\scriptscriptstyle+\mathcal{T}_{t}=\texttt{TE}(({\color[rgb]{0,0,0}s_{t}},a_{t},e_{t}))\end{subarray}]{\scriptscriptstyle-(\mathcal{T}_{t-1},a_{t},e_{t})}s_{t+1}=(p,q,\mathcal{T}_{t}).}_{\text{State Reconstruction Phase}}\end{aligned} Remark. While “harness” generally refers