Enhancing LLM Instruction Following: An Evaluation-Driven Multi-Agentic Workflow for Prompt Instructions Optimization
Alberto Purpura, Li Wang, Sahil Badyal, Eugenio Beaufrand, Adam Faulkner · 2026
Read Enhancing LLM Instruction Following: An Evaluation-Driven Multi-Agentic Workflow for Prompt Instructions Optimization by Alberto Purpura, Li Wang, Sahil Badyal, Eugenio Beaufrand, Adam Faulkner (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-03359.txt.
Description
Alberto Purpura and four co-authors fix a specific way language models fail instructions: the content is right, but formal constraints are violated, so the output is procedurally flawed. Ordinary prompt refinement rewrites the main task description while neglecting the granular constraints that act as acceptance criteria. Their multi-agentic workflow instead optimizes the task description and its constraints separately.
Quantitative compliance scores feed back into the loop, driving agents that iteratively rewrite and improve each part of the prompt. In their evaluation, the revised prompts earned significantly higher compliance scores from models such as Llama 3.1 8B and Mixtral. The approach treats instructions as contracts with checkable terms, and uses measurement, not intuition, to decide when a prompt is good enough.
Catalog record
| CREATOR | Alberto Purpura, Li Wang, Sahil Badyal, Eugenio Beaufrand, Adam Faulkner |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 41 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-03359