Interactive Critique-Revision Training for Reliable Structured LLM Generation
Fei Xu Yu, Zuyuan Zhang, Mahdi Imani, Nathaniel D. Bastian, Tian Lan · 2026
Read Interactive Critique-Revision Training for Reliable Structured LLM Generation by Fei Xu Yu, Zuyuan Zhang, Mahdi Imani, Nathaniel D. Bastian, Tian Lan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-08327.txt.
Description
Fei Xu Yu, Zuyuan Zhang, Mahdi Imani, Nathaniel Bastian, and coauthors train language models to produce structured outputs that auditors can check. In form filling, compliance review, and maintenance reporting, an answer must be locally right, globally consistent, and defensible against written rules, and heuristic self-debate offers no real assurance.
Their DPA-GRPO method trains a generator and a verifier as paired players. The verifier either stays silent or files a safety assurance case with a claim, an argument, and evidence; the generator then keeps or revises its output. Those paired decisions form counterfactual action groups for role-specific reinforcement updates, grounding revision in stated evidence rather than vibes.
Catalog record
| CREATOR | Fei Xu Yu, Zuyuan Zhang, Mahdi Imani, Nathaniel D. Bastian, Tian Lan |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 51 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.08327