JAF: Judge Agent Forest
Sahil Garg, Brad Cheezum, Sridhar Dutta, Vishal Agarwal · 2026
Read JAF: Judge Agent Forest by Sahil Garg, Brad Cheezum, Sridhar Dutta, Vishal Agarwal (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-22269.txt.
Introduction
Sahil Garg, Brad Cheezum, Sridhar Dutta, and Vishal Agarwal rethink how AI judges grade AI work. In agent setups, a judge checks answers, guards rules, and helps the main agent improve. Their 2026 preprint, JAF, lets the judge weigh a whole batch of question-and-answer pairs at once.
Most judges score each pair alone, with no view of the rest. Joint scoring can catch drift and bias that solo checks miss. It can also make grades more even across a full set. The frame suits teams that run agents at scale. It gives them a stricter, shared yardstick.
Catalog record
| CREATOR | Sahil Garg, Brad Cheezum, Sridhar Dutta, Vishal Agarwal |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 129 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-22269