JAF: Judge Agent Forest

Sahil Garg, Brad Cheezum, Sridhar Dutta, Vishal Agarwal · 2026

Read JAF: Judge Agent Forest by Sahil Garg, Brad Cheezum, Sridhar Dutta, Vishal Agarwal (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-22269.txt.

Introduction

Sahil Garg, Brad Cheezum, Sridhar Dutta, and Vishal Agarwal rethink how AI judges grade AI work. In agent setups, a judge checks answers, guards rules, and helps the main agent improve. Their 2026 preprint, JAF, lets the judge weigh a whole batch of question-and-answer pairs at once.

Most judges score each pair alone, with no view of the rest. Joint scoring can catch drift and bias that solo checks miss. It can also make grades more even across a full set. The frame suits teams that run agents at scale. It gives them a stricter, shared yardstick.

Catalog record

CREATORSahil Garg, Brad Cheezum, Sridhar Dutta, Vishal Agarwal
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE129 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-22269

Browse the full library · About the Tower of Babel