Auto-Eval Judge: Towards a General Agentic Framework for Task Completion Evaluation

Roshita Bhonsle, Rishav Dutta, Sneha Vavilapalli, Harsh Seth, Abubakarr Jaye, Yapei Chang, Mukund Rungta, Emmanuel Aboah Boateng, Sadid Hasan, Ehi Nosakhare, Soundar Srinivasan · 2025

Read Auto-Eval Judge: Towards a General Agentic Framework for Task Completion Evaluation by Roshita Bhonsle, Rishav Dutta, Sneha Vavilapalli, Harsh Seth, Abubakarr Jaye, Yapei Chang, Mukund Rungta, Emmanuel Aboah Boateng, Sadid Hasan, Ehi Nosakhare, Soundar Srinivasan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-05508.txt.

Introduction

As AI agents take on more tasks, judges are needed that can tell if a task was truly done, step by step. Roshita Bhonsle and co-authors build such a judge in a 2025 study. Plain model judges look at the last output alone and miss the path that led there.

Their judge splits a task into sub tasks and checks each step with the facts at hand, such as the agent's own notes and outputs. Part scores roll up into one call on the whole job. On two test sets, the judge's calls sat closer to human calls than a top plain judge, by clear spans. The frame is built to swap parts, so it can judge work in many fields.

Catalog record

CREATORRoshita Bhonsle, Rishav Dutta, Sneha Vavilapalli, Harsh Seth, Abubakarr Jaye, Yapei Chang, Mukund Rungta, Emmanuel Aboah Boateng, Sadid Hasan, Ehi Nosakhare, Soundar Srinivasan
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE47 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-05508

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Auto-Eval Judge: Towards a General Agentic Framework for Task Completion Evaluation Roshita Bhonsle, Rishav Dutta, Sneha Vavilapalli, Harsh Seth, Abubakarr Jaye, Yapei Chang, Mukund Rungta, Emmanuel Aboah Boateng, Sadid Hasan, Ehi Nosakhare, Soundar Srinivasan Abstract The increasing adoption of foundation models as agents across diverse domains necessitates a robust evaluation framework. Current methods, such as LLM-as-a-Judge, focus only on final outputs, overlooking the step-by-step reasoning that drives agentic decision-making. Meanwhile, existing Agent-as-a-Judge systems, where one agent evaluates another’s task completion, are typically designed for narrow, domain-specific settings. To address this gap, we propose a generalizable, modular framework for evaluating agent task completion independent of the task domain. The framework emulates human-like evaluation by decomposing tasks into sub-tasks and validating each step using available information, such as the agent’s output and reasoning. Each module contributes to a specific aspect of the evaluation process, and their outputs are aggregated to produce a final verdict on task completion. We validate our framework by evaluating the Magentic-One Actor Agent on two benchmarks, GAIA and BigCodeBench. Our Judge Agent predicts task success with closer agreement to human evaluations, achieving 4.76% and 10.52% higher alignment accuracy, respectively, compared to the GPT-4o based LLM-as-a-Judge baseline. This demonstrates the potential of our proposed general-purpose evaluation framework. * * footnotetext: Equal Contribution 1 1 1 Code will be made available on GitHub. Figure 1: Performance Comparison 1 Introduction Problem and Motivation We propose a general-purpose, scalable, and modular Agent-as-a-Judge evaluation framework designed to assess agentic task performance with minimal human oversight, while maintaining robustness across diverse domains and datasets. Human evaluation continues to serve as the de facto standard for determining task success in agentic systems. However, it is inherently limited by its high cost, subjectivity, and lack of scalability posing a critical obstacle to widespread deployment of autonomous agents in real-world settings. Recent advances have explored leveraging large language models (LLMs) and autonomous agents as evaluators. Notable examples include the LLM-as-a-Judge paradigm [ 7 ] and Meta’s Agent-as-a-Judge framework [ 8 ] . While promising, these approaches exhibit key limitations: (1) they operate primarily on final outputs and ignore intermediate reasoning traces; (2) they often rely on post hoc human adjudication for ground-truth validation; and (3) they are narrowly scoped, often bound to specific task domains or evaluation protocols. The following definitions will be used consistently throughout this paper: • Actor : the agent responsible for executing a task through sequential reasoning and interaction. • Judge : the agent tasked with evaluating the Actor ’s performance by analyzing both its intermediate reasoning states and final output artifacts. To address these shortcomings, we formalize the evaluation setup by introducing two core agentic roles and framing our contributions around two central research questions: Research Questions • RQ1 : How can the task completion ability of Agentic Systems be evaluated across a wide range of domains? • RQ2 : How can the quality and human-alignment of Judge , tasked with evaluating these agentic systems, be improved? By addressing these questions, we aim to establish a general evaluation framework that reduces human dependency while maintaining semantic rigor and cross-domain applicability. Contributions The key contributions of this work are: • We present a domain-agnostic decomposition of the agent evaluation task, enabling step-wise reasoning over task completion without presupposing task-specific heuristics. • We release an open-source, modular, and extensible evaluation framework equipped with interface-consistent modules that can be independently substituted or enhanced. A concrete instantiation demonstrates its compatibility and generalization across multiple domains. • Empirical results show that our implementation consistently outperforms existing baselines, achieving stronger alignment with human evaluations (see Figure 1 ). Proposed Approach Our framework is inspired by how expert human evaluators decompose complex tasks into logical subgoals and assess correctness at each step via evidence-based reasoning. The Judge agent architecture incorporates multiple LLM-based and agentic modules that collectively verify both intermediate reasoning steps and final outputs of the Actor agent. For our experiments, we instantiate the Actor using the Magentic-One agent, a general-purpose agent capable of multi-step task execution. Architectural and implementation details are provided in Section 3. We evaluate our framework on two benchmark datasets, GAIA and BigCodeBench, which focus on text-based tasks. Evaluation quality is assessed by comparing the Judge ’s verdicts against human annotations to measure alignment and reliability. Figure 2: Proposed method overview. The input- Task is comprised of not only query text, but also any type of attachment and tools that might be provided to the Actor . 2 Related Work Recent research has increasingly focused on evaluating large language models (LLMs) and autonomous agents by leveraging other LLMs or agents as evaluators, aiming to supplement or even replace human evaluation. LLM-as-a-Judge: Several studies have shown that LLMs can serve as effective judges. For example, MT-Bench and Chatbot Arena [ 7 ] use human-aligned LLMs to score open-ended responses, showing high agreement with human evaluations. Compass-Judger-1 [ 1 ] trains an open-source judge using a mix of public and self-collected feedback data for scoring and pairwise comparisons. Prometheus [ 4 ] further improves evaluation fidelity by training on a diverse feedback dataset, achieving results comparable to GPT-4. While effective, these methods focus on static, text-based tasks. Our work builds on them by expanding evaluation to more complex, step-driven agentic behaviors. Multi-LLM as Judge Evaluation: Multi-LLM setups simulate human-like debate to enhance evaluation quality. ChatEval [ 2 ] assigns roles to LLMs for collaborative judging, while AutoArena [ 6 ] uses peer debate and committee voting to select top responses. Though limited to chat tasks, these frameworks motivate our own Judge design, aimed at evaluating broader workflows. Evaluating Agentic Systems: Agent-as-a-Judge [ 8 ] introduces the idea of agent judging agents. However, it is constrained to DevAI dataset which contains ML tasks introduced through this paper. Moreover, this work needs a set of soft and hard requirements for each task as an input in order to perform evaluations, which hugely limits the extensibility of this method towards other datasets of same domain. Our work removes this requirement by automatically generating a set of checklist criteria agnostic to domain or dataset. Step-by-Step Evaluation: Since Agentic Systems often operate in sequences, evaluation should track not just final outputs but intermediate steps. LLM-Reasoners [ 3 ] proposes AutoRace to assess reasoning chains like Chain of Thought and Tree of Thought for LLMs. We adopt a similar philosophy, our Judge agent evaluates the completeness and correctness of each step in the Actor agent’s process, enabling more accurate and transparent assessments. 3 Method Figure 2 . gives an overview of the proposed Judge system. The remainder of this section describes the functional modules of the Judge framework in detail. 3.1 Criteria Generator Given a task description, the Criteria Generator module generates a concise list of checklist questions which must be met by the Actor Agent to successfully complete the task. The generated checklist aims to verify whether the agent has satisfied the “explicit” requirements stated in the task, while minimizing assumptions. It follows detailed prompting guidelines to ensure that each checklist question is strictly aligned with the task. The questions are designed to be binary ("yes" or "no") in nature and focus on a single requirement at a time. This approach

Read the complete text