Creative Adversarial Testing (CAT): A Novel Framework for Evaluating Goal-Oriented Agentic AI Systems

Hassen Dhrif · 2025

Read Creative Adversarial Testing (CAT): A Novel Framework for Evaluating Goal-Oriented Agentic AI Systems by Hassen Dhrif (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-23006.txt.

Introduction

Goal-driven AI agents are hard to grade beyond whether they pick the right tools. Hassen Dhrif proposes Creative Adversarial Testing, or CAT, to judge goal-task fit. Current tests check agent, tool, and parameter choices, but not whether tasks serve the system's aims. CAT is built to map that link between tasks and goals. Dhrif tests the framework on synthetic data modeled after Alexa+ audio services.

Synthetic data let him probe edge cases and failure modes without risking user privacy. Results gave new insight into where tasks drift from goals. Dhrif argues such insight can guide better tuning of agentic systems. The paper is a single-author framework proposal with simulation support.

Catalog record

CREATORHassen Dhrif
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE32 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-23006

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Creative Adversarial Testing (CAT): A Novel Framework for Evaluating Goal-Oriented Agentic AI Systems Hassen Dhrif Abstract Agentic AI represents a paradigm shift in enhancing the capabilities of generative AI models. While these systems demonstrate immense potential and power, current evaluation techniques primarily focus on assessing their efficacy in identifying appropriate agents, tools, and parameters. However, a critical gap exists in evaluating the alignment between an Agentic AI system’s tasks and its overarching goals. This paper introduces the Creative Adversarial Testing (CAT) framework, a novel approach designed to capture and analyze the complex relationship between Agentic AI tasks and the system’s intended objectives. We validate the CAT framework through extensive simulation using synthetic interaction data modeled after Alexa+ audio services, a sophisticated Agentic AI system that shapes the user experience for millions of users globally. This synthetic data approach enables comprehensive testing of edge cases and failure modes while protecting user privacy. Our results demonstrate that the CAT framework provides unprecedented insights into goal-task alignment, enabling more effective optimization and development of Agentic AI systems. 1 Introduction Agentic AI refers to systems—often based on large language models (LLMs)—that perceive their environment and act autonomously to achieve goals, going beyond passive text generation. In formal terms, an autonomous agent is “a system situated within and a part of an environment that senses that environment and acts on it, over time, in pursuit of its own agenda” [ 7 ] . Recent advances show that scaled-up LLMs can approximate such agents: for example, Tree of Thoughts [ 11 ] extends chain-of-thought prompting to allow LLMs to explore multiple reasoning paths and deliberately plan, dramatically improving problem-solving on complex tasks. Likewise, Reflexion [ 5 ] equips an LLM agent with verbal self-reflection: the agent generates textual feedback from trial results and reuses it to refine future actions, yielding large gains (e.g., boosting HumanEval pass@1 from 80% to 91%). Unlike purely generative models, agentic LLMs can iteratively plan and adapt. For instance, AdaPlanner [ 6 ] uses a closed-loop framework in which an LLM agent generates an initial plan and then adaptively refines it using environmental feedback. SWIFTSAGE [ 4 ] adopts a dual-process architecture: a fast “Swift” LM proposes actions by behavior cloning, while a slow “Sage” LLM (e.g., GPT-4) conducts deliberate subgoal planning. This combination of intuition and deliberation significantly outperforms single-strategy baselines on complex interactive reasoning tasks. Other recent examples include DEPS [ 8 ] , which interleaves planning with self-explanation to improve multi-task agents, and Prospector [ 2 ] , which pairs an LLM “Actor” with a fine-tuned “Critic” to rank trajectories, both boosting agentic performance in benchmarks. To evaluate such agentic systems, new benchmarks and datasets have been developed. Mind2Web [ 1 ] provides over 2,000 tasks across 137 real websites, testing a web-crawling agent’s ability to follow instructions on arbitrary sites. InterCode [ 10 ] frames code generation as a sequential decision process with execution feedback, enabling LLMs to interactively debug and refine code. Research on multi-agent coordination has also been explored: for example, MultiPrompter [ 3 ] trains cooperative LLM “prompters” via multi-agent reinforcement learning to collaboratively construct prompts, yielding higher-quality outputs (e.g., in text-to-image tasks) than independent prompting. Together, these developments illustrate the rise of agentic AI: LLM-based agents that plan, act, and learn from feedback in complex environments. In this paper, we update the foundational discussion by incorporating recent peer-reviewed work (2023–2024) in this space. We survey definitions and early theories of agency, and then review modern architectures and benchmarks where LLMs act as autonomous agents. This sets the stage for our contributions in advancing agentic AI. 2 Related Work Recent research on LLM-based agents can be grouped into several threads: Deliberative Planning with LLMs: Building on chain-of-thought prompting [ 9 ] , methods like Tree of Thoughts [ 11 ] enable search over intermediate “thoughts” so that the model considers multiple future paths. DEPS [ 8 ] alternates between planning and self-explanation steps, using failure feedback to iteratively refine plans in open-world tasks. These approaches aim to overcome the myopic nature of one-shot prompting by adding structured reasoning. Learning from Feedback: Several works equip LLM agents with feedback loops akin to reinforcement learning. Reflexion [ 5 ] uses natural-language feedback: after each trial, the agent generates a textual summary of success or failure, which it then uses to guide future choices. AdaPlanner [ 6 ] takes environment observations as input, adaptively updating its plan step-by-step. Prospector [ 2 ] further formalizes this idea by using an LLM “Critic” (trained on reward signals) to rank the actor’s generated action sequences, combining in-context learning with fine-tuning. These methods demonstrate that LLM agents can improve over time without updating model weights directly. Agent Architectures for Interactive Tasks: Other works propose specialized agent frameworks. SWIFTSAGE [ 4 ] explicitly integrates two systems of thought (fast LM vs. slow LM) to tackle tasks requiring hierarchical planning. Mind2Web [ 1 ] and InterCode [ 10 ] focus on environment-specific challenges: the former builds a generalist web navigation agent, while the latter creates an interactive coding benchmark where the agent writes and executes code in a sandbox. These benchmarks highlight different aspects of agency, from real-world perception to multimodal decision-making. Collaborative and Modular Agents: Moving beyond single-agent setups, some work explores multi-agent coordination. MultiPrompter [ 3 ] divides a large prompt optimization problem among cooperative “prompter” agents using multi-agent RL, improving performance in multimodal tasks. More generally, the use of multiple specialized LMs (e.g., actor/critic, fast/slow) points toward modular agent designs. Surveys and Definitions: Several recent surveys contextualize these trends. Wang et al. [ 7 ] define autonomous agents in the context of LLMs and categorize emerging LLM-based agents from a holistic perspective. Unlike older RL-based agent work, LLM agents draw on massive pretrained knowledge and emergent reasoning abilities, enabling new forms of human-like decision making. Overall, the landscape of agentic AI is rapidly evolving. We build on these developments by ensuring our references reflect the latest peer-reviewed contributions (especially from top venues in 2023–2024) and by situating our work within this updated context. 3 Methodology The Creative Adversarial Testing (CAT) framework introduces a novel approach to AI system evaluation through a hierarchical architecture that systematically bridges the gap between task execution and goal achievement. This section presents the framework’s theoretical foundations, core mechanisms, and their practical application in voice-activated audio services. 3.1 Framework Architecture The CAT framework employs a three-layer architecture designed to transform granular task-level metrics into meaningful goal-oriented outcomes, as illustrated in Figure 3 . Each layer serves a specific purpose in the evaluation pipeline: 1) The Goal Layer establishes the evaluation framework through explicit goal formulation and success criteria definition. In the context of audio services, high-level goals might include "enhance music discovery experience" or "increase podcast completion rates." These goals are structured hierarchically: - Strategic: "Build sustainable user engagement patterns" - Tactical: "Improve content discovery accuracy" - Operational: "Reduce irrelevant recommendations" 2) The Execution Monitoring Layer continuously observes system behavior across multiple dimensions. As shown in Figure 3 , this layer implements sophisticated pattern recognition algorithms to identify relationships between individual actions (e.g., voice commands, content selections) and their contributions to goal achievement (e.g., sustained listening sessions,

Read the complete text