Seven simple steps for log analysis in AI systems
Magda Dubois, Ekin Zorer, Maia Hamin, Joe Skinner, Alexandra Souly, [0.4em] Jerome Wynne, Harry Coppock, Lucas Sato, Sayash Kapoor, Sunishchal Dev, [0.4em] Keno Juchems, Kimberly Mai, Timo Flesch, Lennart Luettgau, Charles Teague, [0.4em] Eric Patey, JJ Allaire, Lorenzo Pacchiardi, Jose Hernandez-Orallo, Cozmin Ududec, [2em] UK AI Security Institute (AISI), [0.3em] US Center for AI Standards, Innovation (CAISI), [0.3em] Model Evaluation, Threat Research (METR), [0.3em] Princeton University, [0.3em] RAND Corporation, [0.3em] Meridian Labs, [0.3em] University of Cambridge · 2026
Read Seven simple steps for log analysis in AI systems by Magda Dubois, Ekin Zorer, Maia Hamin, Joe Skinner, Alexandra Souly, [0.4em] Jerome Wynne, Harry Coppock, Lucas Sato, Sayash Kapoor, Sunishchal Dev, [0.4em] Keno Juchems, Kimberly Mai, Timo Flesch, Lennart Luettgau, Charles Teague, [0.4em] Eric Patey, JJ Allaire, Lorenzo Pacchiardi, Jose Hernandez-Orallo, Cozmin Ududec, [2em] UK AI Security Institute (AISI), [0.3em] US Center for AI Standards, Innovation (CAISI), [0.3em] Model Evaluation, Threat Research (METR), [0.3em] Princeton University, [0.3em] RAND Corporation, [0.3em] Meridian Labs, [0.3em] University of Cambridge (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-09563.txt.
Introduction
Dubois and nineteen colleagues lay out a seven-step pipeline for analyzing the logs that AI systems leave as they work with tools and users. Such logs can reveal model capabilities, tendencies, and behavior, and show whether an evaluation ran as intended, yet no standard method exists. Their guide follows current best practice, illustrates each step with concrete code in the Inspect Scout library, and flags common pitfalls. The result gives researchers a shared foundation for rigorous, reproducible log analysis.
Catalog record
| CREATOR | Magda Dubois, Ekin Zorer, Maia Hamin, Joe Skinner, Alexandra Souly, [0.4em] Jerome Wynne, Harry Coppock, Lucas Sato, Sayash Kapoor, Sunishchal Dev, [0.4em] Keno Juchems, Kimberly Mai, Timo Flesch, Lennart Luettgau, Charles Teague, [0.4em] Eric Patey, JJ Allaire, Lorenzo Pacchiardi, Jose Hernandez-Orallo, Cozmin Ududec, [2em] UK AI Security Institute (AISI), [0.3em] US Center for AI Standards, Innovation (CAISI), [0.3em] Model Evaluation, Threat Research (METR), [0.3em] Princeton University, [0.3em] RAND Corporation, [0.3em] Meridian Labs, [0.3em] University of Cambridge |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 54933 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.09563
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Seven simple steps for log analysis in AI systems Magda Dubois, Ekin Zorer, Maia Hamin, Joe Skinner, Alexandra Souly, [0.4em] Jerome Wynne, Harry Coppock, Lucas Sato, Sayash Kapoor, Sunishchal Dev, [0.4em] Keno Juchems, Kimberly Mai, Timo Flesch, Lennart Luettgau, Charles Teague, [0.4em] Eric Patey, JJ Allaire, Lorenzo Pacchiardi, Jose Hernandez-Orallo, Cozmin Ududec, [2em] UK AI Security Institute (AISI), [0.3em] US Center for AI Standards, Innovation (CAISI), [0.3em] Model Evaluation, Threat Research (METR), [0.3em] Princeton University, [0.3em] RAND Corporation, [0.3em] Meridian Labs, [0.3em] University of Cambridge Abstract AI systems produce large volumes of logs as they interact with tools and users. Analysing these logs can help understand model capabilities, propensities, and behaviours, or assess whether an evaluation worked as intended. Researchers have started developing methods for log analysis, but a standardised approach is still missing. Here we suggest a pipeline based on current best practices. We illustrate it with concrete code examples in the Inspect Scout library, provide detailed guidance on each step, and highlight common pitfalls. Our framework provides researchers with a foundation for rigorous and reproducible log analysis. Introduction: What is log analysis? As AI systems interact with tools or respond to queries across multiple turns (e.g., during agentic evaluations or multi-turn conversations) they generate extensive logs made of responses, tool calls, reasoning traces, and additional metadata. These logs contain valuable information, but making sense of them can be challenging. Log analysis is a way to transform this unstructured data into structured data, which allows researchers to answer questions about AI systems or an evaluation setup in which they operate. This can include examining AI capabilities (“Can the agent solve complex tasks?”), propensities (“Does it refuse harmful requests?”), or behaviour (“Is it excessively verbose?”). It also includes examining factors outside the AI’s control, such as looking for unclear instructions or unavailable tools. Answering these questions is essential for building rigorous AI evaluations and better understanding AI systems. Regardless of the purpose of log analysis, recent advances in model capabilities and tooling have enabled researchers to perform these analyses in a semi-automated 1 1 1 They work best when combined with human oversight and validation. fashion and hence to detect certain patterns at scale. Current LLM-based scanners (see Background for terminology) show promising performance for some types of signals ( 31 , e.g., explicit reward - hacking cues versus more implicit or subtle ones;) , but effectiveness can vary across contexts. While many researchers, AI developers, and evaluators have begun to explore this space, a unified and standardised approach is still missing. This guide summarises current best practices in log analysis and provides a practical framework for researchers. We illustrate this framework using 17 , an open-source library that supports exploring logs, building scanners, and running analysis at scale. We begin by reviewing relevant terminology and related work. We then introduce our pipeline ( fig. 1 ), with each step detailed in its own section and illustrated with an example. Background Terminology We use the term AI system to encompass both agents and chatbots (cf. fig. 2 ). By agent, we mean a system that operates autonomously to achieve goals: it uses tools (external functions like web browsers or code executors), runs in a loop to make sequential decisions, and determines independently how to accomplish tasks. Agents are typically coordinated by scaffolds (frameworks managing agent calls, tools, and context) and deployed in sandbox environments for safe operation. By chatbot, we mean a system that engages in multi-turn dialogue with users (can be human or AI), responding to queries and maintaining conversation context. It may also use tools, but primarily to fulfill specific user requests. We use the term "log" to refer to any records generated when using an AI system. Logs can include model inputs (user messages, prompts, instructions), model outputs (model responses, internal commentary, chain-of-thought reasoning, tool calls), environment interactions (tool outputs, API responses, terminal commands) and metadata (timestamps, token usage, error codes). Logs can also include task descriptions and scores from previous analyses (e.g., in agentic evaluations where agents are prompted to solve specific tasks and receive pass/fail scores). Throughout this guide, we sometimes refer to these original task scores and analyses as “primary”, and those derived from further log exploration as “secondary”. We use the term "scanners" to refer to any automated method for detecting patterns in logs. Scanners may be programmatic (e.g., string matching, regular expressions) or LLM-based, in which case they are sometimes called "LLM-as-a-Judge" or "autograders". Scanners can be applied in real time (during model execution) or offline (during post-hoc analysis). Related work There has been extensive work on chain-of-thought monitoring ( 40 ; 20 ; 19 , e.g.,) , which focuses on model reasoning, and on analysing human-LLM conversations ( 30 ; 6 , e.g.,) , which tend to examine single-turn or short multi-turn interactions. As AI systems have become more capable and their evaluations have grown longer and more complex, the need to analyse extensive chain-of-thought traces and extended agentic interactions has made manual analysis increasingly challenging. This has driven interest in automated methods for log analysis at scale ( 17 ; 27 , e.g.,) . In terms of long agentic settings, there is emerging work on what does and doesn’t work when detecting errors through automated analysis ( 5 ) , and on categorising failure types in agent evaluations ( 2 ; 31 ; 18 ; 7 ; 41 ; 29 ) . However, much of the current knowledge on log analysis exists primarily in blog posts and internal evaluation reports rather than systematic methodologies. A structured approach to log analysis is essential to increase reproducibility of results, validity of analyses, and establish a common language across the field. A pipeline for log analysis We aggregated common practices across different areas of AI research into a pipeline for log analysis ( fig. 1 ). We assume an exploratory analysis (where logs already exist), but most steps apply equally to a hypothesis-driven analysis (where logs are created to answer specific questions). In the following sections, we provide detailed guidance on each step, and illustrate throughout by building a refusal scanner for agentic evaluations in Inspect Scout. Figure 1: Suggested pipeline for log analyses. Each step is described in detail in its relevant section. Section 1: Define the purpose of the analysis The first step, similarly to any data analysis, is to establish the purpose of the log analysis. This might be to address a primary research question (e.g., "Can the agent solve a coding challenge?") or a secondary research question that supports the analysis of a primary research question (e.g., "Can I trust that the evaluation worked as intended?"). In both cases, articulating the initial research question helps scope the next steps. This question can be broad, as it will be refined into a more specific hypothesis later (Section 4). When logs already exist, it is important to understand the context behind them. For agentic evaluations, this means understanding the task (e.g., scoring design, validity concerns), the model setup (e.g., temperature, reasoning, token limit), the agent setup (e.g., scaffolding, maximum iterations, sub-agents), the environment (e.g., available tools) and the agent’s context (e.g., prompts, error messages). For chatbots ( 47 , e.g., Wildchat