Estimating the Empowerment of Language Model Agents

Jinyeop Song, Jeff Gore, Max Kleiman-Weiner · 2025

Read Estimating the Empowerment of Language Model Agents by Jinyeop Song, Jeff Gore, Max Kleiman-Weiner (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-22504.txt.

Introduction

Jinyeop Song, Jeff Gore, and Max Kleiman-Weiner measure how much control a language model agent has over its future. They use empowerment, an information-theoretic score of how much an agent's actions sway what happens next. Unlike task scores, it needs no hand-built benchmark for each job. Their algorithm, EELMA, estimates this score from multi-turn text interactions, which pose special challenges.

They tested EELMA on text games and on realistic web and tool-use settings. Empowerment tracked average task success closely. It also varied in telling ways across models, settings, and agent setups. High-empowerment states and actions often marked turning points for general skill. The score thus complements success rates as a broad gauge of agent quality.

Catalog record

CREATORJinyeop Song, Jeff Gore, Max Kleiman-Weiner
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE75 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-22504

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Estimating the Empowerment of Language Model Agents Jinyeop Song, Jeff Gore, Max Kleiman-Weiner Abstract As language model (LM) agents become more capable and gain broader access to real-world tools, there is a growing need for scalable evaluation frameworks of agentic capability. However, conventional benchmark-centric evaluations are costly to design and require human designers to come up with valid tasks that translate into insights about general model capabilities. In this work, we propose information-theoretic evaluation based on empowerment , the mutual information between an agent’s actions and future states, as an open-ended method for evaluating LM agents. We introduce EELMA (Estimating Empowerment of Language Model Agents) , an algorithm for approximating effective empowerment from multi-turn text interactions. We validate EELMA on both language games and scaled-up realistic web-browsing scenarios. We find that empowerment strongly correlates with average task performance, characterize the impact of environmental complexity and agentic factors such as chain-of-thought, model scale, and memory length on estimated empowerment, and that high empowerment states and actions are often pivotal moments for general capabilities. Together, these results demonstrate empowerment as an appealing general-purpose metric for evaluating and monitoring LM agents in complex, open-ended settings. Code available: https://github.com/Jinyeop3110/EELMA 1 Introduction Large language model agents (LM-agents) are now capable of acting proactively within and across broader computational systems. In this agentic paradigm, LLMs are expected to make autonomous decisions, invoke external tools such as search engines or APIs to access real-time information ( Schick et al. 2023 ) , control operating systems and development environments to configure settings ( Kwon et al. 2024 ) , and engage in multi-agent interactions with humans or other AIs ( Li et al. 2024 ) . However, as these interactions occur over longer time horizons and with greater complexity, evaluating LLM agent performance and safety has become a time-consuming and costly challenge. Most current evaluations rely on goal-centric benchmarks ( Phuong et al. 2024 ; Zhou et al. 2023 ) , where human-designed tasks serve as proxies for capability. While this approach enables direct and practical assessment, it suffers from two limitations. First, designing large-scale evaluation tasks is labor-intensive and challenging. Second, traditional evaluation rarely considers the dynamic and open-ended nature of agentic interactions ( Stanley & Lehman 2015 ) . Instead, the focus is more narrowly on specific end goals or hand-selected milestones. As a result, traditional evaluations are unable to detect when agents are capably pursuing goals outside the measured scope. This blind spot matters for AI safety because it can hide capability growth that benchmarks fail to capture. Figure 1: Empowerment reflects an agent’s ability to reach diverse future states. (Top) A low-empowerment LM-agent becomes trapped in a loop and thus can access only a small fraction of states. (Bottom) A high-empowerment LM-agent effectively explores a wider range of trajectories and can successfully reach states that solve different random goals. To address the gap, we propose leveraging empowerment , an information-theoretic measure of an agent’s influence ( Klyubin et al. 2005 ; Salge et al. 2014 ; Myers et al. 2025 ) , to quantify LM agent capability without specifying goals. Consider the agent-environment framework where an LM agent observes its current state (e.g., a webpage or code editor), takes actions (clicking, typing, or generating responses), and transitions to new states (Figure 1 ). Empowerment quantifies how much control an agent has over future states through its actions. Highly empowered agents recognize the full range of available actions (optionality) and can effectively chain them together to navigate to diverse future states. Therefore, empowerment serves as a strong candidate metric for formalizing a general notion of agentic capability. However, classical empowerment estimators ( Klyubin et al. 2005 ; Jung et al. 2011 ) are computationally expensive and do not scale to high-dimensional language-driven settings of LM agents. Tasks such as browsing, coding, or dialogue involve natural language variability, semantic sparsity, and uncertainty in state transitions, which make estimation particularly challenging. This motivates the need for a new scalable estimation algorithm tailored to language-based agents. In this paper, we propose EELMA (Empowerment Estimation for Language Model Agents), a framework that estimates empowerment from multi-turn language interactions. EELMA enables scalable, goal-agnostic measurement of LM-agent capability without explicit task specifications or reward functions. We validate our approach first in structured games (Gridworld and Tower of Hanoi) and then in a scaled-up web-browsing sandbox (WebArena ( Zhou et al. 2023 ) ). In each of these settings, we show that empowerment estimates strongly correlate with average task performance. Furthermore, high-empowerment moments in a trajectory reveals critical points where agents rapidly expand their control over the environment. This makes empowerment not only a promising tool for evaluation but also a potential diagnostic tool for monitoring unintended behavior during training and deployment. Our main contributions are: 1. We develop a novel information-theoretic estimator, EELMA (Empowerment Estimation for Language Model Agents). EELMA is the first method to estimate effective empowerment directly from multi-turn text-based interactions. 2. We show that effective empowerment (as measured by EELMA) enables goal-agnostic evaluation of LM-agent capability in both toy environments and a scaled-up web-browsing task. 3. We analyze how LM-agent subsystems such as chain-of-thought, memory capacity, and backbone LLM architecture change the effective empowerment of the agent. 4. Finally, we demonstrate that empowerment highlights highly influential states in a trajectory without human annotation, which may provide a scalable mechanism for open-ended monitoring of anomalous behavior. 2 Related Works Large Language Model Agents and Benchmarking The advancements in Large Language Models (LLMs) have led to a new class of autonomous agents, referred to as LM-agents ( Yao et al. 2023 ; Aksitov et al. 2023 ; Pan et al. 2024 ) . In these systems, the agent perceives an environment state or context, generates a plan, and executes an action. Multi-turn interactions, often augmented with memory or planning summaries, enable LM-agents to tackle tasks requiring context, long horizons, and complex reasoning ( Xu et al. 2025 ) . Benchmarks for agents evaluate their behavior in domains such as software engineering ( Jimenez et al. 2023 ; Aleithan et al. 2024 ) , web navigation ( Zhou et al. 2023 ) , games ( Anonymous 2024 ) , and practical computing ( Xie et al. 2024 ) . These benchmarks rely on handcrafted completion or milestone-based goal metrics. In contrast, we quantify an agent’s control over the environment using an information-theoretic approach, offering a complementary evaluation methodology. Information Theoretic Measures Empowerment is an information theoretic measure that quantifies an agent’s ability to influence its environment. Formally, it is defined as the channel capacity between an agent’s actions and its subsequent sensory inputs, capturing the maximal mutual information between the agent’s actions and future states ( Salge et al. 2014 ) . Variational techniques are now available to estimate empowerment in high dimensional, continuous domains ( Mohamed & Rezende 2015 ) . Furthermore, recent work has used the mutual information between actions and states as an intrinsic reward signal for training RL agents to encourage exploration ( Bharadhwaj et al. 2022 ) or assist humans without needing to infer their goals ( Myers et al. 2025 ) . In contrast to the above methods, which have been limited to robotic and

Read the complete text