Sensi: Learn One Thing at a Time—Curriculum-Based Test-Time Learning for LLM Game Agents
Mohsen Arjmandi · 2026
Read Sensi: Learn One Thing at a Time—Curriculum-Based Test-Time Learning for LLM Game Agents by Mohsen Arjmandi (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-17683.txt.
Introduction
Arjmandi presents Sensi, a language-model agent that learns games one topic at a time. The ARC-AGI-3 setting forces agents to learn task rules during play. Sensi splits perception from action across two players. An outside state machine runs a lesson plan, and a judge model checks when each lesson sticks. Version two finished its full lesson plan in about 32 tries, he reports. But a perception hallucination cascade left it solving zero levels.
Catalog record
| CREATOR | Mohsen Arjmandi |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 45176 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.17683
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Sensi: Learn One Thing at a Time—Curriculum-Based Test-Time Learning for LLM Game Agents Mohsen Arjmandi Abstract Large language model (LLM) agents deployed in unknown environments must learn task structure at test time, but current approaches require thousands of interactions to form useful hypotheses. We present Sensi , an LLM agent architecture for the ARC-AGI-3 game-playing challenge that introduces structured test-time learning through three mechanisms: (1) a two-player architecture separating perception from action, (2) a curriculum-based learning system managed by an external state machine, and (3) a database-as-control-plane that makes the agent’s context window programmatically steerable. We further introduce an LLM-as-judge component with dynamically generated evaluation rubrics to determine when the agent has learned enough about one topic to advance to the next. We report results across two iterations: Sensi v1 solves 2 game levels using the two-player architecture alone, while Sensi v2 adds curriculum learning and solves 0 levels—but completes its entire learning curriculum in approximately 32 action attempts, achieving 50–94 × \times greater sample efficiency than comparable systems that require 1,600–3,000 attempts. We precisely diagnose the failure mode as a self-consistent hallucination cascade originating in the perception layer, demonstrating that the architectural bottleneck has shifted from learning efficiency to perceptual grounding —a more tractable problem. 1 Introduction The ARC-AGI-3 challenge [ 1 ] presents a distinctive test of machine intelligence: agents must play pixel-art puzzle games with no prior knowledge of the rules, mechanics, or win conditions. Unlike standard game-playing benchmarks where the rules are specified or can be inferred from a large training corpus, ARC-AGI-3 requires agents to discover the game’s dynamics entirely through interaction—a form of test-time learning that mirrors how humans approach unfamiliar situations. Current approaches to this challenge are remarkably sample-inefficient. Systems such as Agentica from Symbolica reportedly require 1,600 to 3,000 game interactions to build a working model of a single game’s mechanics. This inefficiency fundamentally limits the practical applicability of LLM agents in settings where test-time compute budgets are constrained, a concern that has become increasingly relevant as the field explores test-time scaling [ 16 , 15 , 20 ] . We introduce Sensi , an LLM agent that evolves across two design iterations to address this sample efficiency problem. The core architectural insight is separation of concerns: perception should be decoupled from action, and learning should be structured as a curriculum rather than an undirected search. Sensi v1 splits the agent into two communicating roles—an Observer that maintains hypotheses about the game world, and an Actor that selects actions to test those hypotheses. This two-player architecture, where cognition is factored into perception and decision-making, enables structured hypothesis accumulation. Using ChatGPT 5.1 as the backbone, v1 solves 2 levels of the ARC-AGI-3 challenge with the notable property that pass@10 equals pass@1: results are consistently reproducible given the same accumulated knowledge. Sensi v2 adds three mechanisms on top of the two-player foundation: (i) a curriculum that orders learning goals into a sequential queue with a state machine managing progression, (ii) a database-as-control-plane where the agent’s entire cognitive state resides in SQLite tables that are programmatically injected into prompts each turn, and (iii) a sense scorer implementing LLM-as-judge [ 21 ] with dynamically generated evaluation rubrics. V2 solves 0 levels—an honest negative result—but completes its full learning curriculum in approximately 32 interactions, a 50–94 \times improvement in sample efficiency. The failure mode is itself a contribution: we identify a self-consistent hallucination cascade where errors in the perception layer (frame differencing) propagate through the hypothesis pipeline, producing internally coherent but factually incorrect game models that receive high scores from the sense evaluator. This precisely localizes the bottleneck: the architecture works; the perception does not. Our contributions are: 1. A two-player architecture that separates perception from action via distinct Observer and Actor LLM roles communicating through structured hypothesis lists (§ 3 ). 2. A curriculum learning system with an external state machine that sequences learning goals and accumulates verified knowledge as facts for subsequent learning items (§ 4 ). 3. A database-as-control-plane pattern that makes the LLM’s context window externally programmable through database state, enabling modular and steerable agent behavior (§ 4.4 ). 4. An LLM-as-judge with dynamic rubrics for evaluating learning progress, where both the evaluation metric and the scoring are performed by separate LLM calls (§ 4.3 ). 5. A sample efficiency analysis demonstrating 50–94 \times improvement over baselines, together with a precise diagnosis of the hallucination cascade failure mode (§ 6 ). 2 Preliminaries 2.1 ARC-AGI-3 Environment ARC-AGI-3 [ 1 ] is a game-based evaluation where agents play pixel-art puzzle games without prior knowledge of the rules. At each timestep t , the agent observes a game frame represented as a 3D tensor: \mathcal{F}_{t}\in\mathbb{Z}_{16}^{L\times H\times W} (1) where L is the number of grid layers, H and W are the spatial dimensions (up to 64\times 64 ), and each cell takes an integer value in [0,15] representing a color. The agent selects from a discrete action space: \mathcal{A}=\{a_{0},a_{1},\ldots,a_{7}\} (2) where a_{0} is reset (restarts the game), a_{1} through a_{5} are simple actions (directional movement, interact), a_{6} is a coordinate-parameterized action taking (x,y) arguments, and a_{7} is an additional simple action. After executing action a_{t}\in\mathcal{A} , the agent receives the next frame \mathcal{F}_{t+1} and a scalar score s_{t}\in[0,254] , along with a status code from \{\texttt{NOT\_PLAYED},\texttt{NOT\_FINISHED},\texttt{GAME\_OVER},\texttt{WIN}\} . Crucially, the semantics of each action are not provided to the agent. The agent must discover what each action does, how the game mechanics work, and what constitutes winning—all from raw interaction. 2.2 POMDP Formulation The ARC-AGI-3 problem can be formulated as a partially observable Markov decision process (POMDP) [ 5 ] with an important distinction: the agent must discover not only the state dynamics but also the reward function itself. Let \langle\mathcal{S},\mathcal{A},T,R,\Omega,O\rangle denote the POMDP, where \mathcal{S} is the (hidden) game state space, \mathcal{A} is the action space, T:\mathcal{S}\times\mathcal{A}\to\Delta(\mathcal{S}) is the unknown transition function, R:\mathcal{S}\times\mathcal{A}\to\mathbb{R} is the unknown reward function, \Omega is the observation space (rendered frames), and O:\mathcal{S}\to\Delta(\Omega) is the observation function. The agent’s task is two-fold: (1) learn an approximate model of T and R from interactions, and (2) use this model to select actions that maximize the game score. This dual-discovery requirement distinguishes ARC-AGI-3 from standard POMDP settings where the dynamics are assumed known or learnable from a fixed distribution. 2.3 Test-Time Learning It is important to situate Sensi within the landscape of test-time adaptation methods. We distinguish three paradigms: Test-time compute (TTC). Methods such as chain-of-thought prompting [ 16 ] and self-consistency [ 15 ] allocate additional inference-time computation to improve output quality. The model’s parameters remain frozen; only the reasoning trajectory is extended. Test-time training (TTT). Methods such as TTT [ 12 ] and TTT-Discover [ 20 ] perform gradient-based updates to the model’s parameters on each test instance. The model literally learns—in the weight-update sense—at test time. Test-time in-context learning. Sensi occupies a third position: the model’s parameters remain frozen, but the agent accumulates structured knowledge in an external database that is injected into the context window each turn. This is neither pure inference (the agent’s effective knowledge base changes) nor gradient-based training (no parameters are updated), extending in-context test-time learning ideas from frameworks like EvoTest [ 4 ] . We