Explore Before You Solve: The Speed–Depth Trade-off in Epistemic Agents for ARC-AGI-3
Keong Han Liew · 2026
Read Explore Before You Solve: The Speed–Depth Trade-off in Epistemic Agents for ARC-AGI-3 by Keong Han Liew (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-25931.txt.
Introduction
Liew Keong Han argues that the public ARC-AGI-3 puzzle games cannot tell clever exploration from cheap tricks. Every one of the 25 games falls to a mindless strategy. A library flaw alone bypasses 18 games in a single step. Han presents AERA, an agent that explores first, checks its findings, and only then plans. It solves four games, while random play and a no-exploration baseline solve none.
Catalog record
| CREATOR | Keong Han Liew |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 63606 |
| LICENSE | http://creativecommons.org/publicdomain/zero/1.0/ |
| RIGHTS | CC0 |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.25931
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Explore Before You Solve: The Speed–Depth Trade-off in Epistemic Agents for ARC-AGI-3 Keong Han Liew Abstract We systematically investigate all 25 public ARC-AGI-3 games and find that every one is reachable through non-intelligent strategies: 10 in a single blind step, 5 after one probing action, 1 via repeated ACTION1 presses, 1 via diverse exploration, and 8 via single repeated actions with sufficient budget (50–200 steps). A library-level null-coordinate vulnerability additionally bypasses 18 games in 1 step. This benchmark critique implies the public evaluation set cannot discriminate intelligent exploration from trivial heuristics — the private 55-game evaluation is the only genuine intelligence test. Against this backdrop, we present AERA (Adaptive Epistemic Reasoning Agent), a three-phase (EXPLORE / VERIFY / PLAN) agent achieving RHAE = 0.2116 \text{RHAE}{=}0.2116 (4/25 solved) on these 25 games with Qwen2.5-0.5B, while random and no-explore baselines score 0.0000 0.0000 . We formalise AERA through a Speed–Depth trade-off framework: under a convexity assumption (proved for a class of environments in the Appendix), RHAE’s quadratic form emerges as a second-order penalty for deviating from the Pareto frontier between action efficiency and information gain. Contributions: (i) a benchmark validity analysis showing that current interactive reasoning benchmarks fail to measure the exploration they claim to require, and (ii) the EXPLORE-before-PLAN framework and model-capability × \times exploration interaction. The linked code track entry achieves RHAE = 0.30 \text{RHAE}{=}0.30 on the full 55-game private evaluation. Code: CC0. Figure 1: Complete taxonomy of all 25 public ARC-AGI-3 games by solving strategy. Bold labels indicate games solved by AERA ( b{=}1 , Qwen2.5-0.5B). Every game is reachable through non-intelligent strategies: blind single actions, repeated actions with sufficient budget, or a null-coordinate vulnerability. The public set cannot discriminate intelligent exploration from trivial heuristics. 1 Introduction When a human encounters an unfamiliar puzzle — a game they have never played, a pattern they have not seen — they do not immediately attempt to solve it. They explore first. They try a small action and watch what happens. They form a tentative hypothesis, test it against an edge case, revise it, and only then commit to a solution. This explore-before-solve behavior is so natural that its absence in artificial intelligence systems is easy to overlook. ARC-AGI-3 makes this absence costly. In ARC-AGI-3, an agent is placed inside a novel turn-based environment and must discover both the rules and the goal through interaction, without any instructions. The benchmark scores agents using RHAE: the square of the ratio of human median actions to AI actions, capped at 1.15^{2} . The quadratic penalty means an agent using twice as many actions as a human earns only 25% credit. The metric does not merely prefer efficiency; it punishes inefficiency quadratically. This paper makes three contributions: 1. Theoretical: RHAE as Speed–Depth trade-off penalty. We argue that RHAE’s quadratic form can be interpreted as a second-order penalty for deviating from the Pareto frontier between action efficiency (Speed) and information gain per action (Depth). Under an explicit convexity assumption (A1, § 3 ), this structure is consistent with the observed quadratic scoring. We do not prove (A1) in general; Appendix A provides a proof for a class of environments where it holds. 2. Architectural: AERA. A three-phase architecture (EXPLORE, VERIFY, PLAN) motivated by the Speed–Depth trade-off analysis. The adaptive exploration budget — approximately 40% of the human baseline — is an empirical heuristic fit on a small ablation (n=1 environment), not a derived result. 3. Empirical: model \times exploration interaction. On five public ARC-AGI-3 games with Qwen2.5-0.5B, AERA reaches \text{RHAE}=0.5290 versus 0.0000 for our no-explore baseline (which produces zero actions because the PLAN module requires a non-empty hypothesis — an architectural choice, not a theorem prediction). At Qwen2.5-1.5B the same no-explore baseline reaches 0.2645 by solving FT09 through planning alone. Exploration is necessary for the 0.5B model and optional for 1.5B on this 5-game subset. The gap between 100% human solve rate and < 1% AI solve rate on ARC-AGI-3 is not a gap in reasoning capability; it is a gap in epistemic discipline. Summary for scanning readers. (1) Architecture: AERA (EXPLORE/VERIFY/PLAN) achieves RHAE = 0.2116 on 25 public games, RHAE = 0.5290 on 5-game subset, 8/8 runs solve FT09 (100%). (2) Theory: RHAE = (H/A)^{2} can be interpreted as a Speed–Depth Pareto-frontier penalty (Proposition 1 under A1; A1 proved for UIS environments in Appendix A ). (3) Benchmark critique: All 25 public games reachable by non-intelligent strategies; public set cannot distinguish exploration from trivial heuristics. Private 55-game set is the genuine test. Competition: BFS submission RHAE = 0.30 on full 55-game eval. Code: CC0. Relationship to ReAct, Chain-of-Thought, and Tree-of-Thoughts. ReAct [ 17 ] interleaves reasoning and acting but does not model belief entropy or gate commitment on uncertainty reduction. Chain-of-Thought [ 18 ] improves planning over a known problem but cannot handle hidden rule discovery. Tree-of-Thoughts [ 19 ] explores solution branches but assumes the problem formulation is fixed, not itself uncertain. AERA differs in one specific way: it maintains an explicit world-model hypothesis and gates the transition from exploration to planning on a proxy for belief entropy. This single architectural choice — absent from all three prior frameworks — is what enables non-zero RHAE on environments where the win condition is unknown at episode start. We do not claim AERA is superior to these frameworks on their native tasks; we claim it addresses a different problem (hidden-rule interactive environments) that those frameworks were not designed for. Linked code track submission. This paper is tied to the ARC-AGI-3 code track entry farmountain/arc-agi3-v31-zorojuro-hybrid-v9 , which achieves \text{RHAE}=0.30 on the full 55-game private evaluation set. That submission uses a BFS solver with offline pre-solve cache, consistent with the EXPLORE-before-PLAN principle described here. The code track entry demonstrates the principle at competition scale; this paper isolates the mechanism in controlled conditions on the public set where systematic analysis is possible. Notes on this work (author). The EXPLORE/VERIFY/PLAN decomposition did not arrive from a single source. Four converging observations led to it: (i) repeated runs of a one-shot planner failed in the same way — the agent committed to a wrong plan from o_{0} and executed deterministically into a dead end; (ii) reading the POMDP and active-inference literature suggested that an explicit belief-update phase was the missing piece; (iii) observing humans play public ARC-AGI-3 demos showed a consistent probe-first pattern that one-shot planning ignored; (iv) an early ablation in which the first action was sampled at high temperature occasionally produced wins, hinting that exploration was not merely diagnostic but sometimes solution-finding in itself. Several earlier approaches were tried and abandoned before the three-phase agent was settled: a one-shot LLM planner deterministic from o_{0} ; pure-RL / random-search policies without LLM guidance; scaling the model up under the (incorrect) assumption that the gap was capability rather than epistemic discipline; and a DSL-only symbolic solver without belief updating. Each failed in a characteristic way that the eventual architecture was designed to address. The FT09 result requires its own provenance note. Across 4 independent runs, the 0.5B model triggers a logged ACTION6 error immediately before SOLVED . The sequence was initially logged as a bug and only re-investigated after replicated runs showed identical timing; a side-by-side diff of solved versus unsolved