Spatial Atlas: Compute-Grounded Reasoning for Spatial-Aware Research Agent Benchmarks

Arun Sharma · 2026

Read Spatial Atlas: Compute-Grounded Reasoning for Spatial-Aware Research Agent Benchmarks by Arun Sharma (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-12102.txt.

Introduction

Sharma describes compute-grounded reasoning, where code solves sub-problems from representations before a model answers. Spatial Atlas is an Agent2Agent server with two handlers; the engineering side writes code, parses scores, and caps repair. The spatial handler extracts a scene graph; code fills distances and checks rules. A metric bridge computes gap values from masks and a point map, returning unavailable when checks fail, never using estimates. One run, four paths writing eight rows each with sealed labels, establishes integrity only, with no score and no FieldWorkArena result.

Catalog record

CREATORArun Sharma
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE38633
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.12102

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Spatial Atlas: Compute-Grounded Reasoning for Spatial-Aware Research Agent Benchmarks Arun Sharma Abstract We introduce compute-grounded reasoning (CGR), a design paradigm for spatial-aware research agents in which every answerable sub-problem is resolved by deterministic computation before a language model is asked to generate. Spatial Atlas instantiates CGR as a single Agent-to-Agent (A2A) server that handles two challenging benchmarks: FieldWorkArena, a multimodal spatial question-answering benchmark spanning factory, warehouse, and retail environments, and MLE-Bench, a suite of 75 Kaggle machine learning competitions requiring end-to-end ML engineering. A structured spatial scene graph engine extracts entities and relations from vision descriptions, computes distances and safety violations deterministically, then feeds computed facts to large language models, thereby avoiding hallucinated spatial reasoning. Entropy-guided action selection maximizes information gain per step and routes queries across a three-tier frontier model stack (OpenAI + Anthropic). A self-healing ML pipeline with strategy-aware code generation, a score-driven iterative refinement loop, and a prompt-based leak audit registry round out the system. We evaluate across both benchmarks and show that CGR yields competitive accuracy while maintaining interpretability through structured intermediate representations and deterministic spatial computations. 1 Introduction The development of general-purpose research agents capable of operating across diverse evaluation domains represents a fundamental challenge in artificial intelligence. While large language models (LLMs) have demonstrated remarkable reasoning capabilities [ 19 , 1 ] , deploying them as autonomous agents that can reliably solve real-world tasks remains an open problem [ 22 ] . Two recent benchmarks highlight complementary dimensions of this challenge: FieldWorkArena [ 7 ] , which evaluates multimodal spatial reasoning in industrial environments such as factories, warehouses, and retail spaces, and MLE-Bench [ 3 ] , which tests end-to-end machine learning engineering across 75 Kaggle competitions. Most existing agent architectures treat these benchmarks as independent problems, developing specialized systems for each [ 26 , 11 ] . This fragmentation wastes shared infrastructure and misses opportunities for architectural insights that transfer across domains. For instance, the structured reasoning required to answer spatial questions (“How many pallets are within 3 meters of the emergency exit?”) shares fundamental properties with the systematic hypothesis testing needed to select effective ML strategies (“Which feature engineering approach maximizes validation accuracy for this tabular dataset?”). We present Spatial Atlas , a spatial-aware research agent that addresses both benchmarks through a single Agent-to-Agent (A2A) protocol server [ 8 ] . The system is organized around a design paradigm we call compute-grounded reasoning (CGR): wherever a sub-problem admits a deterministic solution, compute the answer first and supply it as a fact to the language model rather than asking the model to generate it. Our architecture instantiates CGR through five key contributions: 1. Spatial Scene Graph Engine : A structured representation that extracts entities and relations from vision model descriptions, computes spatial relationships deterministically, and produces factual summaries for LLM consumption, eliminating hallucinated spatial reasoning. 2. Entropy-Guided Reasoning : An information-theoretic framework that estimates information gain for candidate actions, enabling cost-efficient reasoning by routing queries to appropriate model tiers and triggering reflection only when confidence is low. 3. Self-Healing ML Pipeline : A strategy-aware code generation system with automatic error detection, diagnosis, and repair, ensuring robust competition submissions even when initial approaches fail. 4. Score-Driven Refinement : An iterative improvement loop that parses machine-readable validation scores from pipeline output and uses a cross-provider strong model to propose targeted improvements, keeping whichever submission scores higher. 5. Leak Audit Registry : A prompt-based exploit framework that detects train/test data leakage at codegen time and injects targeted hints so the strong model can adapt the exploit to the actual data. The unifying principle behind these contributions is compute-grounded reasoning: wherever possible, we compute answers deterministically from structured representations rather than asking language models to generate them directly. This design philosophy yields more reliable, interpretable, and cost-efficient agent behavior across both evaluation domains, and we argue that CGR defines a general class of spatial-aware research agents whose reliability stems from grounding generation in computation. 2 Related Work Agent Frameworks: The rapid development of LLM-based agent frameworks has produced systems spanning general-purpose reasoning and specialized domains. AutoGPT [ 21 ] pioneered autonomous LLM agents with self-directed task decomposition, while OpenDevin (now OpenHands) [ 11 ] established a software development agent framework with sandboxed code execution. SWE-Bench agents [ 13 ] demonstrated that LLMs can resolve real-world GitHub issues, and DAMO MLE-Agent [ 27 ] specifically targets Kaggle-style ML competitions. Our work differs in unifying two distinct benchmark domains under a single architecture with shared compute-grounded reasoning infrastructure. Spatial Reasoning in Vision-Language Models: Vision-language models (VLMs) exhibit well-documented weaknesses in spatial reasoning tasks, particularly object counting, distance estimation, and relative positioning [ 18 , 4 ] . Studies have shown that VLMs frequently hallucinate spatial relationships when asked to reason about complex scenes [ 16 ] . SpatialVLM [ 4 ] attempts to address this through specialized spatial training data, while our approach sidesteps the problem entirely by extracting structured representations and computing spatial facts deterministically. Scene Graphs for Visual Reasoning: Scene graph representations, popularized by Visual Genome [ 15 ] and the GQA dataset [ 12 ] , provide structured representations of visual scenes as graphs of objects and relationships. Neural scene graph generation [ 25 ] and scene graph-based visual question answering [ 9 ] have shown that explicit structure improves reasoning over raw visual features. Our spatial scene graph engine adapts these ideas to industrial environments, incorporating distance computation and constraint checking as first-class operations. AutoML and Competition-Oriented Systems: Automated machine learning frameworks such as AutoGluon [ 5 ] , Auto-sklearn [ 6 ] , and AutoKeras [ 14 ] aim to automate the end-to-end ML pipeline. More recent work leverages LLMs for ML code generation [ 10 ] , combining the flexibility of natural language understanding with systematic hyperparameter search. Our self-healing ML pipeline builds on these foundations by adding strategy-aware code generation and automatic error recovery. A2A Protocol and Agent Interoperability: Google’s Agent-to-Agent (A2A) protocol [ 8 ] defines a standard for inter-agent communication, enabling heterogeneous agents to collaborate through a common interface. Our system implements a compliant A2A server that exposes both spatial reasoning and ML pipeline capabilities through a unified task interface, demonstrating the protocol’s flexibility for multi-domain agent deployment. Information-Theoretic Reasoning: Active learning [ 20 ] and Bayesian experimental design [ 2 ] provide principled frameworks for selecting actions that maximize information gain. Recent work has applied these ideas to LLM reasoning chains [ 24 ] , using uncertainty estimates to guide when to seek additional information. Our entropy-guided reasoning extends this paradigm to agent action selection, estimating which reasoning step will most reduce uncertainty about the final answer. 3 System Architecture Spatial Atlas operates as a spatial-aware research agent exposed via a dual-domain A2A server. It receives task requests through a standardized protocol and routes them to the appropriate processing pipeline. Figure 1 illustrates the overall system design. A2A Protocol Server Domain Classifier FieldWorkArena Handler MLE-Bench Handler Spatial Scene Graph Engine Self-Healing ML Pipeline Shared Infrastructure LiteLLM \cdot 3-Tier Routing \cdot Cost Tracking Entropy-Guided Reasoning Engine goal format tar.gz Figure 1: Spatial Atlas system architecture. The A2A server routes incoming tasks to domain-specific handlers through a classifier. Both domains share

Read the complete text