Beyond Flatlands: Unlocking Spatial Intelligence by Decoupling 3D Reasoning from Numerical Regression

Zhongbin Guo, Jiahe Liu, Yushan Li, Wenyu Gao, Zhen Yang, Chenzhi Li, Xinyue Zhang, Ping Jian · 2025

Read Beyond Flatlands: Unlocking Spatial Intelligence by Decoupling 3D Reasoning from Numerical Regression by Zhongbin Guo, Jiahe Liu, Yushan Li, Wenyu Gao, Zhen Yang, Chenzhi Li, Xinyue Zhang, Ping Jian (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-11239.txt.

Introduction

Zhongbin Guo, Jiahe Liu, and their colleagues present GEODE, an architecture that gives vision-language models real 3D spatial skill by splitting reasoning from number output. Such models grew up on flat images, so they miss depth and layout, and their token outputs cannot state precise continuous values. Costly geometric encoders at the input stage clash with shallow 2D features as well.

GEODE adds two plug-in modules. One acts as a spatial co-processor, aligning explicit 3D data with image features and distilling spatial step-by-step logic into tokens the main model can use. The other routes special tokens to a small network that regresses exact values and 3D boxes.

Catalog record

CREATORZhongbin Guo, Jiahe Liu, Yushan Li, Wenyu Gao, Zhen Yang, Chenzhi Li, Xinyue Zhang, Ping Jian
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-11239

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Beyond Flatlands: Unlocking Spatial Intelligence by Decoupling 3D Reasoning from Numerical Regression Zhongbin Guo, Jiahe Liu, Yushan Li, Wenyu Gao, Zhen Yang, Chenzhi Li, Xinyue Zhang, Ping Jian Abstract Existing Vision Language Models (VLMs) architecturally rooted in “flatland” perception, fundamentally struggle to comprehend real-world 3D spatial intelligence. This failure stems from a dual-bottleneck: input-stage conflict between computationally exorbitant geometric-aware encoders and superficial 2D-only features, and output-stage misalignment where discrete tokenizers are structurally incapable of producing precise, continuous numerical values. To break this impasse, we introduce GEODE (Geometric-Output and Decoupled-Input Engine), a novel architecture that resolves this dual-bottleneck by decoupling 3D reasoning from numerical generation. GEODE augments main VLM with two specialized, plug-and-play modules: Decoupled Rationale Module (DRM) that acts as spatial co-processor, aligning explicit 3D data with 2D visual features via cross-attention and distilling spatial Chain-of-Thought (CoT) logic into injectable Rationale Tokens; and Direct Regression Head (DRH), an “Embedding-as-Value” paradigm which routes specialized control tokens to a lightweight MLP for precise, continuous regression of scalars and 3D bounding boxes. The synergy of these modules allows our 1.5B parameter model to function as a high-level semantic dispatcher, achieving state-of-the-art spatial reasoning performance that rivals 7B+ models. 1 Introduction Figure 1 : Performance comparison of GEODE with other mainstream VLM models on VSI-bench 39 . Our model with only 1.5B parameters achieves SOTA overall performance, especially on Object Count and Absolute Distance tasks. Recent advances in Vision Language Models (VLMs) 2 ; 28 ; 30 ; 1 have marked a pivotal moment in artificial intelligence, demonstrating remarkable capabilities in understanding and reasoning over 2D images, videos, and text. However, the frontier of multimodal artificial intelligence is rapidly expanding beyond the flatland of pixels into the physically grounded, dynamic, and three-dimensional world we inhabit 47 . This transition presents a fundamental challenge that transcends mere data scaling: current VLM architectures, architecturally rooted in 2D perception, are overwhelmingly trained on planar tasks such as OCR and 2D grounding 44 ; 15 , yet they struggle to comprehend and reason about explicit geometric, spatial structures and temporal dynamics 19 . Their reliance on patch-level visual tokens makes them susceptible to spatial hallucinations — producing interpretations that are geometrically inconsistent or physically implausible 39 ; 43 . Consequently, they exhibit poor performance on real-world 3D tasks such as depth estimation, distance prediction, and path planning, severely limiting their deployment in embodied intelligence and autonomous driving scenarios 22 ; 10 . To address this deficiency, current approaches face two fundamental bottlenecks. At the input stage , a critical trade-off arises between geometric fidelity and computational tractability. While extending 2D-VLM with more spatio-temporal data 23 is computationally manageable, it remains architecturally insufficient for interpreting explicit 3D geometry. Conversely, attempts to directly integrate high-fidelity 3D sensors like LiDAR point clouds 32 ; 37 ; 21 achieve genuine geometric awareness, but at the cost of prohibitive computational overheads that render them impractical for scalable deployment. Concurrently, at the output stage , a structural misalignment emerges between the discrete, token-based nature of language models and the continuous values of the physical world. The autoregressive generation of tokens is fundamentally ill-suited for producing precise numerical quantities for tasks like distance measurement or object localization 33 . This forces an untenable compromise: models must either quantize continuous values into a coarse, error-prone vocabulary or abandon numerical precision entirely. Consequently, the prevailing design leaves VLMs trapped in a dilemma, being either geometrically superficial, computationally infeasible, or numerically imprecise. To break this impasse and truly unlock spatial intelligence, we introduce GEODE (Geometric-Output and Decoupled-Input Engine) , a novel architecture that fundamentally resolves this dual-bottleneck by decoupling 3D reasoning from numerical generation. GEODE transforms the main VLM with only 1.5B parameters from a monolithic processor into a parameter-efficient orchestrator, augmenting it with two specialized, plug-and-play modules. First, to address the input-stage deficiency, we present Decoupled Rationale Module (DRM) , a decoupled spatial reasoning co-processor. Unlike approaches that rely on implicit 2D geometric cues, DRM achieves a high-fidelity 2D-3D alignment by fusing native visual features with explicit encoded 3D data, such as point clouds and camera poses, through a cross-modal attention mechanism. This module is subsequently trained on spatial Chain-of-Thought (CoT) data to distill its complex spatio-temporal reasoning logic into a set of compact, injectable Rationale Tokens. These tokens, which encapsulate the reasoning process of the 3D world, provide the main VLM with rich, pre-computed spatial context, thereby jointly solving the geometrically superficial and computationally infeasible dilemma. Second, to achieve holistic numerical decoding for 3D spatial tasks, we propose the Direct Regression Head (DRH) . This “Embedding-as-Value” paradigm fundamentally bypasses the tokenization bottleneck for continuous numerical values. Our VLM is trained to emit specialized control tokens when a quantitative answer is required. The hidden-state embedding of these tokens is then intercepted and routed away from the standard language head to the DRH — a lightweight, specialized MLP trained with a regression loss. This mechanism demonstrates powerful generalization, seamlessly decoding embeddings into both precise scalar values for distance and multi-dimensional vectors for 3D bounding boxes. This solves the final numerically imprecise problem by design. Figure 2 : Overview of the GEODE architecture, contrasted with standard VLMs. ( Top-Left ) Standard VLMs are architecturally rooted in 2D perception, and their discrete tokenizers are ill-suited for generating precise, continuous numerical values. ( Bottom-Left ) GEODE architecture resolves this dual-bottleneck by decoupling 3D reasoning from numerical generation. Decoupled Rationale Module (DRM) acts as spatial co-processor, fusing 2D visual features with 3D pointcloud data and distilling the logic into injectable <Spatio> Rationale Tokens to solve the input bottleneck. Direct Regression Head (DRH) implements “Embedding-as-Value” paradigm, intercepting <REG> control tokens and regressing their embeddings directly into continuous values to solve the output bottleneck. ( Right ) A Spatial Chain-of-Thought (CoT) sample used for training DRM to generate Rationale Tokens encapsulate the underlying reasoning process. The synergy of the DRM (input rationale) and DRH (output regression) modules creates a remarkably parameter-efficient framework. The 1.5B main LLM 38 is liberated from the burdens of low-level 3D processing and high-precision numerical generation, allowing it to function as a high-level semantic dispatcher. This architecture allows our model, aligned from scratch, to achieve spatial intelligence on-par with, and in some cases exceeding, 7B+ parameter models on complex benchmarks like VSI-Bench 39 , as shown in Fig 1 . Our main contributions are summarized as follows: • We propose GEODE , a novel dual-decoupling architecture that resolves the fundamental input-reasoning and output-generation bottlenecks for spatial intelligence. • We introduce Decoupled Rationale Module (DRM) , a plug-and-play co-processor aligns explicit 3D point cloud features with 2D vision via cross-attention and distills CoT-based spatial logic into injectable Rationale Tokens. • We present Direct Regression Head (DRH) , an “Embedding-as-Value” mechanism that enables precise, continuous regression of both scalar values and 3D bboxes by decoding specialized token embeddings. • We demonstrate state-of-the-art parameter efficiency, showing our 1.5B model rivals 7B+ models on challenging 3D spatial reasoning benchmarks by integrating our decoupled modules. 2 Methodology Our GEODE framework is a dual-decoupling architecture which transforms a parameter-efficient VLM into high-level spatial orchestrator. It achieves this by introducing two synergistic components: Decoupled Rationale Module (DRM) for input-stage reasoning, and Direct Regression Head (DRH) for output-stage

Read the complete text