GeoProg3D: Compositional Visual Reasoning for City-Scale 3D Language Fields

Shunsuke Yasuki, Taiki Miyanishi, Nakamasa Inoue, Shuhei Kurita, Koya Sakamoto, Daichi Azuma, Masato Taki, Yutaka Matsuo · 2025

Read GeoProg3D: Compositional Visual Reasoning for City-Scale 3D Language Fields by Shunsuke Yasuki, Taiki Miyanishi, Nakamasa Inoue, Shuhei Kurita, Koya Sakamoto, Daichi Azuma, Masato Taki, Yutaka Matsuo (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-23352.txt.

Description

Shunsuke Yasuki and co-authors build a system for asking questions about whole cities in 3D in a 2025 paper. Language fields let users query 3D scenes in plain words, but past versions stalled at room or block scale. City scenes are vast, and queries often chain several steps of reasoning.

Their GeoProg3D pairs two parts. A geography-aware language field stores the city in a memory-light layered model, tagged with direction, distance, height, and landmark data. A tool kit of geographic vision functions then handles jobs like segmenting areas or spotting objects. A language model writes small programs that combine those tools. On a new 952-question benchmark, the system beat prior scene and vision-language models across five task types.

Catalog record

CREATORShunsuke Yasuki, Taiki Miyanishi, Nakamasa Inoue, Shuhei Kurita, Koya Sakamoto, Daichi Azuma, Masato Taki, Yutaka Matsuo
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE54 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-23352

Browse the full library · About the Tower of Babel