Fixed External Cameras as Common Prior Maps for Active 3D Scene Graph Generation

Giorgia Modi, Davide Buoso, Giuseppe Averta, Daniele De Martini · 2026

Read Fixed External Cameras as Common Prior Maps for Active 3D Scene Graph Generation by Giorgia Modi, Davide Buoso, Giuseppe Averta, Daniele De Martini (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-18184.txt.

Introduction

Giorgia Modi's 2026 paper treats views from fixed outside RGB cameras as common prior maps for robot scene mapping. Those wide views seed a semantic and geometric prior before the robot moves at all. An RGB-only pipeline then fuses on-board and outside views alike into an incremental 3D scene graph, with no hardware changes. A graph-guided search steers the robot toward zones of high semantic doubt, and even one outside camera lifts initial object recall by up to 79 percent.

Catalog record

CREATORGiorgia Modi, Davide Buoso, Giuseppe Averta, Daniele De Martini
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE18921
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.18184

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Fixed External Cameras as Common Prior Maps for Active 3D Scene Graph Generation Thanks: *Correspondent author: [email protected] Thanks: This work was supported by the EPSRC Impact Acceleration Account (IAA), and the UKRI InnovateUK project ‘A general-purpose configuration management system for highly configurable systems validated in automated logistics’. Giorgia Modi, Davide Buoso, Giuseppe Averta, Daniele De Martini Abstract Commonly available prior information, such as BIM models, floor plans, and remote sensing images, can provide valuable geometric and semantic context for autonomous robotic systems. In this paper, we treat observations from fixed external RGB cameras as Common Prior Maps (CPMs): wide-field views of the environment that initialize a semantic and geometric scene prior before any robot motion begins. We present an RGB-only framework for active, incremental 3D scene graph (3DSG) generation that seamlessly fuses observations from both onboard robot cameras and fixed external cameras within a single hardware-agnostic pipeline. By relying solely on RGB observations processed by a feed-forward 3D reconstruction model, the system treats all cameras - onboard or external - identically, requiring no hardware modifications. A graph-based active semantic exploration framework then directly leverages the partial scene graph to guide the robot toward regions of high semantic uncertainty, progressively completing and refining the prior. Experiments demonstrate that bootstrapping the scene graph with even a single external camera increases initial object recall by up to +79% , and that the richer context of the prior significantly improves the efficiency of subsequent active exploration. I Introduction Modern robotic systems navigating unstructured human environments – such as homes, hospitals and offices - heavily depend upon rich contextual visual scene understanding to perceive, decide, and act autonomously [ 14 ] . Traditional perception pipelines build either low-level dense metric maps that lack explicit semantic content, or produce object-centric outputs that fail to encode relational structure [ 26 ] . A structured representation that jointly captures which entities are present, where they exist in 3D space, and how they relate to one another is therefore essential for reliable robot autonomy. 3D scene graphs (3DSGs) have emerged as a powerful representation for this purpose [ 13 , 1 ] . In a 3DSG, nodes correspond to object instances annotated with semantic labels and metric locations, while edges encode spatial and functional relationships between them. This compact and queryable structure supports downstream tasks including language and task planning [ 16 ] , navigation [ 24 ] , and manipulation [ 10 ] . However, constructing such representations robustly and efficiently in real-world environments remains challenging, especially when prior knowledge about the scene is only partially available. This motivates the use of Common Prior Maps (CPMs), which have long been available in real-world deployments and offer rich geometric and semantic priors. We argue that observations from fixed external cameras, already deployed as surveillance or monitoring infrastructure in many buildings, can serve as a valuable and underutilized form of CPM for robot scene understanding. To exploit this prior, the perception pipeline must seamlessly incorporate external camera observations, which are typically available as RGB images. We therefore present a framework for active 3D scene graph generation from RGB inputs alone. By removing the dependency on depth sensors and relying instead on feed-forward 3D reconstruction [ 11 ] , the system processes all RGB inputs - onboard and external - through a unified pipeline. Within this framework, the 3DSG becomes the semantic and geometric representation extracted from external-camera observations, capturing the dominant layout, objects, and spatial relationships of the environment. Our contributions are: 1. an RGB-only pipeline for 3D scene graph generation that enables seamless integration of fixed external cameras; 2. an active semantic exploration loop that uses the scene graph to select informative viewpoints; 3. experimental evidence that camera-infrastructure priors substantially improve scene graph completeness and exploration efficiency. II Related Work 3D Scene Graphs (3DSGs). Scene graphs couple object semantics with relational context, addressing ambiguities in purely object-centric systems [ 26 ] . Grounding this abstraction in 3D enables navigation, manipulation, and language-guided planning [ 5 ] . Systems such as Hydra [ 9 ] and SceneGraphFusion [ 25 ] build hierarchical representations from RGB-D SLAM, while ConceptGraphs [ 8 ] introduces open-vocabulary semantics via foundation models, but still assumes access to depths and camera poses. To the best of our knowledge, our system is the first to enable 3DSG generation in an RGB-only setting. Active Perception. Active perception—controlling sensing to maximize information gain—has long been studied via Next-Best-View (NBV) planning [ 2 ] . Geometric frontier-based methods [ 27 ] and density-based approaches [ 3 ] efficiently expand coverage but ignore semantics. Recent work incorporates semantic reasoning: Ding et al. [ 7 ] use semantic scene completion to guide exploration toward uncertain regions, while Chen et al. [ 6 ] combine semantic and geometric uncertainty via 3D Gaussian Splatting. ASP [ 22 ] further enables LLM-based reasoning over scene graphs, turning them into active exploration tools. However, prior work on ASP has not considered settings with external camera inputs, nor RGB-only perception. External sensing. While robotic perception is typically egocentric, fixed external cameras provide complementary global context. Prior work shows their value for visual servoing [ 18 ] and VLM-guided navigation [ 4 ] , but their integration into 3DSGs remains unexplored. III Methodology Fig. 1 : System Overview. RGB observations from fixed external cameras serve as a Common Prior Map (CPM) and are processed by the RGB-only 3DSG generation pipeline to initialize the point cloud and 3D scene graph. For t>0 , the onboard robot camera provides new RGB observations that incrementally update the point cloud and scene graph. The active exploration module then uses the current scene graph to select the Next-Best-View (NBV) and the robot moves to the selected viewpoint to continue exploration. The architecture is modular, separating 3D metric reconstruction, scene graph generation, and active exploration into distinct stages. III-A System Overview The system operates as an incremental perception–action loop, illustrated in Fig. 1 . At initialization ( t=0 ), RGB observations from one or more fixed external cameras serve as a Common Prior Map (CPM). These observations are processed by the RGB-only 3DSG generation pipeline to initialize a point cloud and scene graph, providing semantic and geometric structure before robot motion begins. For subsequent steps ( t>0 ), the robot acquires an RGB image from its current viewpoint v_{t}\in\mathcal{V} , where \mathcal{V} denotes the set of navigable viewpoints. The same RGB-only pipeline processes this observation to update the reconstructed point cloud \mathcal{P}_{t} and the scene graph \mathcal{G}_{t} . Based on the current graph, the active exploration module selects the Next-Best-View (NBV) v_{t+1} by maximizing expected information gain. The robot then moves to the selected viewpoint, acquires a new observation from the onboard camera, and repeats the loop, progressively extending and refining the initial CPM. III-B RGB-Only 3DSG Generation Depths and Poses Estimation. The pipeline leverages MapAnything [ 11 ] to infer scene geometry from a set of RGB images. Given N inputs, the model predicts in a single forward pass a factored representation: per-view pixel ray directions R_{i} , up-to-scale depth maps \tilde{D}_{i} , poses \tilde{P}_{i} in the reference frame of the first image, and a global metric scale factor m\in\mathbb{R} . These outputs

Read the complete text