SSR : A Generic Framework for Text-Aided Map Compression for Localization
Mohammad Omama, Po-han Li, Harsh Goel, Minkyu Choi, Behdad Chalaki, Vaishnav Tadiparthi, Hossein Nourkhiz Mahjoub, Ehsan Moradi Pari, Sandeep P. Chinchali · 2026
Read SSR : A Generic Framework for Text-Aided Map Compression for Localization by Mohammad Omama, Po-han Li, Harsh Goel, Minkyu Choi, Behdad Chalaki, Vaishnav Tadiparthi, Hossein Nourkhiz Mahjoub, Ehsan Moradi Pari, Sandeep P. Chinchali (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-04272.txt.
Introduction
Omama and colleagues cut robot map costs by treating text as a second channel for maps. Short written descriptions pair with tiny image feature vectors that hold complementary detail. Their technique, Similarity Space Replication, learns in one shot an embedding keeping only what text lacks. Tests on place recognition and object centred Monte Carlo localization, indoors and out, confirm the approach. It compresses about twice as well as rival baselines on TokyoVal, Pittsburgh30k, Replica, and KITTI.
Catalog record
| CREATOR | Mohammad Omama, Po-han Li, Harsh Goel, Minkyu Choi, Behdad Chalaki, Vaishnav Tadiparthi, Hossein Nourkhiz Mahjoub, Ehsan Moradi Pari, Sandeep P. Chinchali |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 37462 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.04272
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
SSR : A Generic Framework for Text-Aided Map Compression for Localization Mohammad Omama, Po-han Li, Harsh Goel, Minkyu Choi, Behdad Chalaki, Vaishnav Tadiparthi, Hossein Nourkhiz Mahjoub, Ehsan Moradi Pari, Sandeep P. Chinchali Abstract Mapping is crucial in robotics for localization and downstream decision-making. As robots are deployed in ever‑broader settings, the maps they rely on continue to increase in size. However, storing these maps indefinitely (cold storage), transferring them across networks, or sending localization queries to cloud-hosted maps imposes prohibitive memory and bandwidth costs. We propose a text-enhanced compression framework that reduces both memory and bandwidth footprints while retaining high-fidelity localization. The key idea is to treat text as an alternative modality—one that can be losslessly compressed with large language models. We propose leveraging lightweight text descriptions combined with very small image feature vectors, which capture “complementary information” as a compact representation for the mapping task. Building on this, our novel technique, Similarity Space Replication ( SSR ), learns an adaptive image embedding in one shot that captures only the information “complementary” to the text descriptions. We validate our compression framework on multiple downstream localization tasks, including Visual Place Recognition as well as object-centric Monte-Carlo localization in indoor as well as outdoor settings. SSR achieves 2 × 2\times better compression than competing baselines on state-of-the-art datasets, including TokyoVal, Pittsburgh30k, Replica, and KITTI. Keywords: Compression, Mapping, Localization Figure 1: Map compression pipeline and downstream use-cases. The mapping robot (1) first creates a standard map of the environment (2), which is then converted into a feature map (3). Our proposed compression framework (4) processes these feature maps into highly compressed text and complementary feature vectors (5). The compressed map can be stored in cold storage (6), uploaded to a server (7) for remote queries, or transmitted to another robot (8). During inference, if the robot has the compressed map locally (8), standard localization is performed. Otherwise, the input image (10) is compressed by the robot (9), sent to the server, decompressed, and localized, with the resulting pose returned to the robot. 1 Introduction Figure 2: Highly compressible text descriptions combined with “complementary” image information are enough for effective localization. Text descriptions (highly compressible) are good enough to discard the bottom two candidates in the reference set for the given query but struggle to distinguish between the top two. Integrating complementary details from the image, like whether the building tapers, ensures a precise match. Modern robots—like self-driving cars, delivery drones, and warehouse vehicles—localize by matching live sensory input against ever-growing maps . These maps grow continuously as robots are deployed to new areas. In city-scale ride-hailing systems, for example, the landmark database can exceed terabytes of data. Sending daily map updates to hundreds of cars can overwhelm cellular networks. Bandwidth and storage constraints appear in other settings as well. An indoor service robot frequently sends image snippets to a cloud server that hosts a high-resolution map of its operational area; each query incurs both latency and bandwidth costs. Further, survey drones that fly week-long missions over farmland collect petabytes of imagery; archiving this data for later use has prohibitive memory costs. All of these scenarios underline a simple point: without effective compression techniques, map storage and communication quickly become the dominant costs in robotic localization. Consequently, there is a pressing need for map compression techniques tailored for localization that a) reduce memory and bandwidth footprints and b) seamlessly adapt to varying resource constraints. To address this, we propose a novel map compression pipeline (illustrated in Fig. 1 ), which transforms feature maps into highly compressed text descriptions and complementary feature vectors, enabling efficient storage, transmission, and localization across diverse deployment settings. Existing classical and neural compression techniques focus on reconstruction quality, making them unsuitable for localization. Other popular map compression techniques primarily focus on dimensionality reduction or quantization. Contrastingly, our approach, leverages lightweight, easily-compressible text descriptions generated by vision-language models, combined with compact image feature vectors. These compact feature vectors are learned using our novel method, Similarity Space Replication ( SSR ), and capture “complementary information”. Together, the text descriptions and complementary image vectors enable a compact solution for map compression tailored for localization. Fig. 2 shows a Visual Place Recognition (VPR) scenario where the goal is to find the closest match for a query image of a building. Text descriptions can easily eliminate the bottom two candidates in the reference set, but fail to distinguish between the top two. By integrating text with “complementary features”—like whether the building tapers—we accurately identify the correct match using minimal data. Moreover, our approach SSR is adaptive and does not require separate training to adapt to fluctuating bandwidth. Motivation for Using Text: Our two key insights are that text is inherently more compact and significantly easier to compress than images or feature vectors. For example, a JPEG image [ 54 ] is typically around 500 KB, while a CLIP feature vector [ 38 ] is approximately 4 KB. In contrast, a concise 1–2 line caption describing the image is roughly 0.1 KB. Moreover, leveraging recent advancements such as LLMZip [ 53 ] , the caption can be further compressed losslessly—down to approximately 0.025 KB—making text an ideal modality for compression. As a result, we only need marginal or complementary information from the image, which we obtain using our novel technique, SSR . To the best of our knowledge, this is the first work to demonstrate that recent LLM-based compression techniques can be extended to robotic map compression. The central idea of this work is presented in Fig. 3 . To summarize, our contributions are: 1. We propose a novel technique that uses text, highly compressed with LLMZip, and complementary image information to achieve effective map compression. 2. Our method, Similarity Space Replication ( SSR ), effectively learns an adaptive embedding that captures information complementary to text, as shown in Fig. 3 (A) and further discussed in Sec. 3.3 . SSR can work with any feature extractor as demonstrated in Sec. 4.2 . 3. Our approach achieves 2\times better compression than competing baselines on state-of-the-art (SOTA) localization datasets, as shown in Fig. 3 (C) and discussed in Sec. 4.2 . We also release our codebase in the supplementary material. Throughout the paper, when we refer to SSR in the context of methodology, we mean our approach for learning complementary image feature factors, as illustrated in Fig. 3 (A). In the context of experiments, these terms denote the complete compression setup, incorporating both the complementary image feature vectors and the LLMZipped text during inference as shown in Fig. 3 (B). Figure 3: Pipeline for SSR . (A) SSR (detailed in Sec. 3.3 ) learns adaptive embeddings (green) from the image embeddings (brown) that capture complementary information to the text embeddings (blue). (B) During inference, SSR projects the image embedding to any desired dimension based on the constraints. In parallel, captions are generated (Sec. 3.1 ) and then compressed with LLMZip (Sec. 3.2 ). The projected complementary feature vector and LLMZipped text are then stored or transmitted. (C) SSR (green) outperforms all competing compression baselines (complete results in Sec. 4.2 ). 2 Background and Related Work Deep Metric Learning: Deep Metric Learning (DML) provides a foundation for image retrieval