SPAR: Self-supervised Placement-Aware Representation Learning for Distributed Sensing
Yizhuo Chen, Tianchen Wang, You Lyu, Yanlan Hu, Jinyang Li, Tomoyoshi Kimura, Hongjue Zhao, Yigong Hu, Denizhan Kara, Tarek Abdelzaher · 2025
Read SPAR: Self-supervised Placement-Aware Representation Learning for Distributed Sensing by Yizhuo Chen, Tianchen Wang, You Lyu, Yanlan Hu, Jinyang Li, Tomoyoshi Kimura, Hongjue Zhao, Yigong Hu, Denizhan Kara, Tarek Abdelzaher (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-16936.txt.
Introduction
Sensors scattered through a city or a body record signals that are warped by where each sensor sits, yet standard pretraining pretends placement is a footnote. Yizhuo Chen and co-authors build SPAR in this 2025 paper, a self-supervised framework that treats placement as part of the signal itself. Its guiding idea is a duality: positions shape signals, and signals betray positions.
Spatial and structural embeddings of placement feed dual reconstruction tasks that teach the model both directions at once. The design carries information-theoretic support. On three real-world datasets spanning vehicles, human activity, and earthquakes, SPAR generalized better across placements and tasks than placement-blind rivals, the authors report.
Catalog record
| CREATOR | Yizhuo Chen, Tianchen Wang, You Lyu, Yanlan Hu, Jinyang Li, Tomoyoshi Kimura, Hongjue Zhao, Yigong Hu, Denizhan Kara, Tarek Abdelzaher |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 71 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-16936
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
SPAR: Self-supervised Placement-Aware Representation Learning for Distributed Sensing Yizhuo Chen, Tianchen Wang, You Lyu, Yanlan Hu, Jinyang Li, Tomoyoshi Kimura, Hongjue Zhao, Yigong Hu, Denizhan Kara, Tarek Abdelzaher Abstract We present SPAR, a framework for self-supervised placement-aware representation learning in distributed sensing. Distributed sensing spans applications where multiple spatially distributed and multimodal sensors jointly observe an environment, from vehicle monitoring to human activity recognition and earthquake localization. A central challenge shared by this wide spectrum of applications is that observed signals are inseparably shaped by sensor placements, including their spatial locations and structural characteristics. However, existing pretraining methods remain largely placement-agnostic. SPAR addresses this gap through a unifying principle: the duality between signals and positions. Guided by this principle, SPAR introduces spatial and structural positional embeddings together with dual reconstruction objectives, explicitly modeling how observing positions and observed signals shape each other. Placement is thus treated not as auxiliary metadata but as intrinsic to representation learning. SPAR is theoretically supported by analyses from information theory and occlusion-invariant learning. Extensive experiments on three real-world datasets show that SPAR achieves superior robustness and generalization across various modalities, placements, and downstream tasks. 1 Introduction Figure 1 : An overview of the SPAR workflow applied to a multi-modal multi-node distributed sensing application. Each node from each modality collects its own signal and is associated with a spatial position, as well as unique characteristics that influence its signal patterns. During pretraining, SPAR encodes information from all these aspects to generate latent embeddings, optimized via self-supervised objectives on unlabeled data. In the fine-tuning stage, the encoder is frozen and used to extract representations, which are then fed into task-specific heads trained with labeled data for downstream tasks. This paper advances self-supervised placement-aware representation learning , motivated by the broad class of applications we term distributed sensing . By distributed sensing, we refer to systems where multiple spatially distributed sensing points, potentially spanning diverse modalities, jointly observe an environment. This definition unifies a wide spectrum of domains, including seismic and acoustic monitoring for security ( Li et al., 2025 ; California Institute of Technology (Caltech), 1926 ) , human activity recognition with body-worn sensors ( Gu et al., 2021 ; Sztyler and Stuckenschmidt, 2016 ) , vehicle monitoring in urban spaces ( Bathla et al., 2022 ) , environmental monitoring ( Ullo and Sinha, 2020 ) , and smart cities ( Syed et al., 2021 ) . These scenarios, though superficially distinct, share the common challenge of reconstructing or representing an environment from heterogeneous, distributed vantage points. Sensor placement lies at the core of distributed sensing. A sensor’s vantage point is determined by both its spatial location (e.g., GPS coordinates of roadside microphones monitoring passing vehicles, governing the propagation paths of acoustic waves) and its structural characteristic (e.g., differences in sensor mounting, orientation, or coupling to the ground, which shape frequency response and noise patterns). Robust representation learning in this setting requires models that not only capture signal content but also interpret how those signals are mediated by sensor placement. Despite rapid progress in pretraining, current approaches, whether contrastive ( Ouyang et al., 2024 ) , generative reconstruction ( Kara et al., 2024b ) , or language-model-based ( Ouyang and Srivastava, 2024 ) , remain largely placement-agnostic, overlooking the fact that distributed sensing signals are inseparably shaped by sensor placement. This omission limits generalization across layouts and tasks. To address this gap, we introduce SPAR ( S elf-supervised P lacement- A ware R epresentation learning), a general-purpose pretraining framework that explicitly incorporates placement into representation learning for distributed sensing. Our design is guided by a core principle: the duality between positions and signals . That is, spatial and structural configurations are not auxiliary metadata to the signals, but stand in an equal and mutually-determining relationship with signals. Together, they define how observations are generated, propagated, and interpreted. This principle is both general and intrinsic, applying across the full spectrum of distributed sensing applications. Building on this principle, SPAR introduces explicit spatial and structural positional embeddings, and introduces dual reconstruction objectives that enforce the mutual recoverability of placements and signals with contextual awareness. Together, these elements yield a cohesive, placement-aware pretraining strategy that is broadly applicable across sensing modalities and layouts. An overview of the SPAR workflow is illustrated in Figure 1 . To our knowledge, this is the first work to treat placement as a universal inductive bias for distributed sensing systems as a whole, rather than as an application-specific add-on. We further provide theoretical analyses grounded in information theory and occlusion-invariant representation learning ( Kong and Zhang, 2023 ) to elucidate the rationale behind our design. Experiments on three real-world datasets, covering vehicle monitoring ( Li et al., 2025 ) , human activity recognition ( Sztyler and Stuckenschmidt, 2016 ) , and earthquake localization ( California Institute of Technology (Caltech), 1926 ) , demonstrate that SPAR consistently outperforms existing approaches across diverse sensing modalities, spatial configurations, and downstream tasks. In summary, this paper makes the following contributions: (1) We introduce SPAR, a novel, general pretraining framework for distributed sensing that explicitly models spatial layouts and node-specific characteristics, guided by the duality between positions and signals. (2) We provide theoretical analyses from information-theoretic and occlusion-invariant perspectives that explain the effectiveness of our design. (3) We validate SPAR through extensive experiments on three real-world distributed sensing datasets, demonstrating superior generalizability and robustness compared to prior methods. We release our implementation and scripts at https://anonymous.4open.science/r/SPAR-F6F3/ . 2 Related Work Pretraining and Foundation Models for Sensing. Pretraining for sensing seeks transferable representations from unlabeled data and broadly follows three paradigms: contrastive learning, masked reconstruction, and LLM-based frameworks. Contrastive methods align multi-modal embeddings, ranging from intra-sample approaches such as Cosmo ( Ouyang et al., 2022 ) , Cocoa ( Deldari et al., 2022 ) , and FOCAL ( Liu et al., 2023 ) , to large-scale or loosely paired models like ImageBind ( Girdhar et al., 2023 ) and MMBind ( Ouyang et al., 2024 ) . Generative approaches are dominated by masked autoencoding ( Woo et al., 2024 ; Das et al., 2024 ) , including time-series adaptations such as Ti-MAE ( Li et al., 2023 ) , MOMENT ( Goswami et al., 2024 ) , TS-MAE ( Liu et al., 2025 ) , and frequency-aware variants like FreqMAE ( Kara et al., 2024b ) and PhyMask ( Kara et al., 2024a ) . LLM-based frameworks integrate sensing into language-centric models ( Gruver et al., 2023 ; Garza et al., 2023 ) , including LIMU-BERT ( Xu et al., 2021 ) , Penetrative AI ( Xu et al., 2024 ) , LLMSense ( Ouyang and Srivastava, 2024 ) , and IoT-LM ( Mo et al., 2024 ) . Despite their success, these methods remain largely placement-agnostic, overlooking the spatial layout and node-specific characteristics intrinsic to distributed sensing; in contrast, SPAR explicitly incorporates spatial and structural information during pretraining to improve contextual grounding and robustness. Pretraining with Different Notions of "Spatial" Context. Several works incorporate spatial context, though definitions of “spatial” differ. In vision, it typically refers to grids of pixels or patches, as in video ( Feichtenhofer et al., 2022 ; Wu et al., 2023a ) , remote sensing (