Information Density as a Quantitative Measure for AI-enabled Virtual Sensing: Feasibility and Limits

Hrishikesh Dutta, Roberto Minerva, Reza Farahbakhsh, and Noel Crespi · 2026

Read Information Density as a Quantitative Measure for AI-enabled Virtual Sensing: Feasibility and Limits by Hrishikesh Dutta, Roberto Minerva, Reza Farahbakhsh, and Noel Crespi (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-08180.txt.

Introduction

Hrishikesh Dutta, Roberto Minerva, Reza Farahbakhsh, and Noel Crespi propose a yardstick for deciding where physical sensors are truly needed. Sensor networks produce more data than they can store or send, and compression methods often lose information for good. Their alternative is virtual sensing, where missing signals are inferred from correlated ones.

The authors define information density with two complementary measures, one based on phase in eigen space and one on mutual information. The scores guide which sensors to deploy, within one modality or across several. Validation uses real data from Madrid's smart city infrastructure, and the study maps both the feasibility and the limits of the approach.

Catalog record

CREATORHrishikesh Dutta, Roberto Minerva, Reza Farahbakhsh, and Noel Crespi
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE64 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.08180

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Information Density as a Quantitative Measure for AI-enabled Virtual Sensing: Feasibility and Limits Hrishikesh Dutta, Roberto Minerva, Reza Farahbakhsh, and Noel Crespi Abstract Modern IoT and sensor networks generate vast amounts of data, posing significant challenges for storage, transmission, and real-time processing. Traditional approaches, such as compressive sensing and machine learning-based compression, often suffer from computational inefficiencies and irreversible data loss. This paper introduces Information Density as a quantitative metric to support sensor deployment and enable AI-driven virtual sensing. We propose a framework that leverages spatial, temporal and inter-modal correlations among sensor signals to perform sensing tasks even in the absence of physical sensors. Two complementary measures: (i) Phase in Eigen Space and (ii) Mutual Information, are developed to quantify and assess information density, enabling the selection of optimal sensor configurations across both intra-modality and cross-modality scenarios. Validated using real-world data from Madrid’s smart city infrastructure, this framework demonstrates the feasibility of replacing physical sensors with virtual ones under bounded error conditions (e.g., achieving < 3.21 % <3.21\% mean error with a single sensor). The results highlight the potential for scalable and energy-efficient sensing systems in smart environments. I Introduction Modern day technical advancements, such as, metaverse and smart environments, are fueled by massive data generation from large scale networks of sensors and IoT devices. Such massive IoT infrastructures, powering systems like autonomous transportation, smart cities, and industrial automation, are generating data at rates that exceed the capacity of conventional data infrastructures. As the number of connected devices grows, the volume of data, the speed at which it is generated, and the diversity of data types pose serious challenges for storage, transmission, and real-time processing. Without scalable management strategies, these systems face increased latency, higher energy consumption, and degraded performance. Let us consider Madrid, for instance, a front-runner in the smart city landscape. The city has deployed a vast and diverse array of IoT devices across its urban environment, enabling multi-modal sensing in areas such as traffic, air quality, weather conditions, noise levels, energy usage, and waste management. Its traffic monitoring system alone integrates over 7,000 sensors distributed across more than 4,000 locations, generating more than 145 million data points [ 13 ] . These figures represent just one slice of the city’s overall sensor infrastructure. With numerous other sensing networks operating simultaneously, the volume and complexity of the collected data become significant. In such a densely instrumented environment, the need for scalable data management and efficient system coordination becomes critical. There have been several research efforts to efficiently manage large-scale sensor networks and the massive data they generate. Traditional methods like compressive sensing [ 1 , 2 , 4 , 6 , 7 , 9 , 10 , 20 , 22 , 26 , 27 , 36 , 37 ] aggregate data from nearby sensors using spatio-temporal correlations and lossless compression, but often struggle with adaptability and impose heavy computation on sensor nodes. To address this, AI-based approaches have been adopted, including dimensionality reduction techniques like PCA [ 11 , 14 , 41 ] , SVD [ 3 , 23 ] , and LDA [ 17 ] , along with models such as autoencoders [ 8 , 29 ] and reinforcement learning [ 42 ] . More recent developments explore semantic communication [ 19 , 40 ] and synthetic or general-purpose sensing [ 32 , 31 , 43 ] , which use a limited number of versatile sensors to infer multiple phenomena. However, many of these methods place significant processing demands on resource-constrained devices. As a solution, the Data-driven Modality Fusion (DMF) framework [ 16 ] uses machine learning to fuse data from multiple sensors, enabling virtual sensing and reducing physical sensor count. Additional works [ 13 , 18 , 12 , 38 , 33 ] focus on minimizing sensor deployments while maintaining acceptable sensing performance. All these frameworks - relying on lossless compression, correlation measures and machine learning techniques - serve as noteworthy milestones towards an efficient management of large scale sensor network infrastructures and handling the massive volume of data generated. Particularly, the approaches developed in [ 16 ] empirically demonstrate their capabilities to retain meaningful feature information for data reconstruction and inference, without the complete reliance on physical sensors. Nevertheless, one common problem with these developments is the lack of a quantitative measure or a criterion that can be used to explore the optimal number and distribution of physical sensors in one or more regions, for a given sensing performance. This is not as trivial as it appears in the first look, since, the elimination of a subset of certain highly correlated sensing modalities can be useful from data management perspective, while still allowing us to recover them from the other modalities (as shown in our prior work [ 16 , 15 ] ); on the other hand, these highly correlated sensor values can be useful for extracting spatial information (as shown in [ 13 ] ) for a network deployed in a large city like Madrid. Therefore, in this work, we first extend the concept of Data-driven Modality Fusion (DMF) proposed in [ 16 ] to incorporate spatial sensing correlation into account and demonstrate how DMF allows us to perform sensing in a region with virtual, AI-enabled sensors, in the absence of real, physical sensors. Building on that, this paper introduces Information Density as a novel, quantitative metric to optimize sensor configurations. This metric enables informed decisions about which physical sensors are essential and which can be virtually inferred, thus reducing cost, energy consumption, and data redundancy. The added value lies in its application to both intra-modality (e.g., temperature-to-temperature inference) and cross-modality (e.g., air quality inferred from noise or traffic data) virtual sensing. Through the lens of Madrid’s sensor infrastructure, which is the use-case considered for this work, we demonstrate that accurate sensing can be achieved with significantly fewer physical devices. This paper has the following specific scopes and contributions. • This paper extends the concept of DMF to incorporate spatial sensing correlation, enabling fusion-based sensing in the absence of physical sensors. We demonstrate how virtual sensors, trained using fused data from multiple physical modalities, can replace or supplement real sensors for large-scale sensing applications. • This paper introduces the concept of information density as a quantitative metric to estimate the optimal number, type, and spatial distribution of sensors required for effective virtual sensing. It identifies and analyzes the distinct approaches needed for virtual sensing across sensors of the same modality ( intra-modality virtual sensing ), and of different modalities ( cross-modality inference ), based on their spatial and semantic correlations. • The proposed claims are validated in a real-world context by referencing smart city environments of Madrid, highlighting the relevance and scalability of the proposed methods. The remainder of the paper is organized as follows. First, we present a literature review of the existing approaches of data and network management in the context of large scale IoT/sensor networks. Next, we formally present the problem of Information Density and its relevance in the context of network and data management problem, in section III , followed by the proposed quantitative measures for defining it in section IV . Then, we present a use case of smart

Read the complete text