Distributed Intelligence in the Computing Continuum with Active Inference
Victor Casamayor Pujol, Boris Sedlak, Tommaso Salvatori, Karl Friston, Schahram Dustdar · 2025
Read Distributed Intelligence in the Computing Continuum with Active Inference by Victor Casamayor Pujol, Boris Sedlak, Tommaso Salvatori, Karl Friston, Schahram Dustdar (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-24618.txt.
Introduction
The internet's computing now sprawls from pocket sensors to giant data centers. Victor Casamayor Pujol and four co-authors give each service in that sprawl a small reasoning agent in a 2025 paper. The agents run on active inference, a brain-inspired framework where systems act to keep their world predictable.
Each agent manages one service in a stream processing pipeline, chasing service goals that are device-aware: the same target means different things on a sensor and on a server. In experiments the agents met over 90 percent of goals with known models, and about 80 percent while learning the models on the job. A reinforcement learning rival matched the scores only after heavy training. The authors argue agents that reason from first principles travel better across the continuum's chaos than agents that must be retrained everywhere.
Catalog record
| CREATOR | Victor Casamayor Pujol, Boris Sedlak, Tommaso Salvatori, Karl Friston, Schahram Dustdar |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 85 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-24618
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Distributed Intelligence in the Computing Continuum with Active Inference Victor Casamayor Pujol, Boris Sedlak, Tommaso Salvatori, Karl Friston, Schahram Dustdar Abstract The Computing Continuum (CC) is an emerging Internet-based computing paradigm that spans from local Internet of Things (IoT) sensors and constrained edge devices to large-scale cloud data centers. Its goal is to orchestrate a vast array of diverse and distributed computing resources to support the next generation of Internet-based applications. However, the distributed, heterogeneous, and dynamic nature of CC platforms demands distributed intelligence for adaptive and resilient service management. This article introduces a distributed stream processing pipeline as a CC use case, where each service is managed by an Active Inference (AIF) agent. These agents collaborate to fulfill service needs specified by SLOiDs , a term we introduce to denote Service Level Objectives that are aware of its deployed devices, meaning that non-functional requirements must consider the characteristics of the hosting device. We demonstrate how AIF agents can be modeled and deployed alongside distributed services to manage them autonomously. Our experiments show that AIF agents achieve over 90% SLOiD fulfillment when using tested transition models, and around 80% when learning the models during deployment. We compare their performance to a multi-agent reinforcement learning (MARL) algorithm, finding that while both approaches yield similar results, MARL requires extensive training, whereas AIF agents can operate effectively from the start. Additionally, we evaluate the behavior of AIF agents in offloading scenarios, observing a strong capacity for adaptation. Finally, we outline key research directions to advance AIF integration in CC platforms. K eywords Compute continuum, Active Inference, Service Level Objective, Multi-agent 1 Introduction The next generation of Internet-based applications is poised to change how we live as a society: Autonomous driving will revolutionize urban transportation, demanding ultra-low latency to enable real-time decision-making [ Lin et al.(2018) ] . E-Health applications will allow for remote and detailed patient care, but will also require local data processing to protect patient privacy [ Makina et al.(2024) ] . Fleets of robots will autonomously clean and maintain city streets, ensuring efficient urban management [ Zahidi et al.(2024) ] . Resource usage, such as electricity and water [ Shahra et al.(2024) ] , will be optimized through advanced distribution systems, and AR/VR technologies will reshape how we interact with people and objects, necessitating rapid processing of large data streams [ Sukhmani et al.(2019) ] . All these applications share the need for near-real-time computations while processing large amounts of data, which the Cloud alone cannot provide due to transmission latency [ Hu et al.(2020) ] . The Computing Continuum (CC) is considered by the community as the emerging platform with the potential capabilities to bring the required performance to these new applications [ Beckman et al.(2020) , Dustdar et al.(2023) , Nardelli et al.(2024) ] . Integral to this continuum are its inherent heterogeneity and dynamism, fundamental aspects that must be addressed when developing effective management methods [ Casamayor Pujol et al.(2023) ] . These characteristics impact multiple facets of the system. For instance, heterogeneity is present in the types of computing and networking units, data modalities, system providers, and the variety of services within applications. Device heterogeneity, for example, hinders centralized auto-scalers because adaptations must be tailored to each device’s capacity and characteristics [ Zhang et al.(2019) ] . Similarly, managing multiple system providers requires agreements and methodologies that go beyond current Cloud solutions, which typically rely on a single provider handling the entire infrastructure [ Casamayor Pujol et al.(2024) ] . Dynamism, on the other hand, affects devices, networking capacities, user demands, and system costs [ Baek et al.(2020) ] . Devices may have fluctuating capacities, making fast re-deployment or computation offloading necessary [ Hu et al.(2023) ] . Furthermore, dynamic costs and the involvement of multiple stakeholders require transparent rules to ensure fair and efficient application deployment and execution. As a unified computing fabric that integrates all current computational tiers (i.e., IoT, Edge, Fog, and Cloud), the CC paradigm holds great potential to meet application requirements by harnessing the strengths of each tier [ Beckman et al.(2020) ] . The CC achieves this by placing the services’ elasticity strategies directly where they are most needed, i.e., where services execute. Elasticity strategies refer to the ability of software services to adjust their configuration in response to changing conditions to maintain performance [ Fürst et al.(2018) ] . In Cloud environments, a common elasticity strategy is scaling the number of service replicas. In the Computing Continuum, however, strategies like offloading services to other devices or adapting the quality of data for processing are more common and effective [ Manaouil and Lebre(2020) ] . Local adaptation of services becomes essential to ensure the necessary performance for these applications, given the inherent heterogeneity and dynamism of the CC. This shift presents an exciting opportunity to move beyond the current Cloud-inspired model, paving context sensitivity for more advanced adaptation techniques. Local adaptation implies that services must be able to monitor their status —what we refer to as Service Level Objectives in Device (SLOiD)— as well as their surrounding environment, which includes other related services, the hosting device, and even user behavior patterns. They need to analyze this information and then ask themselves: Is an elasticity strategy necessary to improve current SLOiD fulfillment? If so, which one? Based on this analysis, services must then adapt in real-time to meet current needs. This process requires services to continuously collect and interpret data to infer both the system’s and the environment’s state. These real-time decisions are crucial for maintaining performance but pose a complex planning challenge, as they must consider multiple factors and adjust actions on-the-fly. To address this challenge, we leverage Active Inference (AIF) [ Friston et al.(2016) ] , a probabilistic agent-based approach that enables processing services to continuously adapt to a dynamic environment. From a technical perspective, AIF is particularly apt for the multiple and federated constraint problem furnished by SLOiDs; AIF inherits from the free energy principle, under which self-organisation is specified in terms of minimising surprisal or self-information. In AIF, this surprise is specified in terms of the negative log probability of occupying a preferred or characteristic state. Crucially, this means the objective function in AIF are functionals of probability distributions over outcomes — as opposed to simple functions of outcomes per se, such as reward, utility or cost-to-go. This means that the specification of constraints is naturally accommodated in terms of a probability distribution over all states or outcomes a system can experience. Furthermore, because free energy is an extensive quantity, if all the agents in a distributed architecture minimise their (expected) free energy, then the joint free energy of the ensemble is also minimised. This licences local (planning as) inference. In what follows, we leverage these two fundaments of AIF in the context of CC. This article presents an AIF multi-agent system for managing a pipeline of distributed services. Each service agent is modeled as a partially observable Markov decision process (POMDP), which continuously evaluates its state and selects self-adaptive actions in real-time to optimize performance. To the best of our knowledge, this is the first attempt to use AIF and POMDPs in distributed processing pipelines of