Cost-Aware Distributed Online Learning with Strict Rejection Behavior against Adversarial Agents

Yuhan Suo, Runqi Chai, Senior Member, IEEE, Senchun Chai, Senior Member, IEEE · 2024

Read Cost-Aware Distributed Online Learning with Strict Rejection Behavior against Adversarial Agents by Yuhan Suo, Runqi Chai, Senior Member, IEEE, Senchun Chai, Senior Member, IEEE (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-01524.txt.

Introduction

Yuhan Suo and co-authors design cost-aware online learning for agent networks under attack. Connected device networks learn together, but hostile agents can poison the process. Blocking bad neighbors helps, yet it can desync honest agents nearby.

Their framework rejects suspect neighbor data with strict rules. It also counts the cost of repeated corrective adaptation. A two-time-scale regulator then steadies long-term learning rates. The outer layer adjusts pace so honest agents stay in step. The design targets persistent attacks during early learning stages. It keeps convergence while cutting wasted effort across the network. The work suits sensor and device fleets that must learn in hostile settings.

Catalog record

CREATORYuhan Suo, Runqi Chai, Senior Member, IEEE, Senchun Chai, Senior Member, IEEE
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE67 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-01524

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Cost-Aware Distributed Online Learning with Strict Rejection Behavior against Adversarial Agents Thanks: Yuhan Suo, Runqi Chai, Senchun Chai, and Yuanqing Xia are with the School of Automation, Beijing Institute of Technology, Beijing 100081, China (e-mail: [email protected]; [email protected]; [email protected]; [email protected]). Thanks: Yuhan Suo is also with Zhongguancun Academy, Beijing 100192, China. Thanks: Xudong Zhao is with the Key Laboratory of Intelligent Control and Optimization for Industrial Equipment of Ministry of Education of Dalian University of Technology, Dalian 116024, China (e-mail: [email protected]). Thanks: Corresponding author: Runqi Chai . Yuhan Suo, Runqi Chai, Senior Member, IEEE, Senchun Chai, Senior Member, IEEE Abstract Distributed online learning in Internet of Things(IoT)-enabled multi-agent systems(MASs) is highly vulnerable to persistent adversarial interactions, particularly when malicious agents cannot be fully isolated during the transient learning stage. Existing resilient learning methods mainly focus on convergence preservation or malicious suppression, while the resulting evolution inefficiency caused by repeated corrective adaptation remains largely unexplored. To address this issue, this paper develops a cost-aware distributed online learning framework with a strict rejection behavior against adversarial agents. The proposed mechanism suppresses harmful assimilation of suspicious neighboring information and reveals a previously overlooked side effect, that is, the strict rejection may induce heterogeneous transient evolution among neighboring normal agents, leading to evolution desynchronization across the network. To mitigate this effect, a two-time-scale adaptive evolution regulation architecture is further developed, in which the outer layer dynamically adjusts the long-term evolution-rate schedule while the inner layer preserves robust online learning. Theoretical analysis establishes the dynamic tracking property of the outer-layer update and proves that the proposed regulation mechanism attenuates the propagation of strict-rejection-induced evolution desynchronization. Numerical simulations and a satellite-assisted IoT monitoring scenario demonstrate that the proposed method achieves robust and low-cost distributed online learning under persistent malicious interference. I Introduction With the rapid advancement of the information era and the IoT, multi-agent systems have been increasingly deployed in various networked and security-sensitive applications, such as intelligent transportation systems [ 1 ] , sensor networks [ 2 ] , and IoT-enabled distributed decision-making scenarios [ 3 ] . In these systems, a group of autonomous agents interact and exchange information through local communication networks, enabling them to collaboratively accomplish global objectives that are difficult or inefficient for isolated agents to achieve. Traditional interactive algorithms usually assume that all participating agents are benign and cooperative, and under this assumption they can guarantee convergence to a unified state with favorable convergence speed and robustness properties in benign settings [ 4 ] . Representative examples include average consensus algorithms [ 5 , 6 ] , Laplacian-based protocols [ 7 ] , and robust fusion schemes designed to handle uncertainties such as noise and model perturbations [ 8 ] . These methods have laid an important foundation for distributed coordination and online adaptation. Nevertheless, their theoretical guarantees are typically established under idealized conditions in which the exchanged information is trustworthy or only affected by non-adversarial disturbances. In practical networked environments, especially those involving cyber-physical infrastructures or open communication platforms, such assumptions can be overly restrictive. Malicious agents may intentionally spread false information, manipulate local updates, or strategically reject the decisions of neighboring agents, thereby undermining both the correctness and the stability of the learning process [ 9 ] . From the perspective of information security, this means that the challenge is no longer limited to achieving consensus, but extends to maintaining reliable fusion and safe adaptation in the presence of adversarial behaviors. To address these threats, recent studies have investigated a variety of resilient or secure distributed learning mechanisms. Existing approaches include detecting and isolating malicious agents according to abnormal signals or suspicious state patterns [ 10 ] , assigning trust values or beliefs to modulate the influence of neighbors [ 11 , 12 , 13 ] , exploiting redundancy in network information [ 14 ] , using residual-based anomaly detection schemes [ 15 , 16 ] , and adopting moving target defense strategies to reduce attackers’ effectiveness [ 17 ] . These studies have significantly improved the resilience of multi-agent coordination against malicious interference. However, as suggested in [ 18 , 19 ] , the mitigation of adversarial influence in practical applications is rarely instantaneous; rather, it is typically a gradual process of attenuation and progressive isolation. This phenomenon generally arises for two reasons. First, to maximize the accuracy of identifying and eliminating malicious influence, the system often requires a certain period of information accumulation, behavioral observation, and cross-validation, so as to avoid misjudgment caused by insufficient evidence. For example, in distributed learning, multi-robot coordination, and sensor networks, a single abnormal state or a locally unusual residual is usually insufficient to justify the immediate isolation of an agent; instead, a reliable decision often requires integrating temporal data, neighborhood feedback, or evidence collected over multiple rounds of interaction. Second, due to the underlying task mechanism and operational constraints of the system itself, even when an agent is suspected of malicious behavior, its influence often cannot be completely removed at once. For example, in multi-robot formations, connected vehicle systems, and distributed satellite or UAV networks, a suspicious node may still be responsible for local sensing, communication relaying, or maintaining network topology. Abruptly disconnecting such a node may therefore disrupt task continuity, system observability, or network connectivity. As a result, in many real-world systems, the more practical strategy is not instantaneous isolation, but rather to progressively weaken the agent’s influence through trust degradation, interaction restriction, or conservative fusion until full isolation becomes feasible. This transitional phase is particularly important from a security perspective, because normal agents may continue reacting to manipulated information while the attack is being mitigated. As a result, the system may suffer not only from degraded fusion accuracy, but also from repeated state corrections, amplified adjustment effort, and additional evolution cost. Regrettably, the vast majority of existing research tends to implicitly overlook this phenomenon, and therefore pay limited attention to how a distributed system should regulate its learning behavior online, using only locally available information and without relying on complete isolation, so as to preserve robustness while reducing unnecessary security-induced adaptation costs. Compared with existing resilient distributed online learning methods that primarily focus on convergence or malicious suppression (e.g., [ 20 , 6 , 21 ] ), this paper investigates the transient evolution dynamics induced by adversarial interactions, particularly in scenarios where malicious agents cannot be fully isolated during the online adaptation process. Under persistent adversarial influence, normal agents may repeatedly assimilate suspicious neighboring information and subsequently perform corrective adaptation, thereby generating unnecessary transient evolution burden and long-term learning inefficiency. Existing trust-based interaction mechanisms (e.g., [ 13 ] ) mainly aim to suppress suspicious information at the fusion level. However, the resulting transient evolution mismatch caused by repeated interaction correction remains largely unexplored. In particular, strict rejection of suspicious information may locally accelerate the apparent evolution progress of directly affected agents, while simultaneously inducing heterogeneous transient evolution among neighboring normal agents. Such interaction-induced evolution mismatch may further propagate through neighboring adaptation and amplify the overall evolution burden of the distributed learning process. Although several studies investigate minimum-cost formulations in distributed optimization and learning (e.g., [ 22 , 23 , 24 ] ), their analysis is mainly restricted to benign

Read the complete text