Multi-Robot Coordination with Adversarial Perception

Rayan Bahrami, Hamidreza Jafarnejadsani · 2025

Read Multi-Robot Coordination with Adversarial Perception by Rayan Bahrami, Hamidreza Jafarnejadsani (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-09047.txt.

Introduction

Robot teams that must work while their sight is fooled are studied by Rayan Bahrami and Hamidreza Jafarnejadsani in a 2025 arXiv paper. Small flying robots often lean on learned sight tools to spot things and judge place. Attacks on those tools can fake what a robot sees or slow its view. Such faults matter where robot work guards safety.

The pair treat fake sight as stray, off-and-on bad data for place tasks. Their frame joins motion sensor data with sight data to hold place well despite the faults. It also scores how much harm a set attack rate does to the team. Tests on a real robot group back the frame.

Catalog record

CREATORRayan Bahrami, Hamidreza Jafarnejadsani
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE48 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-09047

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Multi-Robot Coordination with Adversarial Perception Rayan Bahrami, Hamidreza Jafarnejadsani Abstract This paper investigates the resilience of perception-based multi-robot coordination with wireless communication to online adversarial perception. A systematic study of this problem is essential for many safety-critical robotic applications that rely on the measurements from learned perception modules. We consider a (small) team of quadrotor robots that rely only on an Inertial Measurement Unit (IMU) and the visual data measurements obtained from a learned multi-task perception module (e.g., object detection) for downstream tasks, including relative localization and coordination. We focus on a class of adversarial perception attacks that cause misclassification, mislocalization, and latency. We propose that the effects of adversarial misclassification and mislocalization can be modeled as sporadic (intermittent) and spurious measurement data for the downstream tasks. To address this, we present a framework for resilience analysis of multi-robot coordination with adversarial measurements. The framework integrates data from Visual-Inertial Odometry (VIO) and the learned perception model for robust relative localization and state estimation in the presence of adversarially sporadic and spurious measurements. The framework allows for quantifying the degradation in system observability and stability in relation to the success rate of adversarial perception. Finally, experimental results on a multi-robot platform demonstrate the real-world applicability of our methodology for resource-constrained robotic platforms. This paper has been accepted for publication in the proceedings of the 2025 International Conference on Unmanned Aircraft Systems (ICUAS) Supplementary Material Video: https://vimeo.com/1073774001 Code: https://github.com/SASLabStevens/telloswarm I Introduction Learning-enabled visual perception is central to various robotic tasks, including learned visual odometry (VO) [ 1 , 2 ] , metric-semantic SLAM [ 3 ] , visual navigation [ 4 ] , object tracking and relative localization [ 5 , 6 , 7 , 8 ] , drone flocking [ 8 , 9 ] , and collaborative perception [ 10 ] . Most approaches assume the outputs of learned perception models are reliable measurements for these downstream tasks [ 6 , 8 , 9 , 11 ] . However, learned models can fail unpredictably, even under nominal (non-adversarial) conditions [ 3 ] . Moreover, learned perception models are vulnerable to adversarial attacks [ 12 ] where imperceptible noise in input data (e.g., camera images) can significantly compromise the perception model’s outputs in the forms of latency [ 13 ] , misclassification and mislocalization [ 14 , 15 , 16 , 17 ] that cause unavailability of, and dynamically infeasible or unsafe measurements . In mobile robot settings, recent studies have considered uncertainty quantification [ 7 , 18 ] , adversarial training [ 19 , 20 , 21 ] , multi-model consistency [ 22 ] , and measurement-robust control [ 23 , 24 ] to mitigate the effect of uncertainty and/or norm-bounded adversarial measurements. Yet, a system-theoretic understanding of the degree to which adversarial perception data degrades system observability and consequently affects the stability of networked multi-robot systems remains elusive. (a) Experimental setup (b) Multi-threaded comm. arch. Fig. 1: Experimental setup for perception-based multi-robot coordination subject to adversarial image attacks. (a) Two Tello-EDU quadrotors (robots) independently run the framework in Fig. 2 . Only Robot 2 is subject to adversarial perception. The jackal-UGV is the object of interest located at \boldsymbol{p}_{r}\!\in\!\real^{3} in an object-centric map. Each quadrotor uses a custom-trained YOLOv7 object detection model to detect the jackal-UGV and then calculates its relative position w.r.t the detected jackal-UGV as described in Sec. II-C . The quadrotors coordinate their estimated relative positions through the distributed control protocol ( 11 ) over a wireless communication network. (b) Multi-robot communication architecture for TelloSwarm+ . The network is built on the server-client model over Wi-Fi 802.11 using the UDP protocol for multi-threaded, low-latency communication. A motion capture system provides the ground-truth robots’ poses. Fig. 2: Overview of perception-based multi-robot coordination. Our approach models adversarial misclassification and mislocalization in the perception module as sporadic and spurious measurements in a state estimation pipeline. The contribution of this paper is highlighted in the gray box, which encompasses the perception module, shown in the green box, subject to adversarial image attacks. The perception module integrates (Visual-Inertial Odometry) VIO data and object detection data, subject to adversarial attacks, to provide state estimation for the ego-robot, along with capabilities for perception-based relative localization and object tracking. In this setup, the VIO pipeline provides rotation (roll, pitch, yaw) and velocity data in each robot’s local frame, and the perception data, subject to adversarial image attacks, provide complementary localization data, which allows for localization of all robots with respect to an object of interest in a global frame. The problem of interest is to evaluate the degree to which adversarial image attacks on the learned perception module cause performance degradation, locally, in robot localization, and globally, in multi-robot coordination. The blue box shows the consensus-based coordination algorithm and the adversary detection algorithm developed in our prior work [ 25 ] , [ 26 ] . These two modules enable resilient coordination in the presence of adversarial attacks on images or transmitted information over the communication network. Statement of Contribution . This paper extends the prior work [ 6 , 8 , 9 , 11 ] to the case of multi-robot coordination under adversarial image attacks that cause misclassification , mislocalization [ 15 , 14 , 27 ] , and latency [ 13 , 28 ] in the learned perception modules of robots. More specifically, we consider a network of robots that rely on an onboard sensor suite of IMU and RGB camera images for relative localization in an object-centric map and coordination with one another over a wireless communication network. Each camera frame is processed by a custom-trained object detection model, which, unlike [ 6 , 7 , 9 ] , is subject to adversarial perturbations, leading to unreliable 2D bounding boxes around object landmarks within the field of view (FoV). These adversarial 2D detections render adversarial measurements for the robot’s vision-based localization, positing observability challenges at the ego-robot level and stability challenges at the multi-robot coordination level. • We propose a framework, shown in Fig. 2 , for resilience analysis of multi-robot coordination under adversarial perception-based relative localization (Sec. II-A - II-C ). • We formulate adversarial misclassifications and mislocalizations as spurious measurements (e.g, false-positive detections) and sporadic measurements (intermittent measurements incurred by misclassification). This formulation enables us to quantify the degradation of system observability in relation to perception degradation (or adversarial attack success rate {\color[rgb]{1,0,0}\beta}_{k} in ( 5 )). • We propose a system-theoretic approach utilizing a variant Kalman filter [ 29 ] to integrate VIO and perception data, as well as to evaluate the effects of adversarial perception data on relative localization (Sec. II-C ), and state estimation (Sec. II-D ), which provide critical state information for multi-robot coordination (Sec. II-E ). • Comprehensive real-time experimental studies (16 experiments), conducted on a multi-robot platform with open-source code in Sec. III , demonstrate the capability of our approach for system-theoretic resilience analysis against adversarial perception data, and its potential to mitigate the adversarial effects on perception-based localization and coordination. To the best of our knowledge, this paper is the first to investigate the effects of adversarial perception on the observability and stability of multi-robot coordination systems with real-time experiments. II Methodology Notations

Read the complete text