Formation-Aware Adaptive Conformalized Perception for Safe Leader–Follower Multi-Robot Systems
Richie R. Suganda, Bin Hu · 2026
Read Formation-Aware Adaptive Conformalized Perception for Safe Leader–Follower Multi-Robot Systems by Richie R. Suganda, Bin Hu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-08958.txt.
Introduction
Richie Suganda and Bin Hu make leader-follower robot formations safer with formation-aware uncertainty bounds. Onboard perception errors vary with the formation, and maneuvers couple with camera visibility limits. Their adaptive conformal method tightens bounds near field-of-view limits and relaxes them in safe regions, feeding a conformal control program that keeps the leader visible while tracking well in simulation.
Catalog record
| CREATOR | Richie R. Suganda, Bin Hu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 42007 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.08958
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Formation-Aware Adaptive Conformalized Perception for Safe Leader–Follower Multi-Robot Systems Richie R. Suganda, Bin Hu Abstract This paper considers the perception safety problem in distributed vision-based leader–follower formations, where each robot uses onboard perception to estimate relative states, track desired setpoints, and keep the leader within its camera field of view (FOV). Safety is challenging due to heteroscedastic perception errors and the coupling between formation maneuvers and visibility constraints. We propose a distributed, formation-aware adaptive conformal prediction method based on Risk-Aware Mondrian CP to produce formation-conditioned uncertainty quantiles. The resulting bounds tighten in high-risk configurations (near FOV limits) and relax in safer regions. We integrate these bounds into a Formation-Aware Conformal CBF-QP with a smooth margin to enforce visibility while maintaining feasibility and tracking performance. Gazebo simulations show improved formation success rates and tracking accuracy over non-adaptive (global) CP baselines that ignore formation-dependent visibility risk, while preserving finite-sample probabilistic safety guarantees. The experimental videos are available on the project website 1 1 1 Project Website: https://nail-uh.github.io/iros2026.github.io/ . I Introduction Distributed vision-based leader-follower systems are critical for executing complex, collaborative tasks such as cooperative exploration [ 3 ] and search and rescue [ 14 ] . In this architecture, multi-agent coordination is achieved by designating a leader agent, while followers rely entirely on onboard sensing to maintain desired relative formations [ 11 , 19 ] . A fundamental operational requirement in such vision-based schemes is ensuring that the leader consistently remains within the follower’s camera field-of-view (FOV), a constraint that becomes increasingly complex to enforce during dynamic, tightly coupled maneuvers. Ensuring operational safety within this framework is highly challenging due to the tight coupling between vehicle dynamics and camera FOV constraints, compounded by the presence of stochastic and heteroscedastic perception uncertainties. Visibility maintenance in leader-follower formations has been studied extensively [ 13 ] . Recent works [ 19 ] formulate these FOV constraints using Control Barrier Functions (CBFs) and utilize Deep Neural Networks (DNNs) for state estimation. However, nominal CBF formulations fundamentally assume exact state feedback and fail to account for the inherent uncertainties of the perception system. Simply enforcing safety constraints using an estimated state is insufficient; a moderate estimation error near the safe-set boundary can lead to a false certification of safety, where the estimated state appears safe while the true physical state violates the visibility constraints. Existing approaches to address perception uncertainty in CBFs typically rely on robust or stochastic formulations. Robust CBFs [ 6 , 5 , 21 ] utilize worst-case error bounds, yielding highly conservative behavior, whereas stochastic CBFs [ 4 , 16 ] require prior knowledge of accurate error distributions, which is rarely available for complex vision models. Fig. 1: Formation-Aware Adaptive Conformalized Leader–Follower System. Under heteroscedastic, formation-dependent perception errors, the proposed risk-aware conformal bounds tighten in low-risk configurations to preserve tracking performance and expand near FOV limits to enforce probabilistic safety. Conformal Prediction (CP) has recently been integrated into safety-critical robotics as a distribution-free mechanism for translating data-driven estimation uncertainty into statistically valid safety constraints. In perception-based control, Yang et al. [ 22 ] incorporate conformal prediction sets derived from stochastic sensor measurements into a CBF framework to obtain probabilistic safety guarantees without assuming explicit noise distributions. Zhang et al. [ 23 ] embed CP-derived bounds from learned state estimators into a risk-aware CBF formulation, establishing finite-sample safety guarantees for stochastic systems. Tayal et al. [ 20 ] further develop CP-NCBF to statistically certify neural control barrier functions. Beyond CBF-based control, CP has been applied to safe motion planning [ 9 ] , safety-aware POMDP planning [ 18 ] , adversarially robust interaction [ 12 ] , and uncertainty-aware model predictive control [ 24 ] . These works collectively demonstrate that CP enables rigorous safety certification for learning-enabled robotic systems under uncertainties. Despite these advances, standard CP assumes exchangeability over the entire state space, resulting in a single global error bound. While methods such as Conformalized Quantile Regression (CQR) [ 15 ] can address varying uncertainty, they typically require retraining the base architecture as a specific quantile regressor and do not explicitly account for spatial safety constraints. In vision-based leader-follower systems, perception errors are inherently spatial and highly heteroscedastic: uncertainty increases significantly near FOV boundaries and decreases near the image center. A global conformal bound therefore enforces worst-case conservatism everywhere, unnecessarily shrinking the feasible control set even in low-risk configurations. To bridge the gap between rigorous safety guarantees and operational mobility, we propose a distributed, formation-aware adaptive framework that operates exclusively on local relative states. We leverage Mondrian Conformal Prediction [ 2 ] , which partitions calibration data to produce category-conditional prediction intervals. By formulating a Risk-Aware Mondrian CP, our approach computes state- and formation-conditioned uncertainty quantiles. This systematically reduces conservatism by assigning stricter statistical bounds in high-risk configurations (near FOV limits) and relaxing them in low-risk regions. We seamlessly integrate these dynamic bounds into a Formation-Aware Conformal CBF-QP utilizing a continuous margin transition, explicitly enforcing FOV limits while preserving control feasibility. The specific contributions of this paper are threefold: 1. Adaptive Uncertainty Quantification : We introduce a Risk-Aware Mondrian CP framework explicitly conditioned on the robot’s formation state, overcoming the overly conservative, formation-agnostic bounds of standard global CP. 2. Conformal CBF-QP Integration : We develop a Formation-Aware Conformal CBF-QP that integrates these heteroscedastic CP bounds using a smooth margin, ensuring strict FOV constraint satisfaction while maintaining optimization feasibility. 3. Empirical Validation : We validate the proposed architecture through extensive Gazebo simulations, demonstrating superior formation success rates and tracking performance compared to global CP baselines while preserving rigorous probabilistic safety guarantees. II Preliminaries Notation. Let \mathbb{R} and \mathbb{R}_{+} denote the sets of real and nonnegative real numbers. For x\in\mathbb{R}^{n} , \|x\| is the Euclidean norm. The probability of an event \mathcal{E} is denoted by \mathbb{P}(\mathcal{E}) . For a continuously differentiable h:\mathbb{R}^{n}\!\to\!\mathbb{R} and locally Lipschitz vector field f , the Lie derivative is \mathcal{L}_{f}h(x)\triangleq\nabla h(x)^{\top}f(x) . A continuous function \alpha:(-b,a)\to\mathbb{R} with a,b\in\mathbb{R}_{+} is an extended class- \mathcal{K} function ( \alpha\in\mathcal{K}_{e} ) if it is strictly increasing and \alpha(0)=0 . II-A Control Barrier Functions Consider the control-affine system \dot{x}=f(x)+g(x)u, (1) where x\in\mathcal{X}\subseteq\mathbb{R}^{n} , u\in\mathcal{U}\subseteq\mathbb{R}^{m} , and f and g are locally Lipschitz. Safety is encoded by the safe set \mathcal{C}\triangleq\{x\in\mathbb{R}^{n}:h(x)\geq 0\}, (2) where h is continuously differentiable. Definition 1 (Control Barrier Function (CBF) [ 1 ] ) . The function h is a CBF for ( 1 ) on \mathcal{C} if there exists \alpha\in\mathcal{K}^{e} such that for all x\in\mathcal{C} , \sup_{u\in\mathcal{U}}\big(\mathcal{L}_{f}h(x)+\mathcal{L}_{g}h(x)u+\alpha(h(x))\big)\geq 0. The safety set \mathcal{C} is forward invariant with respect to the system defined in ( 1 ). II-B Split Conformal Prediction Conformal prediction provides distribution-free finite-sample uncertainty sets under exchangeability [ 17 ] . Given a dataset \mathcal{D}=\{(y^{i},x^{i})\}_{i=1}^{n} , where y^{i}\in\mathcal{Y} denotes the observed input (e.g., feature or measurement) and x^{i}\in\mathcal{X} is the corresponding unknown target (e.g., label or state). Split conformal prediction framework randomly partitioned the dataset \mathcal{D} into a training set \mathcal{D}_{\mathrm{train}} and a calibration set \mathcal{D}_{\mathrm{cal}} of size n_{\mathrm{cal}} . Let \pi_{\theta}:\mathcal{Y}\to\mathcal{X} denote a predictor with parameters \theta trained on \mathcal{D}_{\mathrm{train}} . For each data point (y^{i},x^{i})\in\mathcal{D}_{\mathrm{cal}} , let R_{i}\triangleq S\!\left(x^{i},\pi_{\theta}(y^{i})\right)\in\mathbb{R} denote a nonconformity score where S is a chosen function that measures the prediction error (e.g. S(x,\hat{x})=\|x-\hat{x}\| ). Given a target