ATOM-CBF: Adaptive Safe Perception-Based Control under Out-of-Distribution Measurements
Kai S. Yun, Navid Azizan · 2025
Read ATOM-CBF: Adaptive Safe Perception-Based Control under Out-of-Distribution Measurements by Kai S. Yun, Navid Azizan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-08741.txt.
Introduction
Kai Yun and Navid Azizan make learned perception safer for robots and vehicles that must act on what their sensors suggest. Perception networks fail quietly on inputs unlike their training data, and a controller that trusts them blindly can steer into danger.
Their framework, ATOM-CBF, builds a control barrier function that measures its own doubt. An adaptive margin grows when incoming measurements look out of distribution, with no need for ground-truth labels or advance knowledge of how the data shifted. A safety filter then uses that margin to tune its caution in real time, staying permissive when perception is trustworthy and conservative when it is not. Simulations with a small race car reading LiDAR and a quadruped reading camera images show safety maintained throughout.
Catalog record
| CREATOR | Kai S. Yun, Navid Azizan |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 48 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-08741
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
ATOM-CBF: Adaptive Safe Perception-Based Control under Out-of-Distribution Measurements Kai S. Yun, Navid Azizan Abstract Ensuring the safety of real-world systems is challenging, especially when they rely on learned perception modules to infer the system state from high-dimensional sensor data. These perception modules are vulnerable to epistemic uncertainty, often failing when encountering out-of-distribution (OoD) measurements not seen during training. To address this gap, we introduce ATOM-CBF (Adaptive-To-OoD-Measurement Control Barrier Function), a novel safe control framework that explicitly computes and adapts to the epistemic uncertainty from OoD measurements, without the need for ground-truth labels or information on distribution shifts. Our approach features two key components: (1) an OoD-aware adaptive perception error margin and (2) a safety filter that integrates this adaptive error margin, enabling the filter to adjust its conservatism in real-time. We provide empirical validation in simulations, demonstrating that ATOM-CBF maintains safety for an F1Tenth vehicle with LiDAR scans and a quadruped robot with RGB images. \coltauthor Massachusetts Institute of Technology, Cambridge, MA keywords Safe Control, Uncertainty-Aware Control, Perception-Based Control, Epistemic Uncertainty 1 Introduction The problem of uncertainty lies at the heart of ensuring safety for autonomous systems in complex, real-world environments. While a vast body of work provides safety guarantees for systems under uncertainties in their dynamics or parameters ( 39 ; 22 ; 41 ) , this line of work often builds on a fundamental reliance on state information. In practice, states are not given in real-world deployment. Instead, they must be inferred from high-dimensional sensor measurements, such as camera images or LiDAR point clouds, often using learned perception modules, e.g., deep neural network (DNN)-based. These modules introduce their own critical source of uncertainty. To date, much of the field has focused on addressing safe perception-based control under aleatoric uncertainty, e.g., stochastic noise inherent to sensors ( 9 ; 40 ) . However, learned perception modules remain vulnerable to epistemic uncertainty, i.e., the model’s own lack of knowledge, which arises when encountering novel, out-of-distribution (OoD) data not seen during training. While epistemic uncertainty can be reduced by training the model on more diverse data ( 34 ; 16 ) , this approach is inherently limited, as it is untenable to capture the full distribution of all real-world scenarios. Frameworks that provide safety guarantees under OoD measurements often require new ground-truth labels to adapt online ( 18 ) or offline statistical bounds on a distribution of data ( 24 ) . These approaches are not designed for a truly on-the-fly safe controller, which has no access to ground-truth labels of a new OoD measurement and information on the distribution shift itself. We address this gap by introducing ATOM-CBF ( A daptive- T o- O oD- M easurement C ontrol B arrier F unction), a novel safe control framework that explicitly computes and adapts to the epistemic uncertainty from OoD measurements. Figure 1: Problem setting (left) and ATOM-CBF (right). Offline, ID data is used to train a perception module and an epistemic uncertainty quantification (EUQ) module, and compute the base error ratio, \varphi_{\text{cal}} . Online, ATOM-CBF is deployed in OoD settings for F1Tenth and quadruped experiments. Contributions. In this work, we make the following contributions to provide empirical safety assurances for perception-based robotic control in the presence of OoD sensor measurements: • OoD-aware adaptive perception error margin. We introduce an effective calibration method to compute an adaptive error margin that dynamically scales with the epistemic uncertainty of a perception module (Fig. 1 , Offline). • ATOM-CBF. We propose the Adaptive-To-OoD-Measurement Control Barrier Function (ATOM-CBF), a safety filter that integrates our adaptive error margin to ensure safety when encountering OoD sensor measurements (Fig. 1 , Online). • Empirical Validation. We demonstrate the efficacy of ATOM-CBF and provide empirical safety assurances in high-fidelity simulations, including an F1Tenth vehicle with 2D LiDAR scans and a quadruped robot with RGB camera images (Fig. 1 , left panel). 2 Related Work We group prior work on perception-based safety into two strands: (1) guaranteed safety under in-distribution (ID) measurements, i.e., data from the same distribution as the perception module’s training set, and (2) OoD-aware safety. Safety guarantees for perception-based control (ID). One line of work stem from formal verification, attempting to verify the perception DNN directly ( 5 ; 36 ) , to be used with downstream safe controllers. However, these tools often struggle to scale to complex DNNs. Another approach verifies the closed-loop system by abstracting the perception module. 17 use “safe approximate abstractions,” though the link to the real perception module is only empirical. 12 provide statistical guarantees but assume linear dynamics. 11 present a certificate-based method that relies on an approximate sensor model, making it difficult to scale to high-dimensional sensor data, such as images. A third category integrates perception uncertainty directly into the closed loop to provide robustness. 13 provide a control-theoretic formal bound of the worst-case perception error for robust safety. This has been extended to consider aleatoric uncertainty by 40 using conformal prediction. 14 also use conformal prediction to provide robust bounding boxes around perceived obstacles, while other approaches numerically synthesize a safety function from perception data ( 35 ; 4 ) . A key limitation across these methods is their dependency on bounds derived from ID data, making them vulnerable to OoD measurements. OoD-aware safety for perception-based systems. A second body of work addresses OoD-aware safety. Some methods seek to return the system to an ID state after an OoD detection. 28 revert to safe prior behavior, and 27 use a recovery policy to return to the ID manifold. Other approaches aim to prevent the system from ever entering OoD states. 38 use anomaly detection to avoid OoD regions in a planner, while 6 , 29 , and 20 use barrier functions or reachability analysis to stay within ID regions. 7 , 15 , and 8 instead use a fallback controller when OoD is detected. However, these methods can fail if OoD entry and measurements are inevitable or the reaction is too late. Finally, some frameworks provide safety guarantees under OoD measurements, but rely on information that may not always be available. 18 require new ground-truth labels online, and 25 require a priori knowledge of the distribution shift bounds. Our work instead provides empirical safety assurances under OoD measurements without requiring new ground-truth labels or a priori distribution knowledge. We achieve this by introducing an OoD-aware adaptive perception error margin that scales in real-time with measured epistemic uncertainty, enabling our safety filter to dynamically adjust its conservatism. 3 Preliminaries † † Notation. \mathbb{R} is the set of real numbers, \mathbb{R}^{n} is a real vector, \mathcal{L} is a Lie derivative, \mathbb{L} is a Lipschitz constant, and \|x\|_{2} is the euclidean norm for a vector x . \kappa:\mathbb{R}\rightarrow\mathbb{R} denotes an extended class \mathcal{K}_{\infty} function, i.e., a stictly increasing function where \kappa(0)=0 , \lim_{v\rightarrow-\infty}\kappa(v)=-\infty , and \lim_{v\rightarrow\infty}\kappa(v)=\infty . In this section, we provide a concise review of the concepts used to formulate our problem. We first introduce the system model and the notion of safety. Next, we review safe control under learned perception modules using Measurement-Robust CBF (MR-CBF), which provides safety under static, bounded perception errors. Finally, we discuss methods for epistemic uncertainty quantification (EUQ) of DNNs. 3.1 System Model and Safety To