Benchmarking Vision Foundation Models for Input Monitoring in Autonomous Driving

Mert Keser, Halil Ibrahim Orhan, Niki Amini-Naieni, Gesina Schwalbe, Alois Knoll, Matthias Rottmann · 2025

Read Benchmarking Vision Foundation Models for Input Monitoring in Autonomous Driving by Mert Keser, Halil Ibrahim Orhan, Niki Amini-Naieni, Gesina Schwalbe, Alois Knoll, Matthias Rottmann (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-08083.txt.

Description

Six authors set out a 2025 test plan for guard systems that flag odd inputs in self-driving cars. A car can meet new objects or new light and weather that its network never saw in training. A good guard must catch both kinds of shift with no labeled odd cases.

Their plan pairs vision foundation models, which turn images into rich features, with methods that model how training features spread out. Low spread scores mark odd inputs. Tests of four feature models and five spread methods beat older binary tools and also flagged inputs that were likely to cause driving errors.

Catalog record

CREATORMert Keser, Halil Ibrahim Orhan, Niki Amini-Naieni, Gesina Schwalbe, Alois Knoll, Matthias Rottmann
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE102 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-08083

Browse the full library · About the Tower of Babel