Benchmarking Vision Foundation Models for Input Monitoring in Autonomous Driving
Mert Keser, Halil Ibrahim Orhan, Niki Amini-Naieni, Gesina Schwalbe, Alois Knoll, Matthias Rottmann · 2025
Read Benchmarking Vision Foundation Models for Input Monitoring in Autonomous Driving by Mert Keser, Halil Ibrahim Orhan, Niki Amini-Naieni, Gesina Schwalbe, Alois Knoll, Matthias Rottmann (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-08083.txt.
Description
Six authors set out a 2025 test plan for guard systems that flag odd inputs in self-driving cars. A car can meet new objects or new light and weather that its network never saw in training. A good guard must catch both kinds of shift with no labeled odd cases.
Their plan pairs vision foundation models, which turn images into rich features, with methods that model how training features spread out. Low spread scores mark odd inputs. Tests of four feature models and five spread methods beat older binary tools and also flagged inputs that were likely to cause driving errors.
Catalog record
| CREATOR | Mert Keser, Halil Ibrahim Orhan, Niki Amini-Naieni, Gesina Schwalbe, Alois Knoll, Matthias Rottmann |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 102 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-08083