Combating Partial Perception Deficit in Autonomous Driving with Multimodal LLM Commonsense
Yuting Hu 1 {1} Chenhui Xu 1 {1} Ruiyang Qin 2 {2} Dancheng Liu 1 {1} Amir Nassereldine 1 {1} Yiyu Shi 2 {2} Jinjun Xiong 1 {1} · 2025
Read Combating Partial Perception Deficit in Autonomous Driving with Multimodal LLM Commonsense by Yuting Hu 1 {1} Chenhui Xu 1 {1} Ruiyang Qin 2 {2} Dancheng Liu 1 {1} Amir Nassereldine 1 {1} Yiyu Shi 2 {2} Jinjun Xiong 1 {1} (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-07020.txt.
Description
Yuting Hu and co-authors present a 2025 paper on self-driving cars that lose part of their view of the road. A blocked sensor can hide a key object and break the car's grasp of the scene. The usual response is to stop at once, which is safe but blunt, and a full stop is not always needed when the risk is minor.
Their system uses a large language model to add human-like road sense to the car's choices. Four parts work together: one infers hazards, one plans short moves, one checks each action, and one sets safety limits. A new data set of video clips with hidden key objects trains the model for such cases.
Catalog record
| CREATOR | Yuting Hu 1 {1} Chenhui Xu 1 {1} Ruiyang Qin 2 {2} Dancheng Liu 1 {1} Amir Nassereldine 1 {1} Yiyu Shi 2 {2} Jinjun Xiong 1 {1} |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 44 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-07020