Combating Partial Perception Deficit in Autonomous Driving with Multimodal LLM Commonsense

Yuting Hu 1 {1} Chenhui Xu 1 {1} Ruiyang Qin 2 {2} Dancheng Liu 1 {1} Amir Nassereldine 1 {1} Yiyu Shi 2 {2} Jinjun Xiong 1 {1} · 2025

Read Combating Partial Perception Deficit in Autonomous Driving with Multimodal LLM Commonsense by Yuting Hu 1 {1} Chenhui Xu 1 {1} Ruiyang Qin 2 {2} Dancheng Liu 1 {1} Amir Nassereldine 1 {1} Yiyu Shi 2 {2} Jinjun Xiong 1 {1} (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-07020.txt.

Description

Yuting Hu and co-authors present a 2025 paper on self-driving cars that lose part of their view of the road. A blocked sensor can hide a key object and break the car's grasp of the scene. The usual response is to stop at once, which is safe but blunt, and a full stop is not always needed when the risk is minor.

Their system uses a large language model to add human-like road sense to the car's choices. Four parts work together: one infers hazards, one plans short moves, one checks each action, and one sets safety limits. A new data set of video clips with hidden key objects trains the model for such cases.

Catalog record

CREATORYuting Hu 1 {1} Chenhui Xu 1 {1} Ruiyang Qin 2 {2} Dancheng Liu 1 {1} Amir Nassereldine 1 {1} Yiyu Shi 2 {2} Jinjun Xiong 1 {1}
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE44 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-07020

Browse the full library · About the Tower of Babel