Steering and Rectifying Latent Representation Manifolds in Frozen Multi-modal LLMs for Video Anomaly Detection

Zhaolin Cai, Fan Li, Huiyu Duan, Lijun He, Guangtao Zhai · 2026

Read Steering and Rectifying Latent Representation Manifolds in Frozen Multi-modal LLMs for Video Anomaly Detection by Zhaolin Cai, Fan Li, Huiyu Duan, Lijun He, Guangtao Zhai (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-24021.txt.

Description

Zhaolin Cai and four co-authors present SteerVAD, an intervention framework that steers frozen multimodal language models for video anomaly detection. The 2026 paper notes that tuning-free use of such models inherits pretraining biases and cannot reshape their internal representations for specific video contexts, so subtle or ambiguous anomalies are missed.

SteerVAD shifts from passively reading model outputs to actively steering representations. A gradient-free separability analysis first identifies the attention heads most discriminative for anomaly detection, called latent anomaly experts. A hierarchical meta-controller then generates dynamic rectification signals from global context and those expert outputs, applying targeted scaling to the expert representation manifolds to amplify anomaly-relevant dimensions and suppress biases. Tests on mainstream benchmarks reach leading performance among tuning-free methods, showing that internal steering can adapt frozen models to anomaly detection.

Catalog record

CREATORZhaolin Cai, Fan Li, Huiyu Duan, Lijun He, Guangtao Zhai
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE104 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-24021

Browse the full library · About the Tower of Babel