ReLope: KL-Regularized LoRA Probes for Multimodal LLM Routing
Yaopei Zeng, Congchao Wang, Blake JianHang Chen, Lu Lin · 2026
Read ReLope: KL-Regularized LoRA Probes for Multimodal LLM Routing by Yaopei Zeng, Congchao Wang, Blake JianHang Chen, Lu Lin (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-24787.txt.
Description
Zeng and co-authors present ReLope, a routing module that decides when a multimodal language model query should escalate to a stronger model. Hidden-state probes predict the small model's correctness in text settings, but images make correctness harder to predict. Their attention probe pools frozen token states with a learned query and improves the signal. Pooling still reuses states built for answering, not for judging trust. ReLope instead adapts one layer of the model itself with LoRA, regularised toward the original, and trains it for the routing decision.
Catalog record
| CREATOR | Yaopei Zeng, Congchao Wang, Blake JianHang Chen, Lu Lin |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 34476 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.24787