MINER: Mining Multimodal Internal Representation for Efficient Retrieval
Weien Li, Rui Song, Zeyu Li, Haochen Liu, Gonghao Zhang, Difan Jiao, Zhenwei Tang, Bowei He, Haolun Wu, Xue Liu, Ye Yuan · 2026
Read MINER: Mining Multimodal Internal Representation for Efficient Retrieval by Weien Li, Rui Song, Zeyu Li, Haochen Liu, Gonghao Zhang, Difan Jiao, Zhenwei Tang, Bowei He, Haolun Wu, Xue Liu, Ye Yuan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-06460.txt.
Description
Weien Li and ten co-authors propose MINER, a plug-in that makes single-vector document retrieval stronger without giving up its efficiency. Visual document search needs compact indexes. Late-interaction retrievers match pages in fine detail but store hundreds of vectors per page, while single-vector methods are cheap yet compress everything into one final-layer embedding and lag in quality.
A layerwise diagnostic shows useful signal lives in internal transformer layers, not just the last one. MINER probes each layer, masks weak neurons adaptively, and fuses the surviving signals into one embedding. Across the ViDoRe benchmarks it beats comparable dense retrievers and sometimes nearly matches late-interaction quality.
Catalog record
| CREATOR | Weien Li, Rui Song, Zeyu Li, Haochen Liu, Gonghao Zhang, Difan Jiao, Zhenwei Tang, Bowei He, Haolun Wu, Xue Liu, Ye Yuan |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 55 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.06460