MINER: Mining Multimodal Internal Representation for Efficient Retrieval

Weien Li, Rui Song, Zeyu Li, Haochen Liu, Gonghao Zhang, Difan Jiao, Zhenwei Tang, Bowei He, Haolun Wu, Xue Liu, Ye Yuan · 2026

Read MINER: Mining Multimodal Internal Representation for Efficient Retrieval by Weien Li, Rui Song, Zeyu Li, Haochen Liu, Gonghao Zhang, Difan Jiao, Zhenwei Tang, Bowei He, Haolun Wu, Xue Liu, Ye Yuan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-06460.txt.

Description

Weien Li and ten co-authors propose MINER, a plug-in that makes single-vector document retrieval stronger without giving up its efficiency. Visual document search needs compact indexes. Late-interaction retrievers match pages in fine detail but store hundreds of vectors per page, while single-vector methods are cheap yet compress everything into one final-layer embedding and lag in quality.

A layerwise diagnostic shows useful signal lives in internal transformer layers, not just the last one. MINER probes each layer, masks weak neurons adaptively, and fuses the surviving signals into one embedding. Across the ViDoRe benchmarks it beats comparable dense retrievers and sometimes nearly matches late-interaction quality.

Catalog record

CREATORWeien Li, Rui Song, Zeyu Li, Haochen Liu, Gonghao Zhang, Difan Jiao, Zhenwei Tang, Bowei He, Haolun Wu, Xue Liu, Ye Yuan
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE55 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.06460

Browse the full library · About the Tower of Babel