Nemotron ColEmbed V2: Top-Performing Late Interaction embedding models for Visual Document Retrieval

Gabriel de Souza P. Moreira, Ronay Ak, Mengyao Xu, Oliver Holworthy, Benedikt Schifferer, Zhiding Yu, Yauhen Babakhin, Radek Osmulski, Jiarui Cai, Ryan Chesler, Bo Liu, Even Oldridge · 2026

Read Nemotron ColEmbed V2: Top-Performing Late Interaction embedding models for Visual Document Retrieval by Gabriel de Souza P. Moreira, Ronay Ak, Mengyao Xu, Oliver Holworthy, Benedikt Schifferer, Zhiding Yu, Yauhen Babakhin, Radek Osmulski, Jiarui Cai, Ryan Chesler, Bo Liu, Even Oldridge (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-03992.txt.

Description

Searching inside scanned documents takes more than text search. Gabriel de Souza P. Moreira and colleagues present Nemotron ColEmbed V2, a family of embedding models for visual document retrieval, in a 2026 paper. The models embed page images directly, skipping error-prone text extraction.

Three sizes, built on different pretrained vision-language backbones, were released. A late-interaction design compares query and page at fine granularity rather than through one summary vector. The largest variant ranked first on the ViDoRe benchmark suite at release. For companies feeding document catalogs into retrieval-augmented generation, such models promise retrieval that sees layout, tables, and figures, not just words.

Catalog record

CREATORGabriel de Souza P. Moreira, Ronay Ak, Mengyao Xu, Oliver Holworthy, Benedikt Schifferer, Zhiding Yu, Yauhen Babakhin, Radek Osmulski, Jiarui Cai, Ryan Chesler, Bo Liu, Even Oldridge
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE39 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-03992

Browse the full library · About the Tower of Babel