Evaluating Large Language Models for Cross-Lingual Retrieval

Longfei Zuo, Pingjun Hong, Oliver Kraus, Barbara Plank, Robert Litschko · 2025

Read Evaluating Large Language Models for Cross-Lingual Retrieval by Longfei Zuo, Pingjun Hong, Oliver Kraus, Barbara Plank, Robert Litschko (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-14749.txt.

Description

Longfei Zuo and four co-authors evaluate large language models for cross lingual retrieval in 2025, where a query in one language must find passages in another. Multi stage search is standard, with a cheap first stage and a smart reranking stage. Language model rerankers are well studied only for single language search.

Prior cross lingual evaluations paired lexical first stages with machine translation, an expensive setup prone to error propagation. Their large comparison covers passage and document level retrieval with multilingual bi encoders as first stages instead. Further gains appear under that cheaper design, the results show. Search across languages serves most of the world population, so reranker evidence beyond English is overdue.

Catalog record

CREATORLongfei Zuo, Pingjun Hong, Oliver Kraus, Barbara Plank, Robert Litschko
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE45 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-14749

Browse the full library · About the Tower of Babel