NeuCLIRTech: Chinese Monolingual and Cross-Language Information Retrieval Evaluation in a Challenging Domain

Dawn Lawrie, James Mayfield, Eugene Yang, Andrew Yates, Sean MacAvaney, Ronak Pradeep, Scott Miller, Paul McNamee, Luca Soldaini · 2026

Read NeuCLIRTech: Chinese Monolingual and Cross-Language Information Retrieval Evaluation in a Challenging Domain by Dawn Lawrie, James Mayfield, Eugene Yang, Andrew Yates, Sean MacAvaney, Ronak Pradeep, Scott Miller, Paul McNamee, Luca Soldaini (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-05334.txt.

Description

Finding the right documents across languages needs test sets that can separate good systems from bad ones. Dawn Lawrie and 8 co-authors present NeuCLIRTech in this 2026 information search paper, a testing set for technical material. The documents were first written in Chinese, then machine rendered into English, giving a controlled matched corpus in a demanding domain.

The set holds 110 queries with fit judgments, nearly 36,000 judged documents in all. It covers two cases: single-language search in Chinese, and cross-language search where the query is English and the documents are Chinese. It merges topics from the 2023 and 2024 TREC NeuCLIR tracks, which gives it strong power to separate rival approaches. A fusion baseline built from strong neural search tools is included, so builders of reranking methods need not start from the weak BM25 baseline. The dataset and artifacts are released on Hugging Face.

Catalog record

CREATORDawn Lawrie, James Mayfield, Eugene Yang, Andrew Yates, Sean MacAvaney, Ronak Pradeep, Scott Miller, Paul McNamee, Luca Soldaini
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE39 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-05334

Browse the full library · About the Tower of Babel