Wikipedia-based Datasets in Russian Information Retrieval Benchmark RusBEIR

Grigory Kovalev, Mikhail Tikhomirov, Pavel Mamaev, Olga Babina, Natalia Loukachevitch · 2025

Read Wikipedia-based Datasets in Russian Information Retrieval Benchmark RusBEIR by Grigory Kovalev, Mikhail Tikhomirov, Pavel Mamaev, Olga Babina, Natalia Loukachevitch (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-05079.txt.

Description

Grigory Kovalev and co-authors add new Russian search test sets to the RusBEIR benchmark, built from the Did You Know part of Russian Wikipedia. The sets cover fact checks, search for use by chat models, and full-document search.

Facts and their linked articles are marked at sentence level with graded relevance, which gives a firm ground truth. The authors spell out how the sets were built so the resource can grow. Their tests compare a classic word-based search method with new neural designs, and place the sets in the wider RusBEIR suite.

Catalog record

CREATORGrigory Kovalev, Mikhail Tikhomirov, Pavel Mamaev, Olga Babina, Natalia Loukachevitch
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE43 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-05079

Browse the full library · About the Tower of Babel