Wikipedia-based Datasets in Russian Information Retrieval Benchmark RusBEIR
Grigory Kovalev, Mikhail Tikhomirov, Pavel Mamaev, Olga Babina, Natalia Loukachevitch · 2025
Read Wikipedia-based Datasets in Russian Information Retrieval Benchmark RusBEIR by Grigory Kovalev, Mikhail Tikhomirov, Pavel Mamaev, Olga Babina, Natalia Loukachevitch (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-05079.txt.
Description
Grigory Kovalev and co-authors add new Russian search test sets to the RusBEIR benchmark, built from the Did You Know part of Russian Wikipedia. The sets cover fact checks, search for use by chat models, and full-document search.
Facts and their linked articles are marked at sentence level with graded relevance, which gives a firm ground truth. The authors spell out how the sets were built so the resource can grow. Their tests compare a classic word-based search method with new neural designs, and place the sets in the wider RusBEIR suite.
Catalog record
| CREATOR | Grigory Kovalev, Mikhail Tikhomirov, Pavel Mamaev, Olga Babina, Natalia Loukachevitch |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 43 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-05079