CrossNews-UA : A Cross-lingual News Semantic Similarity Benchmark for Ukrainian, Polish, Russian, and English
2025
Read CrossNews-UA : A Cross-lingual News Semantic Similarity Benchmark for Ukrainian, Polish, Russian, and English (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-19628.txt.
Description
Daryna Dementieva, Evgeniya Sukhodolskaya, and Alexander Fraser present CrossNews-UA, a benchmark for judging whether news stories in unlike languages report the same events. Checking news across languages can help verify claims. But past datasets were hand-built by journalists and cannot grow. Their fix is a crowdsourcing pipeline built to scale and to show its reasons.
The dataset pairs Ukrainian stories with Polish, Russian, and English ones. Each pair is rated for how alike the two stories are, with reasons logged under who, what, where, and when. The team tests models from simple word counts up to large language models. The results show how hard cross-language news checks remain, above all beyond English.
Catalog record
| YEAR | 2025 |
|---|---|
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 34 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-19628