CrossNews-UA : A Cross-lingual News Semantic Similarity Benchmark for Ukrainian, Polish, Russian, and English

2025

Read CrossNews-UA : A Cross-lingual News Semantic Similarity Benchmark for Ukrainian, Polish, Russian, and English (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-19628.txt.

Description

Daryna Dementieva, Evgeniya Sukhodolskaya, and Alexander Fraser present CrossNews-UA, a benchmark for judging whether news stories in unlike languages report the same events. Checking news across languages can help verify claims. But past datasets were hand-built by journalists and cannot grow. Their fix is a crowdsourcing pipeline built to scale and to show its reasons.

The dataset pairs Ukrainian stories with Polish, Russian, and English ones. Each pair is rated for how alike the two stories are, with reasons logged under who, what, where, and when. The team tests models from simple word counts up to large language models. The results show how hard cross-language news checks remain, above all beyond English.

Catalog record

YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2510-19628

Browse the full library · About the Tower of Babel