LongEval at CLEF 2025: Longitudinal Evaluation of IR Systems on Web and Scientific Data Authors ordered alphabetically Institute of Engineering Univ. Grenoble Alpes.

Matteo Cancellieri, Alaa El-Ebshihy, Tobias Fink, Maik Fröbe, Petra Galuščáková, Gabriela Gonzalez-Saez, Lorraine Goeuriot, David Iommi, Jüri Keller, Petr Knoth, Philippe Mulhem, Florina Piroi, David Pride, Philipp Schaer · 2025

Read LongEval at CLEF 2025: Longitudinal Evaluation of IR Systems on Web and Scientific Data Authors ordered alphabetically Institute of Engineering Univ. Grenoble Alpes. by Matteo Cancellieri, Alaa El-Ebshihy, Tobias Fink, Maik Fröbe, Petra Galuščáková, Gabriela Gonzalez-Saez, Lorraine Goeuriot, David Iommi, Jüri Keller, Petr Knoth, Philippe Mulhem, Florina Piroi, David Pride, Philipp Schaer (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-17469.txt.

Description

Matteo Cancellieri leads a team of thirteen co-authors on a 2025 arXiv overview of the LongEval lab at CLEF 2025. The lab tests search systems over time, with documents, queries, and relevance judgments all changing. That temporal view matters, since a search engine that shines today may fade as its corpus drifts.

This third edition ran two tasks: ad hoc web retrieval and scientific article retrieval. Each came with a data set that captures an evolving search scenario. Nineteen teams submitted systems, which the organizers scored with nDCG and a set of measures for how effectiveness shifts over time. The overview lays out the tasks, the data, and the entries. It serves as the reference record for the edition, and as a guide for teams that want to build search tools that age well.

Catalog record

CREATORMatteo Cancellieri, Alaa El-Ebshihy, Tobias Fink, Maik Fröbe, Petra Galuščáková, Gabriela Gonzalez-Saez, Lorraine Goeuriot, David Iommi, Jüri Keller, Petr Knoth, Philippe Mulhem, Florina Piroi, David Pride, Philipp Schaer
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE53 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-17469

Browse the full library · About the Tower of Babel