Measuring Individual User Fairness with User Similarity and Effectiveness Disparity

Theresia Veronika Rampisela, Maria Maistro, Tuukka Ruotsalo, Christina Lioma · 2026

Read Measuring Individual User Fairness with User Similarity and Effectiveness Disparity by Theresia Veronika Rampisela, Maria Maistro, Tuukka Ruotsalo, Christina Lioma (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-02516.txt.

Description

Theresia Veronika Rampisela and 3 co-authors argue that fairness tests for recommender systems ignore half the definition, in a 2026 arXiv paper. Fairness for one user means treating like users alike. Current tests check either the gap in recommendation quality while ignoring similarity, or the gap in items shown to similar users while ignoring relevance.

Their yardstick, pairwise user unfairness, is the first to capture both factors at once. It weighs the effectiveness gap by how alike the two users truly are. Tests span four data sets and seven ranking methods. The new yardstick moved as it should when either similarity or effectiveness varied. Rival tests were almost numb to effectiveness gaps or wholly blind to user similarity. The authors release their code for all to use. The result is a yardstick that finally fits the fairness notion its users actually quote.

Catalog record

CREATORTheresia Veronika Rampisela, Maria Maistro, Tuukka Ruotsalo, Christina Lioma
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE39 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-02516

Browse the full library · About the Tower of Babel