Towards Fair Rankings: Leveraging LLMs for Gender Bias Detection and Measurement Conference: Proceedings of the 2025 International ACM SIGIR Conference on Innovative Concepts and Theories in Information Retrieval (ICTIR); July 18, 2025; Padua, Italy Proceedings of the 2025 International ACM SIGIR Co

Maryam Mousavian, Zahra Abbasiantaeb, Mohammad Aliannejadi, Fabio Crestani · 2025

Read Towards Fair Rankings: Leveraging LLMs for Gender Bias Detection and Measurement Conference: Proceedings of the 2025 International ACM SIGIR Conference on Innovative Concepts and Theories in Information Retrieval (ICTIR); July 18, 2025; Padua, Italy Proceedings of the 2025 International ACM SIGIR Co by Maryam Mousavian, Zahra Abbasiantaeb, Mohammad Aliannejadi, Fabio Crestani (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-22372.txt.

Description

Maryam Mousavian, Zahra Abbasiantaeb, Mohammad Aliannejadi, and Fabio Crestani tackle gender bias in ranked search results. Their 2025 paper uses large language models to spot and score bias in lists of text passages. Older scores rest on word counts and can miss subtle slanted wording.

The team adds a new score that weighs bias by rank class, so top slots count for more. To test it, they marked up part of a well-known passage set and shared the marks as a new open resource. Tests on several ranking models show the new score tracks human marks more closely than past scores. It also splits biased from fair lists with more care.

Catalog record

CREATORMaryam Mousavian, Zahra Abbasiantaeb, Mohammad Aliannejadi, Fabio Crestani
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE46 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-22372

Browse the full library · About the Tower of Babel