No LLM is Free From Bias: A Comprehensive Study of Bias Evaluation in Large Language Models

Charaka Vinayak Kumar Ashok Urlana Gopichand Kanumolu, Bala Mallikarjunarao Garlapati Pruthwik Mishra, IIIT Hyderabad TCS Research, Hyderabad, India SVNIT Surat, India · 2025

Read No LLM is Free From Bias: A Comprehensive Study of Bias Evaluation in Large Language Models by Charaka Vinayak Kumar Ashok Urlana Gopichand Kanumolu, Bala Mallikarjunarao Garlapati Pruthwik Mishra, IIIT Hyderabad TCS Research, Hyderabad, India SVNIT Surat, India (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-11985.txt.

Description

Charaka Vinayak Kumar and four co-authors run a comprehensive study of bias evaluation in large language models, under the head title No LLM is Free From Bias. Models now lead on many language tasks, yet they mirror biases present in training data. A unified check across bias types and model sizes was missing.

Representative small and medium models face benchmarks spanning physical traits to socio economic categories. Five prompting approaches carry out the detection task, and three research questions organize the comparison of approaches and metrics. Every selected model shows some form of bias. The Phi-3.5B model comes out least biased. Key challenges and future directions for bias work close the study.

Catalog record

CREATORCharaka Vinayak Kumar Ashok Urlana Gopichand Kanumolu, Bala Mallikarjunarao Garlapati Pruthwik Mishra, IIIT Hyderabad TCS Research, Hyderabad, India SVNIT Surat, India
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE54 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-11985

Browse the full library · About the Tower of Babel