No LLM is Free From Bias: A Comprehensive Study of Bias Evaluation in Large Language Models
Charaka Vinayak Kumar Ashok Urlana Gopichand Kanumolu, Bala Mallikarjunarao Garlapati Pruthwik Mishra, IIIT Hyderabad TCS Research, Hyderabad, India SVNIT Surat, India · 2025
Read No LLM is Free From Bias: A Comprehensive Study of Bias Evaluation in Large Language Models by Charaka Vinayak Kumar Ashok Urlana Gopichand Kanumolu, Bala Mallikarjunarao Garlapati Pruthwik Mishra, IIIT Hyderabad TCS Research, Hyderabad, India SVNIT Surat, India (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-11985.txt.
Description
Charaka Vinayak Kumar and four co-authors run a comprehensive study of bias evaluation in large language models, under the head title No LLM is Free From Bias. Models now lead on many language tasks, yet they mirror biases present in training data. A unified check across bias types and model sizes was missing.
Representative small and medium models face benchmarks spanning physical traits to socio economic categories. Five prompting approaches carry out the detection task, and three research questions organize the comparison of approaches and metrics. Every selected model shows some form of bias. The Phi-3.5B model comes out least biased. Key challenges and future directions for bias work close the study.
Catalog record
| CREATOR | Charaka Vinayak Kumar Ashok Urlana Gopichand Kanumolu, Bala Mallikarjunarao Garlapati Pruthwik Mishra, IIIT Hyderabad TCS Research, Hyderabad, India SVNIT Surat, India |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 54 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-11985