DebiasRAG: A Tuning-Free Path to Fair Generation in Large Language Models through Retrieval-Augmented Generation
Rui Chu, Bingyin Zhao, Thanh Quoc Hung Le, Duy Cao Hoang, Huawei Lin, Ping Li, Weijie Zhao, Khoa D Doan, Yingjie Lao · 2026
Read DebiasRAG: A Tuning-Free Path to Fair Generation in Large Language Models through Retrieval-Augmented Generation by Rui Chu, Bingyin Zhao, Thanh Quoc Hung Le, Duy Cao Hoang, Huawei Lin, Ping Li, Weijie Zhao, Khoa D Doan, Yingjie Lao (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-16113.txt.
Introduction
Chu and eight colleagues propose DebiasRAG, a no-retraining way to make large language models generate more fairly. Fine-tuning and prompt tricks cost a lot to train, can dull model skills, and miss live fair contexts. DebiasRAG builds fair contexts matched to each query from self-found bias contexts, then reranks those pieces to guide outputs. It lifts fairness while keeping the model's representation skill, using retrieval rather than retraining.
Catalog record
| CREATOR | Rui Chu, Bingyin Zhao, Thanh Quoc Hung Le, Duy Cao Hoang, Huawei Lin, Ping Li, Weijie Zhao, Khoa D Doan, Yingjie Lao |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 46780 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.16113
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
DebiasRAG: A Tuning-Free Path to Fair Generation in Large Language Models through Retrieval-Augmented Generation Rui Chu, Bingyin Zhao, Thanh Quoc Hung Le, Duy Cao Hoang, Huawei Lin, Ping Li, Weijie Zhao, Khoa D Doan, Yingjie Lao Abstract . Large language models (LLMs) have achieved unprecedented success due to their exceptional generative capabilities. However, they also suffer from producing hallucinations and unexpected outputs (e.g., stereotypes and societal-biased content) . Prior studies employ LLM fine-tuning and prompt engineering to mitigate such biases in LLMs, which requires additional training or domain knowledge to design the framework. However, these approaches either demand extensive training resources or risk degrading the LLM’s original capabilities, while overlooking the need to provide dynamic debiasing contexts for fairer inferences. In this paper, we propose DebiasRAG, a novel LLM-tuning-free and dynamic query-specific debiasing framework based on retrieval augmented generation (RAG) that greatly improves the fairness while simultaneously preserving the intrinsic properties of LLMs. DebiasRAGconsists of three stages: (1) query-specific debias candidates production; (2) Context candidate pool forming; and (3) Gradient updated debiasing-guided context piece reranking. DebiasRAG firstly leverages the self-diagnosed bias contexts in relevant to the query through regular retrieval. Given the query-specific bias contexts , reverse produce debias contexts , which will be provided as an additional fairness constraint for LLM output. Secondly, a regular RAG retrieval process will produce the query-related contexts from the regular RAG document database. During the RAG reranking progress for final debiasing context selection, DebiasRAG re-rank the vectored pieces in the pool based on a gradient-optimized debiasing score as the most unbiased support for the user input query. Lastly, we propose two adaptive scenarios of using DebiasRAG, including a regular scenario (with additional RAG documents in the framework) and a non-RAG-document debiasing scenario, which can use DebiasRAGas a simple debiasing tool as a replacement for fine-tuning. We evaluate the performance of DebiasRAG comprehensively on multiple benchmarks, which demonstrates a highly competitive performance of bias mitigation compared to the state-of-the-art tuning-based methods. 1. Introduction Figure 1 . System workflow of DebiasRAG. The workflow consists of three main components. The first stage (Upper Block) involves document preparation and preprocessing, including management of the Avoid Document Repo, along with user-provided input documents (Optional). The second stage (Middle Block) performs reverse-generation of debiasing performance based on the user’s input to establish a baseline for effective real-time operation. For the third stage (Lower Block), real-time debias-guided reranking optimization, integrates embedding retrieval, gradient-based reranking, and generation, working dynamically to debias the reasoning and output process of large language models. Large language models (LLMs) are widely adopted to empower real-world applications such as content generation ( Khalifa et al. 2020 ; Lin et al. 2023 ; Chen et al. 2023 ; Puduppully et al. 2019 ) , question answering ( Zhuang et al. 2023 ; Li et al. 2024a ; Louis et al. 2024 ; Wang et al. 2024b ) and reasoning ( Wu et al. 2024 ) . Despite their success, LLMs show inferior performance on domain-specific and knowledge-intensive tasks ( Sordoni et al. 2024 ; Borzunov et al. 2024 ) . A phenomenal example is the hallucinations (e.g., stereotypes and biased information) generated by LLMs when dealing with queries that exceed encapsulated knowledge in the training corpora. Prior research ( Schick et al. 2021 ; Yang et al. 2023 ; Hua et al. 2023 ; Guo et al. 2022a ; Meade et al. 2021 ) , has revealed that biases are present and can arise at various stages of the nature language processing (NLP) development iterations. Such limitations raise critical concerns, particularly in areas where fairness and equality are highly demanded (e.g., healthcare and legal services) as biased outputs can lead to harmful or even catastrophic consequences ( Zhang et al. 2023 ; Nazi et al. 2023 ) . Thus, it is crucial to mitigate biases that inherently exist in LLMs. There have been lines of work that attempt to alleviate biases through various approaches. The mainstream mechanisms can be broadly categorized as fine-tuning ( Dettmers et al. 2024 ; Kaneko and Bollegala 2021 ) and prompt engineering ( Yang et al. 2023 ; Wang et al. 2024a ; Park et al. 2023 ) . Fine-tuning is a general method to improve LLMs’ performance on downstream tasks by retraining the model in an end-to-end manner on a relatively small dataset. In the context of debiasing, one may consider bias elimination as a unique instance of downstream tasks. Fine-tuning tends to achieve superior performance since all LLM layers are retrained to accommodate the downstream tasks ( Lee et al. 2009 ) . Yet, it still faces significant limitations, such as high demand for computing resources, the difficulty of data collection, and cumbersome hyperparameter optimization. Prompt engineering is an alternative solution that crafts and refines inputs (i.e., prompts) to direct LLMs to generate fair outputs without touching model parameters ( Isaev et al. 2023 ) . Deliberately designed prompts convey task-specific information that helps models better interpret the input queries and, hence, produce more accurate and reliable outputs. However, acquiring useful and effective prompts is challenging, and a common practice usually involves manual design that requires professional expertise and domain knowledge ( Ben-David et al. 2022 ; Li et al. 2024a ) . Another major issue of debiasing in LLMs is the trade-off between fairness and the model’s representation ability (e.g., accuracy and expressiveness) ( Tsimpoukelli et al. 2021 ) . Prior studies ( Yang et al. 2023 ; Hua et al. 2023 ) have shown that an inordinate emphasis on eliminating biases may ultimately undermine the intrinsic properties of LLMs that evolved from pre-training and generate fair yet meaningless outputs. In this paper, we propose DebiasRAG, which aims to address the aforementioned challenges by leveraging retrieval-augmented generation (RAG) to achieve lightweight debiasing comparable to fine-tuning, but without its computational or data overhead. Although prompt engineering can also achieve debiasing without parameter updates, it often degrades performance by altering user queries ( Guo et al. 2022b ) or yields limited effects due to its reliance on fixed contexts ( Schick et al. 2021 ) . In contrast, RAG provides dynamic, query-dependent contexts, but its potential to deliver adaptive debiasing signals—guiding the LLM toward fairer outputs—remains largely unexplored. Existing RAG-based debiasing methods primarily focus on retrieving the fairest possible context via embedding-level retrieval guidance ( Kim et al. 2025 ) or agent-based filtering ( Singh and Ngu 2025 ) . While effective in preventing the introduction of new bias, these approaches do not actively reduce existing bias in an otherwise clean LLM. We instead consider a practical zero-shot scenario in which the debiasing requester possesses only bias-inducing documents the model should learn to avoid, analogous to the fine-tuning setting. Unlike prior works that rely on unrelated or neutral corpora (e.g., Wikipedia ( Yang et al. 2015 ; Lewis et al. 2020 ) ) for context substitution or reranking, our approach requires no additional external documents. It is important to note that our goal is to use RAG to debias LLM output (just like a substitution of fine-tuning), which is qualitatively different from fairness enhancement within RAG as in prior works ( Kim et al. 2025 ) . The overview of the proposed