FAIRT2V: Training-Free Debiasing for Text-to-Video Diffusion Models
Haonan Zhong, Wei Song †, Tingxu Han, Maurice Pagnucco, Jingling Xue, Yang Song · 2026
Read FAIRT2V: Training-Free Debiasing for Text-to-Video Diffusion Models by Haonan Zhong, Wei Song †, Tingxu Han, Maurice Pagnucco, Jingling Xue, Yang Song (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-20791.txt.
Introduction
Haonan Zhong and five co-authors tackle bias in AI video generation. Their 2026 paper presents FairT2V, a debiasing framework for text-to-video diffusion models. These models turn a written prompt into a short video. Their demographic biases, above all gender bias, remain largely unexplored. The team first analyzes where the bias comes from.
They show that it stems mainly from pretrained text encoders. Even neutral prompts pick up hidden gender associations inside the encoder. FairT2V then corrects that bias without any fine-tuning. The method is training-free, so it can wrap around existing models. The work gives video AI builders a way to cut bias at its source rather than patch outputs after the fact.
Catalog record
| CREATOR | Haonan Zhong, Wei Song †, Tingxu Han, Maurice Pagnucco, Jingling Xue, Yang Song |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 44 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-20791
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
FAIRT2V: Training-Free Debiasing for Text-to-Video Diffusion Models Haonan Zhong, Wei Song †, Tingxu Han, Maurice Pagnucco, Jingling Xue, Yang Song Abstract Text-to-video (T2V) diffusion models have achieved rapid progress, yet their demographic biases—particularly gender bias—remain largely unexplored. We present FairT2V , a training-free debiasing framework for text-to-video generation that mitigates encoder-induced bias without fine-tuning. We first analyze demographic bias in T2V models and show that it primarily originates from pretrained text encoders, which encode implicit gender associations even for neutral prompts. We quantify this effect with a gender-leaning score that correlates with bias in generated videos. Based on this insight, FairT2V mitigates demographic bias by neutralizing prompt embeddings via anchor-based spherical geodesic transformations while preserving semantics. To maintain temporal coherence, we apply debiasing only during early identity-forming steps through a dynamic denoising schedule. We further propose a video-level fairness evaluation protocol combining VideoLLM-based reasoning with human verification. Experiments on the modern T2V model Open-Sora show that FairT2V substantially reduces demographic bias across occupations with minimal impact on video quality. 1 Introduction Text-to-video (T2V) models have progressed rapidly in recent years, driven by advances in diffusion-based architectures ( 21 ; 24 ; 16 ; 34 ; 37 ) . These systems are increasingly deployed in applications such as advertising, education, and entertainment. However, recent studies ( 2 ; 17 ; 7 ; 19 ) show that modern generative models frequently over-represent gender, racial, or age groups. Such demographic biases raise significant ethical concerns, as they risk reinforcing harmful societal stereotypes and perpetuating representational inequities ( 3 ; 26 ) . Despite growing interest in fairness for generative models, demographic bias in text-to-video generation remains largely unexplored. Existing studies have focused primarily on text-to-image (T2I) generation, leaving open the question of how bias manifests and propagates in video generation, where temporal dynamics, identity persistence, and repeated text conditioning introduce new challenges. In this work, we focus on gender bias associated with occupation, as it is a well-documented and measurable form of demographic bias that enables controlled analysis in the text-to-video setting. Unlike images, gender-related bias in videos can be reinforced across frames, leading to temporally persistent stereotypes. Moreover, long-range temporal structure and multiple identities make frame-wise or image-level fairness interventions insufficient and inconsistent. In this paper, we present FairT2V , the first systematic study of demographic bias in text-to-video generation. We formalize implicit gender associations in neutral prompt embeddings via a gender-leaning score, enabling quantitative analysis of bias at the text-conditioning level. Using this formulation, we show that demographic bias in T2V models primarily originates from pretrained text encoders, which encode gender associations even without explicit demographic cues. This bias arises because encoders such as CLIP, trained on large-scale but socially imbalanced image–text data and widely used in modern T2V architectures, internalize skewed correlations that disproportionately align certain occupations with gender-associated directions in the prompt embedding space. Based on this insight, we introduce FairT2V , a training-free debiasing framework for text-to-video generation. FairT2V operates in an angular embedding space, where prompt embeddings and demographic attribute anchors lie on a shared hyperspherical manifold. By adaptively shifting each prompt embedding toward a neutral point based on its relative angular proximity to majority and minority anchors, FairT2V mitigates encoder-induced bias while preserving prompt semantics, without requiring any model fine-tuning. While this embedding-level debiasing is already effective, directly applying the debiased embeddings throughout the entire diffusion process can disrupt temporal coherence and introduce frame-level artifacts. To further improve video quality, FairT2V employs a dynamic denoising schedule that applies debiasing only during early identity-forming stages and restores the original prompt embedding during later refinement steps, preserving temporal consistency and visual smoothness ( 18 ) . Finally, we design a fairness evaluation protocol tailored to text-to-video generation. Existing image-based fairness assessments do not readily extend to videos, where multiple identities and dynamic temporal visibility complicate demographic attribution. To address this, we employ a VideoLLM (Gemini ( 5 ) ) to analyze full video sequences and infer demographic attributes by reasoning over identity continuity, temporal transitions, and multi-subject scenes. Since automated VideoLLM-based judgments may be affected by hallucination and prompt sensitivity, we further incorporate a human-in-the-loop verification stage to validate demographic labels and assess video quality. In summary, this paper makes the following contributions: • We propose FairT2V , a training-free debiasing framework for text-to-video generation that mitigates text-encoder–induced demographic bias while preserving prompt semantics and temporal coherence in videos. • We provide the first systematic analysis of demographic bias in text-to-video diffusion models, and identify the text-conditioning encoder as a primary source through which demographic bias is introduced and propagated. • We develop a video-oriented fairness evaluation protocol that combines LLM-as-a-Judge with human-in-the-loop verification, enabling reliable demographic bias assessment beyond frame-level analysis. • We conduct extensive experiments on state-of-the-art text-to-video model, demonstrating that FairT2V substantially reduces demographic bias while maintaining high video quality across multiple evaluation metrics. 2 Background and Related Work 2.1 Text-to-Video Diffusion Models Text-to-video (T2V) models such as CogVideoX and Open-Sora extend diffusion transformers to the video domain via MM-DiT architectures. Although effective in practice, MM-DiT–based models remain less well understood than U-Net–based diffusion models, and their spatiotemporal attention behavior under textual conditioning has received limited study. Despite architectural differences, T2V models follow a standard text-conditioned diffusion paradigm. Video generation starts from a noisy latent sequence and proceeds through iterative denoising, guided at each step by embeddings produced by pretrained text encoders such as CLIP, T5, or their combination. The text embedding acts as a persistent conditioning signal throughout the reverse diffusion process, shaping both global structure and identity-level semantics across frames. Formally, given a text embedding E_{p} for prompt p and an unconditional embedding E_{\varnothing} , classifier-free guidance (CFG) computes the guided noise estimate at step t as: \displaystyle\hat{\epsilon}_{\theta}(x_{t},t,E_{p}) \displaystyle=\epsilon_{\theta}(x_{t},t,E_{\varnothing}) (1) \displaystyle+\alpha\big(\epsilon_{\theta}(x_{t},t,E_{p})-\epsilon_{\theta}(x_{t},t,E_{\varnothing})\big) where \epsilon_{\theta} denotes the denoising network, x_{t} is the latent at step t , and \alpha is the guidance scale. The latent is updated as: x_{t+1}=\mathcal{D}\big(x_{t},t,\hat{\epsilon}_{\theta}(x_{t},t,E_{p})\big) (2) Under classifier-free guidance, each denoising step is a deterministic function of the text embedding E_{p} . Figure 1 : Bias source analysis in text-to-video generation. Neutral prompts are encoded by the text encoder (e.g., CLIP) into embeddings aligned with gender-associated directions, revealing implicit demographic bias in the text-conditioning space. 2.2 Demographic Bias in Generative Models Diffusion-based generative models are known to produce biased or stereotypical outputs even under neutral prompts ( 12 ) . Prior analyses of Stable Diffusion ( 25 ; 2 ; 17 ; 7 ) reveal systematic associations between occupations, visual attributes, and demographic groups, indicating that bias can arise implicitly from text conditioning alone. While most existing studies focus on text-to-image generation, emerging evidence suggests that such biases carry over to video generation. A recent study of Sora ( 19 ) , for example, reports pronounced gender associations in text-to-video outputs, where particular occupations are consistently linked to one gender despite neutral prompts. These observations motivate the need for a systematic investigation of demographic bias in text-to-video diffusion models. Figure 2 : Gender-leaning scores ( Equation 5 ) from the CLIP text encoder for 16 occupations, using the prompt sets in Equation 3 . Figure 3 : Gender proportions in generated videos for four occupations using neutral prompts (left) and explicit