Investigating Associational Biases in Inter-Model Communication of Large Generative Models
Fethiye Irmak Dogan, Yuval Weiss, Kajal Patel, Jiaee Cheong, Hatice Gunes · 2026
Read Investigating Associational Biases in Inter-Model Communication of Large Generative Models by Fethiye Irmak Dogan, Yuval Weiss, Kajal Patel, Jiaee Cheong, Hatice Gunes (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-22093.txt.
Introduction
Fethiye Irmak Dogan and co-authors study bias that passes between models. Social bias in generative systems is usually measured as unequal performance across groups. The authors focus on a subtler form: associational bias, where models learn stereotyped links between concepts and demographic groups even when no group is named.
A model can link doctors with men without ever being told a doctor's gender. Their 2026 preprint investigates how such associations behave when generative models communicate with each other. If bias can amplify as models talk, then multi-agent systems and model-generated training data could quietly entrench stereotypes. Tracing that spread is a step toward interrupting it.
Catalog record
| CREATOR | Fethiye Irmak Dogan, Yuval Weiss, Kajal Patel, Jiaee Cheong, Hatice Gunes |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 87 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-22093
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Investigating Associational Biases in Inter-Model Communication of Large Generative Models Fethiye Irmak Dogan, Yuval Weiss, Kajal Patel, Jiaee Cheong, Hatice Gunes Abstract . Social bias in generative AI can manifest not only as performance disparities but also as “associational bias”, whereby models learn and reproduce stereotypical associations between concepts and demographic groups, even in the absence of explicit demographic information (e.g., associating doctors with men). These associations can persist, propagate, and potentially amplify across repeated exchanges in inter-model communication pipelines, where one generative model’s output becomes another’s input. This concern is especially salient for human-centred perception tasks, such as human activity recognition and affect prediction, where inferences about behaviour and internal states can lead to errors or stereotypical associations that propagate into unequal treatment in sensitive deployments (e.g., wellbeing assessment or safety monitoring). In this work, we focus on concepts related to human activity and affective expression, and study how such associations evolve within an inter-model communication pipeline that alternates between image generation and image description. Using the RAF-DB and PHASE datasets, we quantify demographic distribution drift induced by model-to-model information exchange and assess whether these drifts are systematic using an explainability pipeline. Our results reveal demographic drifts toward younger representations for both actions and emotions, as well as toward more female-presenting representations, primarily for emotions. We further find evidence that some predictions are supported by spurious visual regions (e.g., background or hair) rather than concept-relevant cues (e.g., body or face). We also examine whether these demographic drifts translate into measurable differences in downstream behaviour, i.e., while predicting activity and emotion labels. Finally, we outline mitigation strategies spanning data-centric, training-time, and deployment-time (post-training) interventions, and emphasise the need for careful safeguards when deploying interconnected models in human-centred AI systems. The code is publicly available at https://github.com/Cambridge-AFAR/Associational_Biases . 1. Introduction Associational bias in AI systems can be understood as the tendency to reproduce or strengthen social stereotypes by associating particular traits, roles, or behaviours with specific demographic groups (e.g., linking doctors with men and nurses with women) Mehrabi et al. 2021 ; Bolukbasi et al. 2016 ; Zhao et al. 2018 . Such biases are not only representational: when AI outputs are used for decisions or judgements about people, stereotype-driven associations can translate into unequal system behaviour and harmful downstream outcomes Birhane & Prabhu 2021 .This concern is especially important for human-centred perception tasks that span a range of difficulty, from comparatively concrete tasks such as human activity recognition, where actions can often be inferred from bodily motion and scene context, to more nuanced tasks such as affect prediction, where visual cues are more subtle and consistent annotator agreement is more challenging. When AI systems are used for such tasks, particularly in sensitive settings (e.g., wellbeing assessment, safety monitoring, and human-centred decision support Cheong et al. 2025a ; Cheong et al. 2024 ; Hassan et al. 2025 ), stereotypical associations can be especially harmful, as they risk producing unfair or distorted interpretations of people’s behaviour. With the rapid rise of generative AI, this concern becomes more pressing, as these models learn from large-scale, web-derived corpora that may be biased Bender et al. 2021 . Indeed, biases in these models are shown to surface in model embeddings and hence in model outputs Basta et al. 2019 ; Bolukbasi et al. 2016 ; Mikolov et al. 2013 ; Manzini et al. 2019 ; Kotek et al. 2023 ; Lee & Chung 2025 , and particularly reported for large image-text datasets Torralba et al. 2008 ; Birhane & Prabhu 2021 used for training vision-language and text-to-image systems. A growing body of work shows that even ordinary prompts can elicit stereotyped generations or biased predictions across demographic groups Seshadri et al. 2024 ; Elsharif et al. 2025 ; Contreras 2025 ; Wan et al. 2024 ; Hirota et al. 2022 ; Chen et al. 2024 . This concern is particularly acute in real-world deployments that rely on interconnected generative AI components, where the output of one model becomes the input to another, allowing biases present in individual components to propagate, interact, or evolve through inter-model information exchange. Figure 1 . An illustrative example demonstrating how associational biases can arise through the inter-model communication of large generative models. Despite their importance, current bias evaluations rarely examine how demographic skew evolves through repeated model-to-model information exchange in human-centred AI settings, particularly for tasks involving human activity and affect recognition. Moreover, much of the fairness literature in these contexts has focused on predictive notions of fairness, formalising disparities via measurable criteria such as equalised odds or counterfactual fairness Cheong et al. 2021 ; Cheong et al. 2023a ; Cheong et al. 2023 ; Cheong et al. 2025 ; Cheong et al. 2025a ; Alam 2020 ; Mennella et al. 2024 . While valuable, these metrics do not directly characterise associational bias : the tendency for particular activities or emotion labels to become disproportionately linked with specific demographic groups, even when demographic attributes are not explicitly specified — for example, associations between Sports and male-presenting individuals Harrison et al. 2023 ; Girrbach et al. 2025 , or between Happiness and female-presenting individuals Hosseini et al. 2025 . Motivated by these gaps, we pose three research questions: RQ1: How do demographic distributions drift under iterative information exchange between generative models, and do such drifts reflect stereotypical associations? RQ2: When demographic drifts occur, are they attributable to sampling noise, or do they instead reflect systematic mechanisms (e.g., consistent reliance on spurious visual regions such as background or hair rather than concept-relevant cues related to human activity or affective expression)? RQ3: Do these demographic drifts result in measurable differences in downstream task performance (e.g., emotion or activity prediction success) across demographic groups? To investigate these research questions in the contexts of human activity and emotion recognition, we make four contributions: C1 (Demographic Distribution Drift): We introduce an inter-model communication pipeline that couples an image-to-text describer with a text-to-image generator in two variants (text-seeded and image-seeded), enabling systematic measurement of how perceived demographic distributions drift through iterative model-to-model knowledge exchange (addresses RQ1); see Figure 1 for an illustrative example. C2 (Regional Associations): We propose an explainability pipeline that combines token-conditioned saliency with region-based aggregation to assess whether observed demographic drifts arise from systematic mechanisms rather than incidental variation (addresses RQ2). C3 (Prediction Success): We evaluate emotion and activity prediction success rates across demographic groups to quantify group-level disparities following inter-model information exchange (addresses RQ3). C4 (Towards Mitigation): Finally, building on our empirical findings and prior mitigation literature, we outline mitigation directions spanning data-centric, training-time, and deployment-time (post-training) interventions for inter-model communication systems. Across RAF-DB Li et al. 2017 and PHASE Garcia et al. 2023 , we observe demographic skews in loop-generated outputs, often trending toward younger representations (for both activities and emotions) and more female-presenting representations (for emotions), alongside evidence of spurious grounding. Together, these findings highlight the risks that arise when generative models are integrated as interconnected components in human-centred AI systems. 2. Related Work 2.1. Biases in Human-centred AI Systems Biases in human-centred AI systems are a longstanding concern because even subtle biases can amplify into unfair outcomes, often disproportionately impacting marginalised groups and reinforcing societal inequities Hamidi & Osmani 2021