Epistemic Generative Adversarial Networks

Muhammad Mubashar, Fabio Cuzzolin · 2026

Read Epistemic Generative Adversarial Networks by Muhammad Mubashar, Fabio Cuzzolin (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-18348.txt.

Introduction

Mubashar and Cuzzolin build GANs that track their own doubt with Dempster-Shafer evidence rules. GANs tend to make near-copy samples and lack range in what they produce. Their loss applies evidence rules to both the maker net and the judge net. The maker also outputs a mass value for each pixel of the image. That score lets the model state its doubt and use it to make samples with more range.

Catalog record

CREATORMuhammad Mubashar, Fabio Cuzzolin
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE42020
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.18348

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Epistemic Generative Adversarial Networks Muhammad Mubashar, Fabio Cuzzolin Abstract Generative models, particularly Generative Adversarial Networks (GANs), often suffer from a lack of output diversity, frequently generating similar samples rather than a wide range of variations. This paper introduces a novel generalization of the GAN loss function based on Dempster-Shafer theory of evidence, applied to both the generator and discriminator. Additionally, we propose an architectural enhancement to the generator that enables it to predict a mass function for each image pixel. This modification allows the model to quantify uncertainty in its outputs and leverage this uncertainty to produce more diverse and representative generations. Experimental evidence shows that our approach not only improves generation variability but also provides a principled framework for modeling and interpreting uncertainty in generative processes. 1 Introduction Generative models have achieved remarkable progress in synthesizing high-fidelity images, audio, and text, with Generative Adversarial Networks (GANs) standing out for their sample quality and training efficiency ( 6 ; 50 ; 38 ) . These models have revolutionized various domains, from computer vision to natural language processing, demonstrating unprecedented capabilities in generating realistic synthetic data ( 67 ) . Yet, despite numerous advances in objectives, architectures, and regularization techniques, lack of output diversity persists as a major challenge plaguing GANs and related generative approaches ( 50 ; 38 ; 54 ) . GANs often exhibit mode dropping and mode collapse, producing samples that look plausible but concentrate on a narrow subset of the target distribution ( 53 ; 50 ) . This phenomenon occurs when the generator fails to capture the complete range of diversity present in the training data, instead focusing on generating limited and repetitive variations of samples ( 38 ; 3 ) . Mode collapse arises from imbalances in the training dynamics between the generator and the discriminator ( 53 ) . For example, if the discriminator is weak or learns too slowly, the generator can exploit this by converging to a narrow set of outputs that consistently fool the discriminator ( 38 ) . The discriminator, seeing only limited patterns, gives the generator no incentive to explore other modes ( 53 ) . Conversely, training instabilities can cause the generator to rapidly jump between modes, effectively collapsing to one mode at a time ( 53 ; 38 ) . This imbalance erodes coverage, biases downstream analyses, and obscures failure modes that are crucial for trustworthy deployment ( 53 ; 8 ) . The problem is particularly acute in conditional GANs, which tend to ignore the input noise vector and focus primarily on conditional information, further limiting diversity in generated outputs ( 19 ; 62 ) . In applications such as medical imaging, where diverse and clinically relevant outputs are essential, mode collapse poses critical challenges for practical deployment ( 8 ; 54 ) . Addressing the diversity problem requires not only better training dynamics but also principled approaches to quantify and leverage uncertainty in the generative process ( 47 ; 28 ) . Traditional approaches to mitigate mode collapse have included architectural modifications, loss function adaptations, regularization techniques, and hybrid methods ( 8 ) . However, these solutions often come with computational costs or may reduce performance in scenarios where sample similarity is desired ( 22 ; 19 ) . More fundamentally, existing approaches typically lack a principled theoretical framework for understanding and modeling the uncertainty inherent in generative processes. Uncertainty quantification in deep learning ( 65 ) has gained significant attention, particularly for improving model reliability and trustworthiness ( 28 ; 47 ) . In the context of generative models, uncertainty can arise from both data uncertainty (aleatoric) and model uncertainty (epistemic) ( 40 ; 39 ; 11 ) . Data uncertainty stems from inherent randomness and noise in the data, while model uncertainty arises from insufficient knowledge during training or prediction ( 28 ) . Recent work has begun exploring uncertainty estimation in generative models, including approaches for diffusion models that estimate pixel-wise uncertainty to guide sampling processes ( 63 ) . The Dempster-Shafer theory of evidence provides a robust mathematical framework for reasoning under uncertainty ( 18 ) that generalizes classical probability theory ( 20 ; 14 ; 16 ) . Unlike traditional Bayesian approaches, Dempster-Shafer theory can handle incomplete and conflicting evidence by assigning belief masses to sets of propositions rather than single events ( 20 ; 51 ) . This framework has found applications across various domains, including sensor fusion, medical diagnosis, and collapse risk assessment ( 27 ; 64 ; 66 ) . In computer vision, Dempster-Shafer theory has been successfully applied to tasks such as classification ( 41 ) and image segmentation ( 55 ) . The theory’s ability to model both uncertainty and ignorance makes it particularly well-suited for generative modeling applications, where we often face incomplete knowledge about the true data distribution and conflicting evidence from different modes ( 51 ; 27 ) . Recent developments in evidential deep learning have begun incorporating belief theory into neural network architectures, though these approaches have faced challenges with zero-evidence regions that limit learning from certain training samples ( 49 ) . Building on these foundations, this work introduces a novel approach that leverages Dempster-Shafer theory to address the diversity problem in GANs while providing principled uncertainty quantification. By extending the traditional GAN framework with evidence-theoretic principles and enabling region-wise uncertainty estimation, we aim to create generative models that can both capture greater diversity in their outputs and provide meaningful measures of confidence in their predictions. This approach represents a significant departure from conventional GAN training paradigms and offers new possibilities for creating more robust and interpretable generative models. This is achieved through three key innovations: 1) modifying the discriminator to predict a belief function ( 12 ; 13 ) rather than a traditional probability distribution for assessing image authenticity, 2) introducing architectural enhancements to the generator that enable region-wise uncertainty estimation via belief function prediction, and 3) developing a generalized GAN loss formulation that operates within the belief function framework. Contributions . This paper makes the following contributions to the wider research in GANs: 1. We propose a unique Epistemic Generative Adversarial Network approach based on predicting belief functions in discriminators and generators. This leads to better generation quality and explainability of the model’s generation. 2. We advance architectural enhancements to discriminator and generator architectures to enable them to work in a belief theoretical framework. 3. We set out a novel loss function to effectively train the proposed model in this framework while also introducing terms to balance stochasticity and diversity of the generator. 4. We show experimental results of our approach outperforming the standard model both in terms of image quality and diversity of generations on several datasets. Paper Outline. This paper is structured as follows. Sec. 1 introduces the need for and concept of Epistemic Generative Adversarial Networks (E-GAN). Sec. 2 outlines the existing approaches and methods in this regard. In Sec. 3 , we recall the notions of random sets, belief functions and mass functions. Sec. 4 details our E-GAN approach, loss and architecture. Finally, Sec. 5 provides empirical evidence supporting out approach and discusses the results. Conclusions are given in Sec. 6 . 2 Related

Read the complete text