Multi-population GAN Training: Analyzing Co-Evolutionary Algorithms CCS: Computing methodologies Unsupervised learning CCS: Computing methodologies Bio-inspired approaches CCS: Computing methodologies Neural networks
Walter P. Casas, Jamal Toutouh · 2025
Read Multi-population GAN Training: Analyzing Co-Evolutionary Algorithms CCS: Computing methodologies Unsupervised learning CCS: Computing methodologies Bio-inspired approaches CCS: Computing methodologies Neural networks by Walter P. Casas, Jamal Toutouh (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-13157.txt.
Introduction
Casas and Toutouh test whether raising rival AI image-makers in competing populations trains them better than standard tuning. Generative adversarial networks pair a maker with a critic, yet training often collapses to a few outputs or wobbles. Their 2025 study evolves whole populations of makers and critics under three survival rules, and compares them with a plain multi-network setup.
Tests ran on two simple synthetic sets and the handwritten-digit benchmark. Full generational replacement, where offspring wholly displace parents, gave the best sample quality and variety, especially with larger broods. Rules that kept elite parents forever stalled early and lost variety. The authors draw lessons on balancing exploration against exploitation in population training. They aim the guidance at builders of generative models.
Catalog record
| CREATOR | Walter P. Casas, Jamal Toutouh |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 42 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-13157
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Multi-population GAN Training: Analyzing Co-Evolutionary Algorithms CCS: Computing methodologies Unsupervised learning CCS: Computing methodologies Bio-inspired approaches CCS: Computing methodologies Neural networks Walter P. Casas, Jamal Toutouh Abstract . Generative adversarial networks (GANs) are powerful generative models but remain challenging to train due to pathologies such as mode collapse and instability. Recent research has explored coevolutionary approaches, in which populations of generators and discriminators are evolved, as a promising solution. This paper presents an empirical analysis of different coevolutionary GAN training strategies, focusing on the impact of selection and replacement mechanisms. We compare ( μ , λ ) (\mu,\lambda) , ( μ + λ ) (\mu{+}\lambda) with elitism, and ( μ + λ ) (\mu{+}\lambda) with tournament selection coevolutionary schemes, along with a non-evolutionary population based multi-generator multi-discriminator GAN baseline, across both synthetic low-dimensional datasets ( blob and gaussian mixtures) and an image-based benchmark (MNIST). Results show that full generational replacement, i.e., ( μ , λ ) (\mu,\lambda) , consistently outperforms in terms of both sample quality and diversity, particularly when combined with larger offspring sizes. In contrast, elitist approaches tend to converge prematurely and suffer from reduced diversity. These findings highlight the importance of balancing exploration and exploitation dynamics in coevolutionary GAN training and provide guidance for designing more effective population-based generative models. 1. Introduction Generative Adversarial Networks (GANs) have emerged as powerful generative models, demonstrating success in image synthesis, data augmentation, and unsupervised representation learning ( Ku and Lee 2023 ) . A GAN consists of two artificial neural networks (ANN), a generator ( g ) and a discriminator ( d ), that are trained simultaneously in a competitive setting. The generator aims to produce samples that resemble real training data, while the discriminator attempts to distinguish between real and synthesized samples ( Goodfellow et al. 2020 ) . The training process is formulated as a min-max optimization problem ( Krawiec and Heywood 2016 ) . The loss functions are designed so that the generator is rewarded for successfully fooling the discriminator, while the discriminator is rewarded for correctly distinguishing between real and fake data samples. Under ideal conditions, GAN training converges to an equilibrium where the generator produces samples that are indistinguishable from real data. However, in practice, achieving stable convergence remains a significant challenge. Vanishing gradient ( Arjovsky et al. 2017 ) , mode collapse ( Arora et al. 2018 ) or discriminator collapse ( Li et al. 2018 ) are some of the GAN training pathologies that can arise during the training. Several approaches have been proposed to overcome GAN pathologies. Among others, researchers have proposed multi-generator and multi-discriminator architectures, evolutionary-based GAN training, and co-evolutionary approaches. Multi-generator GANs introduce multiple competing generators to enhance sample diversity and mitigate mode collapse, while multi-discriminator frameworks leverage multiple critics to provide more refined and distributed adversarial feedback. Evolutionary algorithms (EAs) have been applied to GAN training to optimize hyperparameters, loss functions, and network architectures through mechanisms such as selection, mutation, and recombination. Recently, co-evolutionary algorithms (Co-EAs) have emerged as a promising paradigm, applying population-based co-evolution to GAN training, where both populations of generators and of discriminators co-adapt over successive iterations. These methods have demonstrated improvements in stability, diversity, and training efficiency. This work aims to analyze how different selection, replacement, and population dynamics influence Co-EA GAN training stability, diversity, and convergence. Thus, the main contribution of this work is a systematic evaluation of different coevolutionary strategies for GAN training, focusing on how population dynamics, selection mechanisms, and replacement strategies impact both quality and diversity. To guide this analysis, we consider the following research questions: RQ1: How do different coevolutionary strategies—particularly selection and replacement mechanisms—impact the quality and diversity of GAN-generated samples? RQ2: To what extent does the balance between exploration and exploitation, as controlled by population and offspring sizes, affect the performance and stability of GAN training? RQ3: Can a simple population based multi-generator multi-discriminator (MG-MD) GAN without selection or replacement be competitive with coevolutionary approaches? The remainder of the paper is organized as follows. Section 2 introduces the background and related work. The evaluated Co-EA GAN training approaches are described in Section 3 . Section 4 describes the experimental methodology and Section 5 presents the experimental results and discussions. Section 6 discusses the main conclusions and future work. 2. Related Works Generative Adversarial Networks (GANs) have been used across a wide variety of applications, from image and video synthesis to data enhancement ( Ali et al. 2024 ) . Despite their remarkable success, training GANs remains complex due to the intricate interaction between the generator and the discriminator, which can lead to undesirable behaviors. This complex interaction frequently results in training pathologies like mode collapse and instability, making these models particularly difficult to train. Several methods integrate Evolutionary Computation (EC) for GANs to mitigate their training pathologies. One representative example is Evolutionary GAN (EGAN) ( Wang et al. 2019 ) which employs multiple loss functions, each assigned to a different generator, and selects the best performing generator, introducing diversity. Another notable approach is Multi-objective Evolutionary GAN (MO-EGAN) ( Baioletti et al. 2020 ) , which proposes a framework that simultaneously optimizes conflicting criteria such as fidelity and diversity. In MO-EGAN, a multi-objective evolutionary algorithm is used to evolve the generator, resulting in a more balanced strategy that addresses inherent challenges and enhances both the robustness and quality of the generated outputs. An additional contribution is Differential-evolution-based GAN (DE-GAN) ( Zheng et al. 2019 ) . This approach applies differential evolution to explore the parameter space in GAN training, specifically targeting edge detection. DE-GAN addresses common training pathologies optimizing the GAN’s parameters, demonstrating the potential of evolutionary strategies to enhance performance in specialized tasks. Other approaches have shown promise in addressing inherent adversarial challenges. Adversarial Evolutionary Learning (AEL), implemented as competitive CoEA ( Zhao et al. 2021 ) , has proven effective for search, optimization, design and modeling ( Antonio and Coello 2018 ; Popovici et al. 2012 ; Rosin and Belew 1997 ; Sims 1994 ) . Its applications include board games ( Pollack and Blair 1998 ) , video game playing ( Keaveney and O’Riordan 2011 ; Sipper 2011 ) , social science games ( Axelrod and Hamilton 1981 ) , software engineering tasks as coevolving programs and unit tests ( Arcuri and Yao 2007 ; Arcuri and Yao 2014 ; Wilkerson and Tauritz 2010 ) or differentiating correct from incorrect behavior ( Barr et al. 2014 ) , and various cybersecurity problems ( Hingston and Preuss 2011 ; Rush et al. 2015 ; Service and Tauritz 2009 ) . As GANs represent a type of adversarial learning, some authors have successfully applied Competitive Co-EA to train GANs. COEGAN ( Costa et al. 2020 ; Costa et al. 2019b ) takes to a coevolutionary approach to jointly evolve the architectures of generator and discriminator, and t-SNE visualization analysis suggest convergence to high quality model ( Costa et al. 2021 ) . Numerous extensions of this idea include multi objective variants, based on NSGA-II ( Baioletti et al. 2020 ) , quality diversity methods. Differential evolution approaches and cooperative CoEA that evolve both generators and discriminators for multi-objective optimization. Other works replace the generator with an expression-based population.