Semi-Supervised Generative Learning via Latent Space Distribution Matching
Kwong Yu Chong and Long Feng · 2026
Read Semi-Supervised Generative Learning via Latent Space Distribution Matching by Kwong Yu Chong and Long Feng (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-04223.txt.
Introduction
Chong and Feng present semi-supervised making learning via latent space distribution matching. They present Latent Space Distribution Matching, a new semi-supervised making models method for conditional spreads. Theoretically, they prove non-asymptotic error bounds and show a key benefit of unpaired data: stronger shape fidelity in generated outputs.
Catalog record
| CREATOR | Kwong Yu Chong and Long Feng |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 68003 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.04223
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Semi-Supervised Generative Learning via Latent Space Distribution Matching Kwong Yu Chong and Long Feng Abstract We introduce Latent Space Distribution Matching (LSDM), a novel framework for semi‑supervised generative modeling of conditional distributions. LSDM operates in two stages: (i) learning a low‑dimensional latent space from both paired and unpaired data, and (ii) performing joint distribution matching in this space via the 1‑Wasserstein distance, using only paired data. This two‑step approach minimizes an upper bound on the 1‑Wasserstein distance between joint distributions, reducing reliance on scarce paired samples while enabling fast one‑step generation. Theoretically, we establish non‑asymptotic error bounds and demonstrate a key benefit of unpaired data: enhanced geometric fidelity in generated outputs. Furthermore, by extending the scope of its two core steps, LSDM provides a coherent statistical perspective that connects to a broad class of latent-space approaches. Notably, Latent Diffusion Models (LDMs) can be viewed as a variant of LSDM, in which joint distribution matching is achieved indirectly via score matching. Consequently, our results also provide theoretical insights into the consistency of LDMs. Empirical evaluations on real‑world image tasks, including class‑conditional generation and image super‑resolution, demonstrate the effectiveness of LSDM in leveraging unpaired data to enhance generation quality. Keywords: Conditional generative learning, Wasserstein distance, Deep neural networks, Representation learning, Autoencoder 1 Introduction Generative learning has achieved impressive success across a wide range of applications, such as language modeling and image generation. This paper focuses on conditional generative learning in a semi-supervised setting. Semi-supervised learning (SSL) enhances learning by leveraging limited labeled data alongside abundant unlabeled data, offering particular value in domains where labeled data are scarce or expensive to acquire. Given inputs X , generating outputs Y according to the conditional distribution \mathbb{P}_{Y|X} is highly valuable for a wide range of applications. In a fully supervised setting, conditional generation requires paired data (X,Y) in order to learn the conditional mapping between inputs and outputs. However, acquiring authentic paired data can be challenging, and artificially constructing such pairs by assuming a particular generative process may introduce biases. For instance, generative learning has shown impressive success in image super-resolution tasks ( 20 ; 31 ) . Training these models requires paired datasets containing both low- and high-resolution versions of the same images. However, such pairs are rarely available, as most natural images exist at a single resolution. Moreover, artificially generating low-resolution images via down-sampling can lead to domain shift, potentially diminishing the model’s effectiveness in real-world applications ( 40 ) . Given these challenges, unpaired data, which are often easier to obtain, hold particular significance. Although such data do not directly reveal the dependence between variables, they can still capture the inherent structure of the response variable Y . For instance, when Y has a low-dimensional geometric structure, such as lying close to a manifold, generated samples need to preserve this geometric structure to maintain realism. Therefore, having access to abundant unpaired response data can improve generation quality by enabling better estimation of the underlying data structure. Building on this idea, this paper studies semi-supervised generative learning that draws on additional response data. We now proceed to review existing studies on semi-supervised learning and generative learning. 1.1 Related Work A central theme in SSL is that unlabeled data can enhance estimation even when the underlying model is misspecified. In regression settings, unlabeled covariates have been shown to improve inference for the regression parameter when the mean function is nonlinear ( 3 ) , facilitate more accurate estimation of the response mean ( 41 ) , and produce estimators with reduced asymptotic variance ( 1 ) . Recent theoretical developments have further demonstrated minimax optimality and efficiency gains for semi-supervised estimators across a wider range of misspecification scenarios ( 10 ; 35 ) . Additional benefits of incorporating unlabeled data have been established in 5 ; 42 ; 4 . In the machine learning literature, SSL has been extensively explored for classification tasks, often relying on structural assumptions such as cluster organization or manifold geometry in the data ( 29 ; 2 ; 6 ) . Generative learning is arguably one of the most actively researched fields in modern AI. Leading frameworks include Variational Autoencoders (VAEs; 19 ), Generative Adversarial Networks (GANs; 15 ), and Diffusion Models (DMs; 17 ). VAEs model data distributions via variational inference but often produce blurry outputs; GANs generate sharper samples through adversarial training, yet suffer from instability and mode collapse; diffusion models achieve high fidelity through iterative refinement, though at high computational cost. Recently, generative learning has also drawn growing interest in statistics. 18 analyzed the convergence rates of GANs, demonstrating their adaptability to inherently low-dimensional data; 8 proposed a GAN–VAE hybrid with a probabilistic interpretation; 27 extended this model to adaptively select latent dimensions; and 28 used Wasserstein gradient flow theory to identify limitations in transport-based models, introducing TemperFlow to address multi-modality. Compared to unconditional generative learning, sampling from conditional distributions is often more valuable for downstream applications, and research in this area has expanded rapidly. An important line of work in conditional generative learning is based on distribution matching ( 44 ; 21 ; 36 ) . Leveraging the noise outsourcing lemma, these methods ensure the existence of a conditional generator and estimate it by minimizing a statistical divergence between the joint distribution of generated pairs and the target joint distribution. The distribution matching approach has several notable advantages. First, the dual representation of divergences enables single-step training through a GAN-style adversarial game. Second, the generation is fast, requiring only one forward pass through the generator. Third, the objective function directly reflects generation quality, aiding model evaluation. However, this approach does not admit a straightforward mechanism for incorporating unlabeled data into the objective, limiting its applicability in semi-supervised settings. Another prominent approach is latent‑space generative modeling, which naturally supports semi‑supervised learning by building a low‑dimensional latent representation. Representative examples include Latent Diffusion Models (LDM; 30 ), Latent Space Flow Matching (LFM; 9 ), and related variants. These methods typically begin by training an autoencoder to capture a compact latent space, then train a conditional generative model to map inputs to the corresponding output latent codes. Despite their state‑of‑the‑art performance, several open questions remain: (1) Diffusion and flow‑based models rely on multiple iterative steps for generation, leading to slow generation. (2) The exact mechanism through which unpaired data enhances generation quality is unclear. (3) While existing latent‑space methods exhibit notable structural similarities, there is currently no unified theoretical framework that explains their shared behavior. 1.2 Contributions This paper addresses semi-supervised generative learning by introducing Latent Space Distribution Matching (LSDM), a framework that integrates distribution matching with latent space representation learning. LSDM operates in two stages: first, an autoencoder is trained on paired and unpaired data to learn a compact latent space; second, a latent code generator is trained on paired data to match joint distributions in this space, while the autoencoder remains fixed. LSDM offers two training variants: composite LSDM (cLSDM), which preserves a composite generator architecture during training, and direct LSDM (dLSDM), which optimizes only the latent generator. These approaches present complementary trade-offs: cLSDM delivers more stable training and higher sample quality, while dLSDM offers faster training and reduced computational cost. The LSDM framework offers at