Multi-Objective Learning for Diffusion Models: A Statistical Theory under Semi-Supervised Learning
Ziheng Cheng, Yixiao Huang, Hanlin Zhu, Haoran Geng, Somayeh Sojoudi, Jitendra Malik, Pieter Abbeel, Xin Guo · 2026
Read Multi-Objective Learning for Diffusion Models: A Statistical Theory under Semi-Supervised Learning by Ziheng Cheng, Yixiao Huang, Hanlin Zhu, Haoran Geng, Somayeh Sojoudi, Jitendra Malik, Pieter Abbeel, Xin Guo (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-25210.txt.
Introduction
Ziheng Cheng and colleagues build a statistical theory for diffusion models. The models must serve many goals at once, such as varied image prompts or robot settings. A single generalist model often needs far more capacity than any one specialist, raising its appetite for labeled data. Their two-stage recipe first trains light specialists on scarce paired examples, then distills them into a generalist using generated pseudo-samples. Bounds show the paired-data need tracks specialist complexity only, and tests on robot control and image repair back the theory.
Catalog record
| CREATOR | Ziheng Cheng, Yixiao Huang, Hanlin Zhu, Haoran Geng, Somayeh Sojoudi, Jitendra Malik, Pieter Abbeel, Xin Guo |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 106595 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.25210
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Multi-Objective Learning for Diffusion Models: A Statistical Theory under Semi-Supervised Learning Ziheng Cheng, Yixiao Huang, Hanlin Zhu, Haoran Geng, Somayeh Sojoudi, Jitendra Malik, Pieter Abbeel, Xin Guo Abstract Diffusion models are increasingly used as powerful conditional generators, yet real deployments often involve multiple target distributions arising from different tasks, e.g., diverse prompt domains in text-to-image generation, or multiple environments in robotics with diffusion policies. This naturally leads to a multi-objective learning (MOL) problem. A key challenge is that achieving good Pareto trade-offs can require a generalist model class with substantially larger capacity than what suffices for solving any individual task, thereby increasing statistical cost since sample complexity typically scales with the model complexity. To reconcile this, we develop a principled MOL framework for diffusion models with limited data: a semi-supervised regime where paired (labeled) samples are scarce, but (unlabeled) condition data are abundant. We propose a two-stage training procedure that first fits lightweight specialist models from limited paired data, and then distills them into a generalist model by generating pseudo-samples. We establish generalization bounds showing that the required number of paired samples only depends on the complexity of the specialist model classes. We further extend the theory to diffusion policies for sequential decision making to account for distribution shift in on-policy rollouts. Extensive experiments on robotic control and image restoration tasks are conducted to verify our theoretical results. † † affiliationnotice: Equal contribution 1 Introduction Diffusion models have emerged as a versatile paradigm for conditional generation, powering applications such as text-to-image synthesis ( 17 ; 42 ; 18 ; 37 ) , image restoration and inverse problems ( 39 ; 24 ) , robotic control via diffusion policies ( 20 ; 8 ) , and life science ( 41 ; 15 ) . In many real-world deployments, however, one rarely faces a single target distribution. Instead, practitioners often face multiple distributions of interest induced by different domains, tasks, or environments. For instance, an image system may be expected to perform robustly across heterogeneous prompt domains (e.g., open-domain prompts vs. technical jargon ( 23 ) ), corruption patterns (e.g., inpainting vs. blurring) and visual styles (e.g., photorealistic vs. anime ( 33 ) ); while a diffusion policy may need to imitate expert behaviors across multiple environments with different rewards (e.g., goal-reaching vs. safety) and dynamics (e.g., changing camera viewpoints ( 53 ) ). This motivates a multi-objective learning (MOL) ( 21 ) perspective: learn a single conditional diffusion model that attains Pareto-optimal performance across the target distributions and supports explicit trade-offs among objectives. However, training a generalist diffusion model typically relies on a large amount of paired data (x,y) , where y is the condition and x is the generated variable. In many settings, acquiring paired samples is expensive (e.g., collecting curated paired text–image data, or expert human demonstrations in robotics), whereas obtaining unpaired conditions is substantially cheaper (e.g., abundant text prompts, states or observations). This creates an asymmetric regime: we have limited paired samples from each objective, but abundant access to the marginal distribution of conditions, also known as semi-supervised or weak supervision regime. Figure 1 : Semi-supervised multi-objective learning for conditional diffusion models. Given limited paired data \{(x_{i}^{k},y_{i}^{k})\}_{i=1}^{n}\stackrel{{\scriptstyle\text{i.i.d.}}}{{\sim}}\mathbb{P}_{k} and abundant condition-only data \{\widetilde{y}_{i}^{k}\}_{i=1}^{N}\stackrel{{\scriptstyle\text{i.i.d.}}}{{\sim}}\mathbb{P}_{k}^{Y} for each objective k , we first train lightweight specialists \widehat{h}_{k}\in\mathcal{H}_{k} and use them to generate pseudo-paired data. A large diffusion generalist in class \mathcal{F} is then trained on labeled and pseudo-labeled data. This reduces the paired-sample complexity from scaling with the generalist complexity C_{\mathcal{F}} to scaling with the specialist complexity C_{\mathcal{H}} where C_{\mathcal{H}}\ll C_{\mathcal{F}} . A central question of this paper is: Can we learn a Pareto optimal diffusion model in a sample-efficient manner by leveraging weakly supervised data? One key observation is that, while training a generalist model that performs well across many objectives is statistically expensive, learning a specialist model for each individual objective can be far more sample-efficient: the specialist model is typically lightweight with lower capacity, and can be learned from substantially fewer paired samples. For example, in robotics, training a specialist diffusion policy for a single manipulation task (e.g., Push-T ) can often be done with a relatively small backbone (e.g., a \sim 12M-parameter ResNet ( 8 ) ), whereas learning a generalist vision–language–action policy that covers diverse tasks typically demands far more data (e.g., OpenVLA at \sim 7B parameters ( 25 ) ). This motivates a two-stage learning algorithm: we first fit the specialist diffusion models respectively using limited paired data, and then use them to generate pseudo-samples that facilitate learning a generalist model. This procedure is simple, broadly applicable, and aligns with how diffusion models are commonly bootstrapped in practice ( 52 ; 28 ; 50 ) . A closely related work ( 47 ) has also studied similar semi-supervised learning algorithms for prediction tasks. To our knowledge, however, a comparable theoretical understanding of the statistical rates for multi-objective generative models remains missing. In this paper, we take the first step towards addressing the central question above and develop a statistical theory for MOL of diffusion models under semi-supervised learning. Our main contributions are summarized as follows: • In Section 2 , we formalize learning a single diffusion model across multiple target distributions through Pareto optimality, characterized by proper scalarizations. We propose a practical semi-supervised training pipeline that first learns lightweight specialist diffusion models for each objective from limited paired data, and then trains a generalist diffusion model using pseudo-samples generated by the specialists. • In Section 3.1 , we provide nonasymptotic generalization bounds on the score matching objectives and derive distributional estimation guarantees (in total variation distance) under general scalarizations. Notably, our results indicate that required number of paired (labeled) samples depends only on the complexity of the specialist model classes, rather than the large generalist class. In Section 3.2 , we further sharpen the rates for linear (weighted-sum) scalarizations via a more refined analysis. • In Section 3.3 , we study diffusion policies in sequential decision making and address the practical distribution shift issue induced by on-policy rollouts. We extend our analysis and establish, to our knowledge, the first theoretical guarantee on the sub-optimality gap of diffusion policies in imitation learning. Overall, this paper provides a principled MOL framework for diffusion models with limited data, bridging theory and practice for semi-supervised learning. We also conduct extensive experiments on robotic manipulation and image restoration tasks in Section 5 to verify the theoretical results. 2 Preliminaries and Problem Setup Notations We use x and y to denote the data and conditions, respectively. The blackboard bold letter \mathbb{P} represents the joint distribution of (x,y) , while the lowercase p denotes its density function. \mathbb{P}^{Y} stands for the marginal distribution of condition y . The notation \Delta(\Omega) denotes the probability simplex over a sample space \Omega and \Delta^{K} is (K-1) -dimensional standard simplex. We use |x| to denote the coordinate-wise absolute value. The norm \|\cdot\| refers to the \ell_{2} -norm for vectors and the spectral norm for matrices, and \|\cdot\|_{p} denotes general \ell_{p} -norm. Finally, we use standard \lesssim,\mathcal{O}(\cdot) to omit constant factors and \widetilde{\mathcal{O}}(\cdot) to omit logarithmic factors. 2.1 Conditional Diffusion Models Let \mathbb{R}^{d_{x}} denote the data space and [0,1]^{d_{y}} denote the condition space. Let \mathbb{P} be any joint