The Fundamental Limits of

2026

Read The Fundamental Limits of (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-30574.txt.

Introduction

Sivaraman Balakrishnan, of Carnegie Mellon University, examines in a 2026 note a quiet assumption behind modern generative modelling. Methods such as diffusion models, normalising flows and flow matching learn transport maps, functions that reshape one probability distribution into another. They rarely aim for the optimal transport map, the cheapest such reshaping, because in generation the transport cost itself does not matter.

Balakrishnan formalises how to estimate any valid transport map inside a minimax framework, which judges methods by their worst-case error. Under standard but strong stability assumptions borrowed from optimal transport theory, he shows that any valid map is statistically as hard to estimate as the optimal one. That yields sample-complexity lower bounds for flow matching and diffusion methods alike. He also gives examples where the assumptions fail and alternative maps can be learned far more accurately.

Catalog record

YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE65 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.30574

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

The Fundamental Limits of Abstract Many modern generative modeling methods, including diffusion models, normalizing flows, and flow matching, estimate transport maps or plans between distributions without explicitly targeting an optimal transport (OT) map. In applications like generative modeling, the transport cost itself is irrelevant, and this makes it natural to target maps which are more tractable from either a statistical or computational standpoint. In this short note, we formalize the task of estimating any valid transport map in a rigorous minimax framework. One consequence of this framing is that it yields sample complexity lower bounds for any method whose learned object is evaluated as a transport map or plan, including flow matching and diffusion-based generative models, in settings where direct analysis would be challenging due to the analytic complexity of the methods and their target maps. We observe that, under standard, though strong, stability assumptions from the OT literature, estimating any valid transport map is statistically as hard as estimating the OT map. We complement these results with some examples showing that when these stability assumptions fail, alternative transport maps can be learned substantially more accurately than the OT map. Our minimax framing provides a rigorous foundation for understanding the statistical limits of modern transport-based generative methods and clarifies when targeting sub-optimal maps can provide real statistical advantages. Valid Transport Map Estimation Sivaraman Balakrishnan †‡ Department of Statistics and Data Science † Machine Learning Department ‡ Carnegie Mellon University, Pittsburgh, PA 15213. August 10, 2026 1 Introduction Learning transformations between probability distributions is a central problem in modern statistics and machine learning. Such transformations provide a mechanism for mapping a simple reference distribution (e.g., a Gaussian) to a complex target distribution. A wide variety of modern generative modeling methods can be interpreted through this lens. For example, normalizing flows explicitly parameterize invertible transport maps between distributions [ 24 , 8 , 22 ] , while diffusion models and score-based generative models construct stochastic processes that implicitly define transformations between a reference distribution and the target distribution [ 25 , 11 , 26 ] . More recent approaches such as flow matching and rectified flows also explicitly frame generative modeling as learning transport maps between distributions [ 16 , 17 , 1 ] . These methods have demonstrated remarkable empirical success across a wide range of generative modeling tasks. A classical mathematical formulation of the problem of transforming one distribution to another is given by optimal transport (OT) [ 28 , 29 ] . In this framework, the optimal transport map between two distributions is defined as the map that pushes one distribution to the other while minimizing a specified transport cost. Optimal transport has become an important tool in machine learning and statistics, with applications ranging from generative modeling and domain adaptation to distributional robustness and fairness [ 23 ] . Part of the success of OT is that it pins down a clear target of inference, enabling us to delve deeper into statistical and computational issues. At the same time, computing or estimating optimal transport maps from samples can be challenging, particularly in high dimensions. In many applications, the transport cost itself is irrelevant. The goal is simply to produce samples from a target distribution or to transform data between domains; any valid transport map that pushes the source distribution to the target distribution suffices. This observation motivates the widespread use of methods that do not explicitly target the optimal transport map, but instead learn alternative transport mechanisms. Indeed, many modern generative modeling methods – including diffusion models, flow matching, and various triangular or autoregressive transport maps – can be interpreted as learning transport maps or stochastic transport plans that are generally sub-optimal with respect to the classical OT objective. This raises a natural question: is learning an arbitrary transport map statistically easier than learning the optimal transport map? A common intuition is that this should be the case. Optimal transport maps can be sensitive to perturbations in the underlying distributions, and estimating them from samples often requires strong regularity assumptions [ 5 , 10 ] . In contrast, modern generative modeling methods often appear empirically stable and effective even in settings where optimal transport maps may be difficult to estimate. These observations have led to a belief that learning a “good enough” transport map may be fundamentally easier, both computationally and statistically , than learning the optimal one. Despite this intuition, the statistical difficulty of estimating general transport maps has not been systematically studied. While there is a growing literature on the statistical estimation of optimal transport maps [ 18 , 6 , 12 ] , much less is known about the fundamental limits of estimating arbitrary transport maps between distributions. Moreover, for many modern generative modeling methods the target map is analytically complex, making it difficult to study their statistical properties directly. In this paper, we introduce a simple minimax framework for studying the statistical limits of transport map estimation. Instead of focusing on the optimal transport map, we consider the broader problem of estimating a measurable map that transports one distribution to another. We measure performance using natural notions of risk that quantify the discrepancy between the estimated transport map and the set of valid transport maps. Our main results show that the task of estimating a valid transport map lends itself quite naturally to statistical analysis. Intuitively, any successful transport map estimator must at least induce an accurate estimate of the target distribution in Wasserstein distance, and the difficulty of this latter task serves as a fundamental limit for the estimation of a transport map. Since the optimal transport map is itself a valid transport map, estimating a valid map is never harder than estimating the optimal one. Stability assumptions commonly imposed in the literature on OT map estimation ensure that the OT map varies smoothly with the underlying distributions. Under these stability assumptions, the risk of OT map estimation is upper bounded by the risk of estimating the target distribution in the Wasserstein sense. We show in this paper that, under stability assumptions, estimating a valid transport map and estimating the optimal transport map have the same statistical difficulty. At the same time, our results also show that the equivalence between optimal and sub-optimal transport maps can fail in the absence of stability. We provide simple examples in which the optimal transport map is either moderately or highly unstable and statistically difficult to estimate, while alternative transport maps can be learned at substantially faster rates. This separation demonstrates that the potential advantages of modern transport-based generative methods arise precisely in regimes where stability assumptions break down. Our framing immediately yields new lower bounds for a range of modern generative modeling methods. In particular, our results imply sample complexity lower bounds for formulations of methods such as flow matching and diffusion-based generative models whose learned object is evaluated as a transport map or plan. Directly analyzing the statistical limits of these methods would be challenging due to the analytic complexity of the transformations they learn. By instead studying the broader problem of valid transport map estimation, we obtain these bounds in a unified and conceptually simple manner. Taken together, our results provide a principled statistical

Read the complete text