Analytic Bijections for Smooth and Interpretable Normalizing Flows
Mathis Gerdes, Miranda C. N. Cheng, [1em] Institute of Physics, University of Amsterdam, Netherlands · 2026
Read Analytic Bijections for Smooth and Interpretable Normalizing Flows by Mathis Gerdes, Miranda C. N. Cheng, [1em] Institute of Physics, University of Amsterdam, Netherlands (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-10774.txt.
Introduction
Mathis Gerdes and Miranda C. N. Cheng design building blocks for normalizing flows. Flows turn simple random noise into rich data by a chain of smooth, invertible maps. Each scalar map in the chain must be expressive, smooth, and easy to invert with a known Jacobian. Existing choices force trade-offs among those needs.
Affine maps are smooth and easy to invert but weak. Splines give local control yet are only piecewise smooth and work on bounded ranges. Residual flows are smooth but need slow numeric inversion. The authors seek analytic bijections that keep all the good traits at once. Better blocks mean flows that train faster and sample more faithfully.
Catalog record
| CREATOR | Mathis Gerdes, Miranda C. N. Cheng, [1em] Institute of Physics, University of Amsterdam, Netherlands |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 89 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-10774
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Analytic Bijections for Smooth and Interpretable Normalizing Flows Mathis Gerdes, Miranda C. N. Cheng, [1em] Institute of Physics, University of Amsterdam, Netherlands Abstract A key challenge in designing normalizing flows is finding expressive scalar bijections that remain invertible with tractable Jacobians. Existing approaches face trade-offs: affine transformations are smooth and analytically invertible but lack expressivity; monotonic splines offer local control but are only piecewise smooth and act on bounded domains; residual flows achieve smoothness but need numerical inversion. We introduce three families of analytic bijections —cubic rational, sinh, and cubic polynomial—that are globally smooth ( C ∞ C^{\infty} ), defined on all of ℝ \mathbb{R} , and analytically invertible in closed form, combining the favorable properties of all prior approaches. These bijections serve as drop-in replacements in coupling flows, matching or exceeding spline performance. Beyond coupling layers, we develop radial flows : a novel architecture using direct parametrization that transforms the radial coordinate while preserving angular direction. Radial flows exhibit exceptional training stability, produce geometrically interpretable transformations, and on targets with radial structure can achieve comparable quality to coupling flows with 1000 × 1000\times fewer parameters. We provide comprehensive evaluation on 1D and 2D benchmarks, and demonstrate applicability to higher-dimensional physics problems through experiments on ϕ 4 \phi^{4} lattice field theory, where our bijections outperform affine baselines and enable problem-specific designs that address mode collapse. 1 Introduction Normalizing flows learn probability distributions by transforming a simple base density through invertible maps, enabling exact likelihood computation and efficient sampling. In many cases such as coupling or autoregressive layers, these are built out of basic scalar bijections acting coordinate-wise, making the choice of bijection a key design challenge. This choice fundamentally constrains how expressive a given concrete architecture is, and how stably it can be trained. Existing scalar bijections face a tradeoff. Affine transformations [ 1 ] are smooth and analytically invertible, but can only shift and scale. They lack the local expressivity needed to capture multimodal or heavy-tailed structure without many layers. Monotonic splines [ 2 ] offer fine-grained local control through learnable knots, but are only C^{k} for finite k (not C^{\infty} ) and only actively transform a bounded interval, requiring domain tuning for each application. Neural autoregressive flows [ 3 ] replace affine transforms with monotonic neural networks, achieving universal approximation but requiring implicit neural network inversion. Residual flows [ 4 , 5 , 6 ] , Gaussianization flows [ 7 ] , and related smooth constructions [ 8 ] achieve both smoothness and expressivity, but generally require numerical root-finding for inversion, complicating implementation and adding computational overhead. We introduce a family of analytic bijections that resolve this tradeoff: globally smooth ( C^{\infty} ), defined on all of \mathbb{R} , analytically invertible in closed form, and supporting both local deformations and global redistribution of probability mass. Our constructions derive from two principles. First, algebraic rational functions whose inverses reduce to solvable cubics, and second, conjugation with monotonic maps like \sinh , yielding three concrete bijection families: cubic rational , sinh , and cubic polynomial . These can serve as drop-in replacements for affine or spline transformers in existing coupling architectures. Beyond improving coupling flows, we develop a novel architecture that leverages these bijections in a fundamentally different way. Radial flows decompose space into radius and angular direction, applying scalar bijections only to the radial coordinate. Unlike coupling flows, whose bijection parameters are generated by neural network conditioners, radial flow parameters are learned directly as model weights. Radial flows exhibit exceptional training stability, produce geometrically interpretable transformations, and, on targets with natural radial structure, achieve comparable quality to coupling flows with orders of magnitude fewer parameters. We further extend radial flows with angular dependence, including a Fourier parametrization in 2D where the learned coefficients directly reveal which angular modes the flow uses to match the target. Paper organization. Section 2 reviews normalizing flows and existing scalar bijections. Section 3 presents our analytic bijections: construction principles, concrete expressions, and how to include learnable parameters for stable training. Section 4 describes flow architectures leveraging these bijections, with emphasis on radial flows. Section 5 provides comprehensive evaluation: 1D density estimation, coupling layer integration, radial flow benchmarks on 2D targets, and a physics application to lattice field theory. Section 6 concludes with a discussion on future directions and limitations. 1.1 Contributions Our two primary contributions are: novel scalar bijections and novel flow architectures. 1. Analytic bijections. We introduce three families of scalar bijections— cubic rational , sinh , and cubic polynomial —derived from two construction principles: algebraic rational functions and conjugation with nonlinear monotonic maps. Unlike existing alternatives, these bijections automatically and simultaneously satisfy five desiderata: global smoothness ( C^{\infty} ), unbounded domain, closed-form inverses, tractable Jacobians, and expressive parametrization supporting both local deformations and global effects. Table 1 summarizes how they compare to affine, spline, and residual flows such as mixture CDF transforms [ 6 ] . 2. Radial flow architectures. We develop a novel class of normalizing flows based on radial decomposition: transforming the radius r=\|\bm{x}\| while preserving angular direction. These radial flows exhibit exceptional training stability (tolerating learning rates an order of magnitude higher than coupling flows) and produce interpretable, geometrically intuitive transformations without requiring dense neural networks. We further extend radial flows with angular dependence, including an explicit Fourier parametrization in 2D where each of the 50–300 learned parameters has direct geometric meaning. 3. Evaluation. We validate our methods across multiple settings: (i) 1D density estimation, demonstrating monotonic improvement with bijection depth; (ii) coupling layer integration, showing competitive or superior performance to spline baselines; (iii) radial flow benchmarks on both unimodal and multimodal 2D targets, highlighting qualitative smoothness advantages and interpretability with directly inspectable parameters rather than opaque neural networks; (iv) application to \phi^{4} lattice field theory on a 20\times 20 lattice, demonstrating scalability to higher dimensions and physics-motivated problem-specific design. Our bijections serve as drop-in replacements in existing coupling architectures, while our radial flows offer a complementary paradigm suited to problems where smoothness, interpretability, or simplicity are priorities. 2 Background and Related Work 2.1 Normalizing Flows Normalizing flows [ 9 , 10 , 11 ] are generative models that learn a probability distribution by defining an invertible transformation f_{\theta}:\mathbb{R}^{d}\to\mathbb{R}^{d} from a simple base distribution (typically Gaussian) to the target. The model density is given by the change of variables formula: q_{\theta}(x)=\rho(f_{\theta}^{-1}(x))\left|\det\partialderivative{f_\theta^{-1}}{x}\right|, (1) where \rho is the base density. Flows are typically constructed as compositions f_{\theta}=f^{(L)}\circ\cdots\circ f^{(1)} of simpler bijective layers, where each layer f^{(\ell)} has an efficiently computable log-determinant Jacobian. The key architectural challenge is designing bijective layers that are both expressive and computationally tractable. Three main paradigms have emerged: Autoregressive flows [ 12 , 13 , 3 ] transform each dimension sequentially, conditioning on all previous dimensions, yielding a triangular Jacobian. Similarly, coupling flows [ 14 , 1 , 15 ] partition dimensions into “active” and “passive” subsets, transforming the active coordinates using parameters generated from the passive ones. Residual flows [ 5 , 16 ] use invertible residual networks with Lipschitz constraints, providing an alternative to the partitioning structure of coupling layers. Continuous normalizing flows [ 17 , 18 ] define the transformation as the solution to an ordinary differential equation, providing maximum flexibility at higher computational