Parameter-Efficient Generative Modeling with Controlled Vector Fields

Peyman Morteza · 2026

Read Parameter-Efficient Generative Modeling with Controlled Vector Fields by Peyman Morteza (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-28267.txt.

Introduction

Peyman Morteza builds generative flows from a few fixed vector fields steered by learned scalar controls. When the fixed fields generate brackets that span the whole space, expressive transport follows with few learned channels and a parameter-efficient geometric alternative to standard field models. An expressivity principle and synthetic tests support the design.

Catalog record

CREATORPeyman Morteza
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE44471
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.28267

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Parameter-Efficient Generative Modeling with Controlled Vector Fields Peyman Morteza Abstract . We introduce a continuous-time generative modeling framework, motivated by the Chow–Rashevskii theorem, that builds expressive flows from a small set of fixed vector fields and learned scalar controls. Instead of learning an unconstrained high-dimensional vector field, our framework constructs the velocity by modulating fixed vector fields with learned scalar control functions. When the fixed fields are bracket-generating, their Lie algebra spans the ambient space, providing a mechanism for expressive transport with only a small number of learned control channels and offering a parameter-efficient geometric alternative to standard vector-field parameterizations. This decoupled formulation yields a structured and interpretable generative model in which the number of learned scalar output channels can be chosen independently of the ambient dimension. We formulate an expressivity principle showing that, under suitable controllability and well-posedness assumptions, such controlled flows can transport a source distribution to a target distribution. We train the resulting model using a continuous-normalizing-flow likelihood objective and present proof-of-concept experiments on synthetic distributions. 1. Introduction Generative models form a cornerstone of modern machine learning and AI, driving advances in areas such as image synthesis, language modeling, and structured data generation ( 1 , 7 ) . Among the most successful approaches are flow-based and diffusion models, which have shown remarkable capability in capturing complex, high-dimensional data distributions ( 5 , 13 , 11 , 9 ) . In this note, we investigate a continuous-time generative modeling framework that builds expressive flows from a small set of fixed vector fields and learned scalar controls. The key idea is to replace an unconstrained high-dimensional velocity field with a controlled dynamical system whose underlying vector fields are fixed and whose scalar coefficients are learned. Unlike conventional flow-based models that directly learn high-dimensional vector-valued fields, our approach learns only scalar coefficients over predefined geometric directions (see Lemma 8 ). Leveraging the Chow–Rashevskii theorem, we formulate an expressivity principle showing that, under suitable admissibility, controllability, and well-posedness assumptions, such controlled flows can transport a source distribution to a target distribution (see Corollary 7 ), even when restricted to a limited number of control directions. Intuitively, the Lie algebra generated by the fixed vector fields spans the full tangent space, enabling the system to reach any state through compositions of a few base directions. This results in a compact, parameter-efficient, and structurally interpretable generative framework: the fixed vector fields provide the underlying geometric structure, while the learned scalar controls modulate the dynamics with a small number of output channels. By structural interpretability, we mean that the generative process is explicitly constructed from a fixed, known set of vector fields, while the learned scalar control functions modulate these directions over time. We instantiate the framework with lightweight MLPs that parameterize the scalar control functions (see Algorithm 1 ) and evaluate its performance on standard synthetic density benchmarks. The remainder of this note is organized as follows. Section 2 recalls the necessary preliminaries on Lie brackets, the Chow–Rashevskii theorem, and control systems. Section 3 introduces the ChowFlow framework, which replaces unconstrained vector-field parameterizations with learned scalar controls over fixed vector fields satisfying a bracket-generating condition. Section 4 presents proof-of-concept experiments on synthetic distributions. Section 5 provides detailed proofs of the theoretical results, and Section 6 provides additional experimental details. 2. Preliminaries We provide a brief overview of Lie brackets, the Chow–Rashevskii theorem, and control systems. Detailed expositions can be found in standard references, e.g., ( 14 , 8 , 10 ) . Definition 1 (Lie Bracket) . The Lie bracket of two smooth vector fields X and Y on a smooth manifold M , denoted [X,Y] , is a smooth vector field defined by, [X,Y](f)=X(Y(f))-Y(X(f)), for any smooth function f:M\to\mathbb{R} , where X(f) and Y(f) denote the action of the vector fields on f . Definition 2 (Left-Invariant Vector Field) . Let G be a Lie group, and let L_{g}:G\to G denote left multiplication by g\in G , i.e., L_{g}(h)=gh . A smooth vector field X\in\mathfrak{X}(G) is called left-invariant if it is preserved under all left translations, (dL_{g})_{h}(X(h))=X(gh),\quad\text{for all }g,h\in G. Equivalently, X is completely determined by its value at the identity element e\in G , and extended to all of G by left translation, X(g)=(dL_{g})_{e}(X(e)). The space of left-invariant vector fields is naturally identified with the Lie algebra T_{e}G of G . Definition 3 (Control System) . A control system on a smooth manifold M is a dynamical system of the form, \dot{x}(t)=\sum_{i=1}^{k}u_{i}(t,x(t))X_{i}(x(t)), where \{X_{1},X_{2},\dots,X_{k}\} are smooth vector fields on M , and u_{i}:[0,T]\times M\to\mathbb{R} , 1\leq i\leq k , are scalar control inputs, or feedback control laws, depending on time and state. Here, k denotes the number of control channels. When classical ODE solutions are considered, we assume the u_{i} are sufficiently regular to ensure well-posedness. Theorem 4 (Chow–Rashevskii Theorem ( 4 , 12 ) ) . Let M be a connected smooth manifold, and let \Delta=\mathrm{span}\{X_{1},\dots,X_{k}\} be a distribution generated by smooth vector fields. If the Lie algebra generated by \{X_{1},\dots,X_{k}\} spans the entire tangent space T_{x}M at every x\in M , i.e., \mathrm{Lie}\{X_{1},\dots,X_{k}\}(x)=T_{x}M\qquad\forall x\in M, then any two points p,q\in M can be connected by a piecewise smooth, absolutely continuous curve \gamma:[0,1]\to M satisfying, \gamma(0)=p,\qquad\gamma(1)=q,\qquad\dot{\gamma}(t)\in\Delta_{\gamma(t)}, for almost every t\in[0,1] . Remark 1 (Control-theoretic interpretation) . The Chow–Rashevskii theorem can be interpreted as a controllability statement: when the vector fields X_{1},\ldots,X_{k} are bracket-generating, admissible curves tangent to their span can connect any two points in the same connected component of M . In our setting, this motivates the use of a small set of fixed bracket-generating vector fields as a geometric basis for constructing continuous-time generative flows. 3. ChowFlow In this section, we show how the Chow–Rashevskii theorem motivates a parameter-efficient class of structured continuous-time generative models. Our key observation is that viewing generative flows through the lens of the Chow–Rashevskii theorem leads to a parameter-efficient velocity parameterization: rather than outputting a full d -dimensional vector field, the model learns scalar controls over a small set of fixed bracket-generating vector fields. Specifically, expressive generative behavior can be achieved using only a small number of scalar control functions, provided that the underlying vector fields are appropriately chosen and satisfy the bracket-generating condition of Theorem 4 . This perspective offers a structured way to steer the generative process through a low-dimensional set of learnable coefficients, effectively reusing a shared geometric backbone to produce complex transformations. This formulation motivates the construction presented in Algorithm 1 . 3.1. Geometric Control and Controlled Flows We begin by establishing the mathematical foundations of the framework. As stated in Theorem 4 , under mild regularity conditions, a suitable control system can steer any initial point to an arbitrary target point. Let \mu_{0} and \mu_{1} be two probability measures on (M,g) , and let \pi\in\Pi(\mu_{0},\mu_{1}) be a coupling between them. Definition 5 (Class of path bridges) . Let \mathcal{F} be a class of absolutely continuous curves \gamma:[0,1]\to M . We say that \mathcal{F} is a class of path bridges if it satisfies the following properties: (1) Endpoint connectivity: for every pair (x_{0},x_{1})\in M\times M , there exists a path \gamma^{x_{0},x_{1}}\in\mathcal{F} such that \gamma^{x_{0},x_{1}}(0)=x_{0},\gamma^{x_{0},x_{1}}(1)=x_{1}. (2) Measurable selection: there exists a measurable map, \displaystyle\Gamma:M\times M\to\mathcal{F}, \displaystyle(x_{0},x_{1})\mapsto\gamma^{x_{0},x_{1}}, such that for

Read the complete text