NinA: Normalizing Flows in Action. Training VLA Models with Normalizing Flows

Denis Tarasov, Alexander Nikulin, Ilya Zisman, Albina Klepach, Nikita Lyubaykin, Andrei Polubarov, Alexander Derevyagin, Vladislav Kurenkov · 2025

Read NinA: Normalizing Flows in Action. Training VLA Models with Normalizing Flows by Denis Tarasov, Alexander Nikulin, Ilya Zisman, Albina Klepach, Nikita Lyubaykin, Andrei Polubarov, Alexander Derevyagin, Vladislav Kurenkov (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-16845.txt.

Introduction

Denis Tarasov and co-authors swap diffusion for flow in robot action models in a 2025 paper. Such models read a scene and a task, then spit out the moves to make. Diffusion decoders draw good moves but need many steps to do so.

Their flow decoder draws a move in one shot through a flip able map. Built into a known robot model and tuned on a bench mark, it matched the diffusion build. One shot draws cut wait time at run time. Fast draws matter where robots must act at high rates in the real world, not just in lab tests.

Catalog record

CREATORDenis Tarasov, Alexander Nikulin, Ilya Zisman, Albina Klepach, Nikita Lyubaykin, Andrei Polubarov, Alexander Derevyagin, Vladislav Kurenkov
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE21 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-16845

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

NinA: Normalizing Flows in Action. Training VLA Models with Normalizing Flows Denis Tarasov, Alexander Nikulin, Ilya Zisman, Albina Klepach, Nikita Lyubaykin, Andrei Polubarov, Alexander Derevyagin, Vladislav Kurenkov Abstract Recent advances in Vision-Language-Action (VLA) models have established a two-component architecture, where a pre-trained Vision-Language Model (VLM) encodes visual observations and task descriptions, and an action decoder maps these representations to continuous actions. Diffusion models have been widely adopted as action decoders due to their ability to model complex, multimodal action distributions. However, they require multiple iterative denoising steps at inference time or downstream techniques to speed up sampling, limiting their practicality in real-world settings where high-frequency control is crucial. In this work, we present NinA (Normalizing Flows in Action), a fast and expressive alternative to diffusion-based decoders for VLAs. NinA replaces the diffusion action decoder with a Normalizing Flow (NF) that enables one-shot sampling through an invertible transformation, significantly reducing inference time. We integrate NinA into the FLOWER VLA architecture and fine-tune on the LIBERO benchmark. Our experiments show that NinA matches the performance of its diffusion-based counterpart under the same training regime, while achieving substantially faster inference. These results suggest that NinA offers a promising path toward efficient, high-frequency VLA control without compromising performance. 1 Introduction The field of general-purpose robotics has recently seen rapid progress driven by Vision-Language-Action (VLA) models ( Brohan et al. 2022 ; Zitkovich et al. 2023 ; Wu et al. 2023 ; Team et al. 2024 ; Kim et al. 2024 ; Black et al. ; Reuss et al. ) . These models combine pre-trained Vision-Language Models (VLMs) – leveraging large-scale multimodal pretraining with an action prediction module that outputs low-level robot commands given a textual goal description and visual observations of the environment. One particularly effective architectural pattern, first successfully demonstrated in \pi_{0} ( Black et al. ) and subsequently adopted in more advanced systems such as \pi_{0.5} ( Intelligence et al. 2025 ) and FLOWER ( Reuss et al. ) , involves splitting the VLA into two components: a frozen or fine-tuned VLM encoder and an action expert that maps VLM embeddings into continuous actions. Figure 1 : Comparison of model performance, size, and inference time on the LIBERO benchmark. Our NinA models (Transformer and MLP) achieve inference speeds up to 10x faster and require significantly fewer parameters compared to diffusion models, while maintaining comparable performance. In prior work, the action expert is almost always implemented using diffusion-based generative models. These models are well-regarded for their ability to capture complex, multi-modal action distributions and have achieved dominant status in many other generative domains such as image and audio synthesis ( Yang et al. 2023 ) . However, their autoregressive denoising process requires multiple forward passes during inference (or specialized acceleration methods that still incur additional computation), leading to latency bottlenecks, a critical concern for fine-grained, real-time robotic control ( Zhao et al. 2023 ) . We argue that Normalizing Flows (NFs) ( Dinh et al. 2014 ; Rezende & Mohamed 2015 ) offer a compelling alternative for the action expert. Like diffusion models, NFs can represent complex probability distributions, but they require only a single forward pass to generate an action. In addition, NFs natively provide exact likelihood estimation and support variational inference, features that could be valuable for downstream tasks such as reinforcement learning (RL), uncertainty estimation, or interpretability ( Zhai et al. 2024 ) . Recent works have also demonstrated the potential of NFs in imitation learning and RL ( Akimov et al. 2022 ; Ghugare & Eysenbach 2025 ) . In this preliminary work, we introduce N ormalizing Flows in A ction ( NinA ) – a VLA variant that replaces the diffusion-based action expert with a normalizing flow model. Using the FLOWER VLA ( Reuss et al. ) as our base architecture, we fine-tune NinA and the original diffusion-based FLOWER on the LIBERO benchmark, finding that NFs can match the performance of state-of-the-art diffusion experts while being significantly faster at inference and requiring fewer parameters. We also investigate key design choices for NinA, including backbone architecture (MLP vs. Transformer ( Vaswani et al. 2017 ) ) and the impact of various hyperparameters, to better understand the trade-offs involved in adopting flows for robotic control. 2 Preliminaries 2.1 Normalizing Flows Normalizing Flows (NFs) ( Dinh et al. 2014 ; Rezende & Mohamed 2015 ) are a family of generative models that represent a complex probability distribution by applying a sequence of invertible transformations to a simple base distribution (e.g., a Gaussian). Let \mathbf{z}_{0}\sim p_{0}(\mathbf{z}_{0}) denote a sample from the base distribution and f_{\theta}=f_{K}\circ\dots\circ f_{1} be a composition of K invertible mappings with tractable Jacobian determinants. The transformed variable \mathbf{z}_{K}=f_{\theta}(\mathbf{z}_{0}) follows the distribution \log p_{\theta}(\mathbf{z}_{K})=\log p_{0}(\mathbf{z}_{0})-\sum_{k=1}^{K}\log\left|\det\frac{\partial f_{k}}{\partial\mathbf{z}_{k-1}}\right|. (1) The exact likelihood calculation enables direct maximum likelihood training and facilitates uncertainty estimation, variational inference, and probabilistic reasoning. Inference is efficient, requiring only a single forward pass through the sequence of transformations to produce a sample. 2.2 Vision-Language-Action Models Objective Vision-Language-Action (VLA) models extend vision-language models by adding an action expert that maps multimodal representations to continuous control commands. Given a visual observation \mathbf{o}_{t} and a textual instruction \mathbf{g} , a VLA model first encodes these inputs into a joint embedding \mathbf{h}_{t} using a pre-trained or fine-tuned vision-language backbone: \mathbf{h}_{t}=\mathrm{VLM}(\mathbf{o}_{t},\mathbf{g}). (2) The action expert \pi_{\theta} then generates an action or a chunk of actions \mathbf{a}_{t}\sim\pi_{\theta}(\cdot\mid\mathbf{h}_{t}) in the robot action space. For imitation learning, the objective is to maximize the log-likelihood of expert actions: \mathcal{L}_{\mathrm{VLA}}(\theta)=\mathbb{E}_{(\mathbf{o}_{t},\mathbf{g},\mathbf{a}_{t})\sim\mathcal{D}}\left[\log\pi_{\theta}(\mathbf{a}_{t}\mid\mathrm{VLM}(\mathbf{o}_{t},\mathbf{g}))\right], (3) where \mathcal{D} is a dataset of demonstration trajectories. This modular design enables one to swap different action experts, such as diffusion models or normalizing flows, while reusing the same vision-language backbone. 3 Methodology NinA implements Normalizing Flows (NFs) similar to RealNVP ( Dinh et al. 2016 ) in two variants: an MLP-based architecture inspired by Ghugare & Eysenbach 2025 and a Transformer-based architecture inspired by Jet ( Kolesnikov et al. 2024 ) . The MLP variant enables faster inference and reduced memory consumption, while the Transformer variant offers better performance and scalability. During training, state–goal–action chunks (\mathbf{o}_{t},\mathbf{g},\mathbf{a}_{t}) are sampled from the dataset \mathcal{D} . The state \mathbf{o}_{t} and goal \mathbf{g} are passed through a pretrained VLM to obtain embeddings \mathbf{h}_{t} . We add Gaussian noise \mathcal{N}(0,\sigma^{2}_{\mathrm{noise}}) to the action chunks, following the beneficial practice for NFs proposed by Zhai et al. 2024 . While this technique has not been nicely ablated in the context of continuous control ( Ghugare & Eysenbach 2025 ) , our experiments confirm its utility. We also find that the noise amplitude is a critical hyperparameter and report an ablation study on its effect. The noised actions \mathbf{\hat{a}}_{t} (treated as \mathbf{z}_{K} ) are passed through a sequence of flow layers f_{k} . In each layer, \mathbf{a}_{t} is randomly split into two equal parts, x_{1} and x_{2} . For the MLP-based approach, \mathbf{\hat{a}}_{t} is treated as a single real-valued vector and split element-wise. For the Transformer-based model, \mathbf{\hat{a}}_{t} is treated as a sequence, and the split is performed sequence-wise, meaning that each action appears fully in either x_{1} or x_{2} . Next, x_{1} is passed through a trainable network g_{\phi_{k}}(x_{1},\mathbf{h}_{t}) to produce scale and bias terms (s,b) , conditioned on the VLM output. In the

Read the complete text