RiboGen: RNA Sequence and Structure Co-Generation with Equivariant MultiFlow
Dana Rubin, Allan dos Santos Costa, Manvitha Ponnapati, Joseph Jacobson · 2025
Read RiboGen: RNA Sequence and Structure Co-Generation with Equivariant MultiFlow by Dana Rubin, Allan dos Santos Costa, Manvitha Ponnapati, Joseph Jacobson (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-02058.txt.
Introduction
Dana Rubin and co-authors introduce a model that designs RNA molecules together with their three-dimensional shapes, in a 2025 paper. RNA carries messages, catalyzes reactions, and regulates genes. Designing new RNA could unlock therapies and biotech tools. Most generators produce either the letter sequence or the shape, not both at once.
Their model, RiboGen, generates the two together. It pairs flow methods for continuous shapes with a discrete version for letters. Its network respects three-dimensional symmetry, so rotations do not confuse it. Samples came out chemically plausible and self-consistent. Designing sequence and structure in one pass may beat pipelines that bolt the two steps together.
Catalog record
| CREATOR | Dana Rubin, Allan dos Santos Costa, Manvitha Ponnapati, Joseph Jacobson |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 22 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-02058
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
RiboGen: RNA Sequence and Structure Co-Generation with Equivariant MultiFlow Dana Rubin, Allan dos Santos Costa, Manvitha Ponnapati, Joseph Jacobson Abstract Ribonucleic acid (RNA) plays fundamental roles in biological systems, from carrying genetic information to performing enzymatic function. Understanding and designing RNA can enable novel therapeutic application and biotechnological innovation. To enhance RNA design, in this paper we introduce RiboGen, the first deep learning model to simultaneously generate RNA sequence and all-atom 3D structure. RiboGen leverages the standard Flow Matching with Discrete Flow Matching in a multimodal data representation. RiboGen is based on Euclidean Equivariant neural networks for efficiently processing and learning three-dimensional geometry. Our experiments show that RiboGen can efficiently generate chemically plausible and self-consistent RNA samples, suggesting that co-generation of sequence and structure is a competitive approach for modeling RNA. 1 Introduction Ribonucleic acid (RNA) is a fundamental biomolecule that stands at the intersection of modern biology and the origins of life. RNA has proven to be a versatile molecule, playing key roles in messaging ( Crick 1970 ) , catalytic functions ( Altman & Guerrier-Takada 1983 ) , regulation, and diverse biological processes through its complex 3D structures ( Fire et al. 1998 ) . While traditional computational methods faced limitations in decoding RNA structure and facilitating RNA design, deep learning emerged as powerful approach to accurately predict RNA structures, enhance RNA engineering, and unlock new insights into its functional roles. Existing deep learning models often predict RNA structure from sequence or design sequences for target structures independently. However, the ability to simultaneously generate both sequence and structure remains a largely unexplored space in deep learning-based modeling of RNA. This co-generation capability can enable exploration of the sequence-structure landscape in novel ways. To address this gap, in this paper we introduce RiboGen for joint generation of all-atom structure and sequence of RNA. RiboGen is based on a Multiflow ( Campbell et al. 2024 ) model that draws on Flow Matching ( Lipman et al. 2022 ; Liu et al. 2022 ) and Discrete Flow ( Gat et al. 2024 ; Campbell et al. 2024 ) for its generation. We train a large model and evaluate its chemical validity and self-consistency. Our results showcase the capabilities of RiboGen for generation and highlight that co-generation models are a promising avenue for modeling of RNA. 1.1 Related Work Previous work in deep learning for RNA design has made significant progress in computational approaches to predict RNA structures ( Shen et al. 2024 ; Abramson et al. 2024 ) , RNA-RNA interactions, and the design of novel RNA sequences. Recent progress in generative modeling for RNA focuses on sequence and structure generation through Denoising Diffusion Probabilistic Models (DDPM) ( Ho et al. 2020 ) or Flow Matching ( Lipman et al. 2022 ) . MMDiff ( Morehead et al. 2023a ) uses discrete DDPM to co-generate sequence and structure of RNA, DNA and proteins. Our approach instead employs Flow Matching and its discrete variant ( Campbell et al. 2024 ) . RNA-FrameFlow ( Anand et al. 2024 ) represents RNA through rigid body frames and uses flow matching to generate 3D backbones, employing inverse folding model gRNAde ( Joshi et al. 2023 ) to obtain sequences. In contrast, while similarly using Flow Matching for 3D generation, our approach additionally models the discrete sequence components of RNA generation. RNAFlow Nori & Jin 2024 uses a GNN conditioned on protein structure and sequence to generate RNA sequences, which are then processed by RoseTTAFold2NA Baek 2024 to predict backbone structure; this method additionally conditions on protein structure as input. Our approach instead focuses on isolated RNA, learning unconditional direct sequence-structure generation. Recent application of the Multiflow ( Campbell et al. 2024 ) framework to protein sequence-structure design has demonstrated the power of joint generation. Our approach builds upon on these insights from protein design, and adapts them to the RNA design domain by enabling the joint generation of RNA sequences and all-atom structures. Figure 1: RNA Sequence and Structure Co-Generation : (a) Traditional molecular structure showing the nucleotides with atoms and bonds. Right side demonstrates how each nucleotide (G, A, C, U) is represented as both a discrete sequence element (colored boxes) and associated 3D point cloud representation (colored directional features) centered around the C3^{\prime} atom. (b) The RiboGen model architechture: the model takes noised input of sequence and geometric features \mathbf{R}_{t} , and a time parameter t , process them through the base network and simultaneously predicts three components: the RNA sequence, central coordinates, and 3D features. These components are combined to produce the final RNA structure prediction \hat{\mathbf{R}}_{1} . 2 Methods 2.1 RNA Representation We represent an RNA molecule as a sequence and a 3D gas of geometric features \mathbf{R}=(\mathbf{S},\mathbf{X},\mathbf{V}) (Figure 1 .a), where: • \mathbf{S}\in\mathcal{S}^{N} is sequence of length N , formed out of standard nucleotides \mathcal{S}=\{A,C,G,U\} . • \mathbf{X}\in\mathbb{R}^{N\times 3} contains the 3D coordinates of the C3’ atom for each nucleotide, chosen as the reference center . • \mathbf{V}\in\mathbb{R}^{N\times 24\times 3} are geometric features encoding the relative position of up to 24 heavy atoms per nucleotide to its center at C3’, in canonical ordering. This representation encompasses both the sugar-phosphate backbone atoms and the base atoms, allowing for complete reconstruction of the RNA structure. Nucleotides that have fewer than 24 heavy atoms have their corresponding channels of \mathbf{V} padded with zeros. After generating the three components, the predicted vectors \mathbf{V} are added to the predicted centers \mathbf{X} and the sequence \mathbf{S} is utilized for labeling nucleotides and atomic types, for full reconstruction of 3D atomic coordinates. This representation encodes both the chemical identity and geometry of each nucleotide while preserving rotational and translational equivariance, which is essential for downstream learning via Euclidean Equivariant Neural Networks. 2.2 Flow Matching To model the distribution of 3D RNA coordinates \mathbf{X} and features \mathbf{V} we use Flow Matching ( Lipman et al. 2022 ; Liu et al. 2022 ; Albergo et al. 2023 ) . Flow Matching parameterizes a conditional probability path \rho_{t}(\mathbf{X}_{t}|\mathbf{X}_{1}) on time t by learning a conditional velocity field \hat{v}^{\theta}_{t}(\mathbf{X}_{t})\approx v_{t}(\mathbf{X}_{t}|\mathbf{X}_{1}) that transforms samples from a prior distribution \mathbf{X}_{0}\sim\rho_{0}=\mathcal{N} to a target data distribution \mathbf{X}_{1}\sim\rho_{1}=\rho_{D} . To learn this transport, we use the standard form of Flow Matching to obtain a noised version of \mathbf{X}_{1} via the linear interpolant and its associated velocity: \mathbf{X}_{t}=(1-t)\mathbf{X}_{0}+t\mathbf{X}_{1} (1) v_{t}(\mathbf{X}_{t}|\mathbf{X}_{1})=\mathbf{X}_{1}-\mathbf{X}_{0} (2) We build our model to reconstruct the target \hat{\mathbf{X}}^{\theta}_{1|\mathbf{X}_{t}}\approx\mathbf{X}_{1} from its noised counterpart \mathbf{X}_{t} . We follow the reparameterization of ( Jing et al. 2024 ; Pooladian et al. 2023 ) and obtain the learned conditional velocity through: v_{t}^{\theta}(\mathbf{X}_{t})=\frac{1}{(1-t)}\Big(\hat{\mathbf{X}}^{\theta}_{1|\mathbf{X}_{t}}-\mathbf{X}_{t}\Big)\approx v_{t}(\mathbf{X}_{t}|\mathbf{X}_{1}) (3) We then sample our learned model via integration \mathbf{X}_{1}=\mathbf{X}_{0}+\int_{0}^{1}v_{t}^{\theta}(\mathbf{X}_{t})dt where \mathbf{X}_{0}\sim\mathcal{N} . 2.3 Discrete Flow Matching While the standard form of Flow Matching is effective for continuous data, it is not appropriate for categorical domains. Hence, for modeling the RNA sequence we employ the extended framework of Discrete Flow Matching ( Gat et al. 2024 ; Campbell et al. 2024 ) . In this setting, the sequence data \mathbf{S}\in\mathcal{S}^{N} is described over a vocabulary \mathcal{S} . We parameterize a discrete flow by describing the velocity field over a probability vector on this categorical space: \mathbf{S}_{t}\sim\textrm{Cat}((1-t)\delta_{\mathbf{S}_{0}}+t\delta_{\mathbf{S}_{1}}) (4) v_{t}(\mathbf{S}_{t}|\mathbf{S}_{1})=\delta_{\mathbf{S}_{1}}-\delta_{\mathbf{S}_{0}} (5) where \delta_{\mathbf{S}}\in\mathbb{R}^{N\times|\mathcal{X}|} is the Dirac delta