STAR-VAE: Latent Variable Transformers for Scalable and Controllable Molecular Generation

Bum Chul Kwon, Ben Shapira, Moshiko Raboh, Shreyans Sethi, Shruti Murarka, Joseph A Morrone, Jianying Hu, Parthasarathy Suryanarayanan · 2025

Read STAR-VAE: Latent Variable Transformers for Scalable and Controllable Molecular Generation by Bum Chul Kwon, Ben Shapira, Moshiko Raboh, Shreyans Sethi, Shruti Murarka, Joseph A Morrone, Jianying Hu, Parthasarathy Suryanarayanan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-02769.txt.

Introduction

Bum Chul Kwon and nine colleagues built STAR-VAE, a model that generates new molecules under user control. Many molecular transformers lack a proper latent space, so users cannot sample variations or steer properties smoothly. Their 2025 model pairs a bidirectional encoder with an autoregressive decoder, pretrained on 79 million molecules from PubChem written in SELFIES notation.

A property signal conditions the prior, the posterior, and the decoder at once, so generation can aim at chosen traits. Light LoRA adapters allow fine-tuning on small data without touching the backbone. Under standard sampling the model produced fully valid molecules with near-perfect novelty, and it steered traits like synthetic accessibility and docking scores for several protein targets. Seed-based sampling also recovered known scaffolds for drug targets.

Catalog record

CREATORBum Chul Kwon, Ben Shapira, Moshiko Raboh, Shreyans Sethi, Shruti Murarka, Joseph A Morrone, Jianying Hu, Parthasarathy Suryanarayanan
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE32 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-02769

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

STAR-VAE: Latent Variable Transformers for Scalable and Controllable Molecular Generation Bum Chul Kwon, Ben Shapira, Moshiko Raboh, Shreyans Sethi, Shruti Murarka, Joseph A Morrone, Jianying Hu, Parthasarathy Suryanarayanan Abstract 1 Abstract The chemical space of drug-like molecules is vast, motivating the development of generative models that must learn broad chemical distributions, enable conditional generation by capturing structure-property representations, and provide fast molecular generation. Meeting the objectives depends on modeling choices, including the probabilistic modeling approach, the conditional generative formulation, the architecture, and the molecular input representation. To address these challenges, we present STAR-VAE ( S elfies-encoded , T ransformer-based , A uto R egressive V ariational A uto E ncoder), a scalable latent‑variable framework with a Transformer encoder and an autoregressive Transformer decoder. It is trained on 79 million drug-like molecules from PubChem, using SELFIES to guarantee syntactic validity. The latent-variable formulation enables conditional generation: a property predictor supplies a conditioning signal that is applied consistently to the latent prior, the inference network, and the decoder. Our contributions are: (i) a Transformer-based latent-variable encoder-decoder model trained on SELFIES representations; (ii) a principled conditional latent-variable formulation for property-guided generation; and (iii) efficient finetuning with low-rank adapters (LoRA) in both encoder and decoder, enabling fast adaptation with limited property and activity data. On the GuacaMol and MOSES benchmarks, our approach matches or exceeds baselines, and latent-space analyses reveal smooth, semantically structured representations that support both unconditional exploration and property-aware generation. On the Tartarus benchmarks, the conditional model shifts docking-score distributions toward stronger predicted binding. These results suggest that a modernized, scale-appropriate VAE remains competitive for molecular generation when paired with principled conditioning and parameter-efficient finetuning. 2 Introduction The space of synthesizable small molecules is estimated to exceed 10^{33} compounds [ 1 ] , far beyond what can be exhaustively enumerated or tested experimentally. Generative modeling provides a principled approach to explore chemical space efficiently, enabling models to capture the diversity of synthesizable molecules while focusing generation toward molecules with desirable properties. To be practically useful, such models must address three intertwined requirements: they should learn broad chemical distributions that capture the diversity of synthesizable molecules [ 2 ] , enable conditional generation guided by structure–property relationships [ 3 ] , and support fast, realistic molecular generation. Meeting these objectives depends critically on modeling choices, including the probabilistic framework, the formulation of conditional generation, the model architecture, and the molecular input representation. Recent advances in molecular generative modeling span several families, including autoregressive models that generate molecules token by token [ 4 , 5 ] , variational autoencoders that learn smooth latent spaces [ 6 , 7 , 8 ] , and iterative refinement methods such as diffusion and flow matching models. These approaches achieve strong benchmark performance, but underlying learning tasks naturally split into distribution learning versus goal‑oriented (generation/optimization) objectives [ 9 ] , and integrating both in a single, theoretically coherent framework remains challenging. At the same time, scaling to very large datasets and multi-billion-parameter decoders has improved validity and diversity, but at substantial computational cost. Furthermore, property-guided generation remains limited by the availability of labeled data, as effective conditioning typically requires high-quality property annotations that are expensive to obtain. In this work, we revisit latent-variable generative modeling as a competitive alternative. We present STAR-VAE, a scalable conditional variational autoencoder (VAE) framework that combines a bi-directional Transformer encoder with an autoregressive Transformer decoder. The model is trained on 79M drug-like molecules curated from PubChem, using SELFIES representations to ensure syntactic validity of generated molecules. The latent-variable formulation provides a principled basis for conditional generation: a property predictor, finetuned from the pretrained encoder, leverages chemical features captured during generative pretraining and supplies a single conditioning signal that consistently shapes the latent prior, the inference network, and the decoder. This design enables property-aware conditional generation using limited labeled data, while retaining the ability to learn broad molecular distributions. To further improve efficiency, we introduce low-rank adaptation (LoRA) in both encoder and decoder, allowing conditional finetuning with small data and modest compute. Our contributions are threefold: (i) a Transformer-based latent-variable encoder–decoder trained on SELFIES, (ii) a principled conditional latent-variable formulation for property-guided generation, and (iii) efficient conditional finetuning with low-rank adapters (LoRA) applied in both encoder and decoder, enabling fast adaptation with limited property and activity data. We evaluate the framework on GuacaMol [ 10 ] , MOSES [ 11 ] benchmarks for unconditional generation, finding that it matches or exceeds strong baselines under comparable budgets. Using the datasets from Tartarus [ 12 ] protein–ligand design benchmark, we conditioned molecule generation on docking scores for three protein targets. Unlike prior work that optimizes for a single best-scoring ligand, our approach shifts the overall distribution toward stronger predicted binding affinities, producing many high-scoring and diverse molecules. For two protein targets (1SYH and 6Y2F), the conditional VAE generated molecules whose docking score distribution was statistically stronger than that produced by the baseline VAE, which demonstrates that the latent‑variable conditioning captures target‑specific molecular features. Latent-space analyses further reveal smooth, semantically structured embeddings that support both unconditional exploration and property-aware steering. These results suggest that a modernized, scale-appropriate VAE remains competitive for molecular generation when paired with robust tokenization, principled conditioning, and parameter-efficient finetuning. 3 Related Work Generative modeling has emerged as a central paradigm for molecular design, enabling data-driven exploration of the vast chemical space through learned distributions rather than exhaustive enumeration. A wide range of models have been proposed for molecular generation, spanning variational autoencoders, generative adversarial networks [ 13 , 14 ] , normalizing flows [ 15 ] , and score and diffusion-based methods [ 16 , 17 , 18 ] . Here, we focus on developments most relevant to our approach: probabilistic latent variable models and Transformer-based molecular generators, which together trace the evolution from early VAEs to modern large-scale molecular foundation models. Variational Autoencoders. Variational autoencoders (VAEs) have significantly influenced molecular generation due to their ability to create smooth latent spaces amenable to interpolation and optimization. Gómez-Bombarelli et al. [ 6 ] applied a Variational Autoencoder (VAE) framework for automatic chemical design, utilizing SMILES [ 19 ] strings as their molecular representation. Their implementation featured a convolutional network as the encoder and recurrent neural networks (GRUs) as the decoder; a primary limitation of this approach was its reliance on a text-based SMILES representation, which inherently struggled with generating chemically valid structures without post-validation. GrammarVAE [ 7 ] addressed this by encoding parse trees as per context-free grammars, guaranteeing syntactic validity during generation. Syntax-Directed VAE (SD-VAE) [ 8 ] extended this to include semantic constraints via attribute grammars. Moving to graph structures, GraphVAE [ 20 ] introduced a variational autoencoder that directly outputs a probabilistic fully-connected graph of a predefined maximum size to sidestep the hurdles associated with linearizing discrete graph structures for generation. GF-VAE [ 21 ] further advanced this direction by coupling a graph-based encoder with a normalizing-flow decoder, enabling exact likelihood estimation and improving training stability on molecular graphs. Junction-Tree VAE [ 22 ] took a complementary approach, first generating a scaffold tree of chemical substructures and then assembling a valid molecular graph. Conditional VAEs (CVAEs) [ 23 , 24 ] extended the paradigm to property-aware generation by incorporating property vectors

Read the complete text