Unified all-atom molecule generation with neural fields

Matthieu Kirchmeyer Pedro O. Pinheiro Emma Willett Karolis Martinkus, Joseph Kleinhenz Emily K. Makowski Andrew M. Watkins, Vladimir Gligorijevic Richard Bonneau Saeed Saremi · 2025

Read Unified all-atom molecule generation with neural fields by Matthieu Kirchmeyer Pedro O. Pinheiro Emma Willett Karolis Martinkus, Joseph Kleinhenz Emily K. Makowski Andrew M. Watkins, Vladimir Gligorijevic Richard Bonneau Saeed Saremi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-15906.txt.

Introduction

Matthieu Kirchmeyer, Pedro O. Pinheiro, and eight co-authors introduce FuncBind, a generative framework that designs molecules atom by atom for a chosen target. Structure-based drug design tools are often built for one kind of system only, which limits their reach. FuncBind instead represents molecules as continuous atomic density fields, borrowing neural field methods from computer vision, and generates them with score-based models.

One unified model trains across diverse atomic systems, from small molecules to large ones, handling varying atom and residue counts and even nonstandard amino acids. It performs competitively in computer tests on small molecules, macrocyclic peptides, and antibody binding loops. It also produced new antibody binders verified in laboratory experiments.

Catalog record

CREATORMatthieu Kirchmeyer Pedro O. Pinheiro Emma Willett Karolis Martinkus, Joseph Kleinhenz Emily K. Makowski Andrew M. Watkins, Vladimir Gligorijevic Richard Bonneau Saeed Saremi
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE62 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-15906

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Unified all-atom molecule generation with neural fields Matthieu Kirchmeyer Pedro O. Pinheiro Emma Willett Karolis Martinkus, Joseph Kleinhenz Emily K. Makowski Andrew M. Watkins, Vladimir Gligorijevic Richard Bonneau Saeed Saremi Abstract Generative models for structure-based drug design are often limited to a specific modality, restricting their broader applicability. To address this challenge, we introduce FuncBind, a framework based on computer vision to generate target-conditioned, all-atom molecules across atomic systems. FuncBind uses neural fields to represent molecules as continuous atomic densities and employs score-based generative models with modern architectures adapted from the computer vision literature. This modality-agnostic representation allows a single unified model to be trained on diverse atomic systems, from small to large molecules, and handle variable atom/residue counts, including non-canonical amino acids. FuncBind achieves competitive in silico performance in generating small molecules, macrocyclic peptides, and antibody complementarity-determining region loops, conditioned on target structures. FuncBind also generated in vitro novel antibody binders via de novo redesign of the complementarity-determining region H3 loop of two chosen co-crystal structures. As a final contribution, we introduce a new dataset and benchmark for structure-conditioned macrocyclic peptide generation * * * The code is available at https://github.com/prescient-design/funcbind . The checkpoints at https://huggingface.co/mkirchmeyer/funcbind/ . † \dagger Equal contribution, ‡ \ddagger work done at Genentech. Correspondence to [email protected] , [email protected] , [email protected] . 1 Introduction A central challenge in drug discovery is designing molecules that bind specifically to a target protein 4 . This task involves navigating a diverse landscape of molecular modalities, from small organic compounds to large biomolecules, each with unique chemical properties. Structure-based approaches are frequently employed to meet this challenge, utilizing the 3D structure of a target site (often an accessible protein region) to generate novel molecules with high affinity. Generative models are emerging as a powerful data-driven alternative to established traditional techniques such as virtual screening and physics-based simulations. These newer models can explore vast chemical spaces more effectively to identify molecules with desired binding properties 79 . Most structure-based generative models specialize on a single molecule modality to better account for specific physicochemical properties. Focusing on a single molecular modality also simplifies data gathering and augmentation, training, representation choice, and metrics used for validation. Generative models of small molecules typically represent molecules as point cloud of atoms 56 ; 27 ; 59 or discretized atomic densities 60 ; 57 . Most protein generative models leverage the fact that proteins are sequences of amino acids to represent them with point clouds of residues, where each residue contains multiple atoms 83 , recovering their sequences with, e.g. , co-generation 5 or inverse folding 15 . Many protein-centric models also rely on large sequence databases and self-supervised generative models for sequence that can help in scoring and generating/proposing mutations. Domain-specific representations limit generalization, as models are not transferable from one modality to another. This narrow focus also limits utility, as most key applications involve interfaces and catalysis across multiple modalities. We argue that modality-agnostic representations are better suited to a wide range of tasks and can learn physical properties across diverse atomic systems, thus leveraging more training data and more challenging metrics. These representations are more expressive 8 as evidenced by the successes of cross-modality models on structure prediction 1 ; 40 , inverse folding 25 or molecular interaction prediction 39 . Here, we introduce FuncBind , a unified and scalable framework for generating all-atom molecular systems conditioned on target structures. Following Kirchmeyer et al. 36 , we represent molecules with neural fields : functions that map 3D coordinates to atomic densities. Neural fields are a compact and scalable alternative to voxels, while sharing many common advantages over point cloud-based representations: they (i) are compatible with expressive neural network architectures (such as CNNs and transformers), (ii) account for variable number of atoms and residues implicitly, and (iii) can represent molecules across modalities with an all-atom formulation. Using this new representation, we build a latent conditional generative model compatible with any score-based approaches. We tested denoising diffusion ( 75 ) and walk-jump sampling (WJS) ( 70 ) , a sampling approach that enjoys fast-mixing and training simplicity when compared to diffusion models, largely because it only relies on one or few noise levels. We train FuncBind on structures from three drug modalities: small molecules, macrocyclic peptides (MCPs), and antibody complementarity-determining region (CDR) loops in complex with a target protein. These modalities encompass a range of chemical matter with challenging constraints, such as cyclic backbones and non-canonical amino acids. FuncBind achieves competitive results on in silico benchmarks, matching or outperforming modality-specific baselines. On in vitro experiments, we show that FuncBind can produce novel antibody binders by redesigning the CDR H3 loop of two chosen co-crystal structures. We also create a new dataset † † † available at https://huggingface.co/datasets/Willete3/mcpp_dataset , containing \sim 190,000 synthetic MCP/protein complexes derived from 641 RCSB PDB structures ( 11 ) , particularly relevant for this work, as cyclic peptides exhibit chemistry and function that span small and large molecule modalities. 2 Related work Pocket-conditioned small molecule generation. Several approaches have framed structure-based drug design as a generative modeling problem ( 18 ) . These methods commonly represent molecules—including both ligands and targets—either as point clouds of atoms or as voxel grids. Point-cloud approaches represent atoms as points in 3D space, along with their atomic types, and typically use graph neural network architectures. Point-cloud approaches have been used to generate molecules using autoregressive models ( 47 ; 43 ; 56 ) , iterative sampling approaches ( 2 ; 88 ; 58 ) , normalizing flows ( 68 ) , diffusion models ( 73 ; 27 ; 28 ) , and Bayesian flow networks ( 59 ) . Voxel-based approaches map atomic densities to 3D discrete voxel grids and apply computer vision techniques for generation ( 74 ; 60 ; 81 ; 44 ) . VoxBind ( 57 ) demonstrates that voxel-based representations achieve state-of-the-art results using expressive vision-based networks and score-based generative models. However, raw voxel-based models do not currently scale to larger molecules due to high memory requirements. Neural fields serve as the continuous analogue to discrete voxels, a technique widely adopted in 3D computer vision ( 86 ) . When applied to molecular generation, these fields match existing performance levels while demonstrating superior memory and computational efficiency ( 36 ) . Antigen-conditioned CDR loop generation. Antibody design is an active research topic and antibody-based treatments represented 26% of 2024 FDA approvals ( 50 ) (with related biologics approvals an even higher fraction). A key line of antibody engineering work re-designs the complementarity-determining regions (CDRs), a subset of the heavy and light chains that totals 48 to 82 residues ( 14 ) and represents most of the protein’s affinity determining variability. A recent approach is to co-design the CDRs sequences and structures using residue cloud representations and equivariant graph neural networks ( 31 ; 30 ; 37 ; 38 ) , combining these representations with diffusion models for generation ( 46 ; 90 ) . Other works leverage protein language models ( 89 ; 85 ) , or revisit the problem by proposing new representations that incorporate domain knowledge and physics-based constraints ( 48 ) . As is the case for most

Read the complete text