Learning Collective Variables from Time-lagged Generation

Seonghyun Park, Kiyoung Seong, Soojung Yang, Rafael Gomez-Bombarelli, Sungsoo Ahn · 2025

Read Learning Collective Variables from Time-lagged Generation by Seonghyun Park, Kiyoung Seong, Soojung Yang, Rafael Gomez-Bombarelli, Sungsoo Ahn (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-07390.txt.

Introduction

Seonghyun Park and co-authors learn, in a 2025 paper, the few key coordinates that capture a protein's slow motions, using a generative model as the teacher. Molecular simulations stall on rare events like folding, and speeding them up needs good collective variables, the dials along which change is pushed. Finding those dials by hand is a notorious bottleneck. The authors repurpose a foundation model that generates protein shapes at equilibrium.

Their framework trains the model to predict how a protein's shape distribution looks after a time lag, given the learned coordinates. That pressure forces the coordinates to keep slow, lasting information and drop fast noise. Tests on fast-folding proteins used the dials to estimate energy differences and to steer folding paths. The study doubles as a broad benchmark for learned collective variables.

Catalog record

CREATORSeonghyun Park, Kiyoung Seong, Soojung Yang, Rafael Gomez-Bombarelli, Sungsoo Ahn
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE37 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-07390

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Learning Collective Variables from Time-lagged Generation Seonghyun Park, Kiyoung Seong, Soojung Yang, Rafael Gomez-Bombarelli, Sungsoo Ahn Abstract Rare events such as state transitions are difficult to observe directly with molecular dynamics simulations due to long timescales. Enhanced sampling techniques overcome this by introducing biases along carefully chosen low-dimensional features, known as collective variables (CVs), which capture the slow degrees of freedom. Machine learning approaches (MLCVs) have automated CV discovery, but existing methods typically focus on discriminating meta-stable states without fully encoding the detailed dynamics essential for accurate sampling. We propose TLC, a framework that learns CVs directly from time-lagged conditions of a generative model. Instead of modeling the static Boltzmann distribution, TLC models a time-lagged conditional distribution yielding CVs to capture the slow dynamic behavior. We validate TLC on the Alanine Dipeptide system using two CV-based enhanced sampling tasks: (i) steered molecular dynamics (SMD) and (ii) on-the-fly probability enhanced sampling (OPES), demonstrating equal or superior performance compared to existing MLCV methods in both transition path sampling and state discrimination. 1 Introduction Understanding rare events in molecular systems, such as ligand binding in drug discovery ( De Vivo et al. 2016 ; Abel et al. 2017 ) , conformational changes in protein folding ( Piana et al. 2012 ; Seong et al. 2025 ) , and phase transformations in materials science ( Lookman et al. 2019 ; Spotte-Smith et al. 2022 ) is essential in biology and chemistry. However, these transitions involve crossing high free-energy barriers between meta-stable states, making them exceedingly rare and challenging to observe directly using conventional molecular dynamics (MD) simulations. To accelerate this sampling challenge, numerous enhanced sampling techniques have been developed. For example, replica-exchange MD ( Sugita & Okamoto 1999 ) exchanges configurations between parallel simulations at different temperatures, while accelerated MD ( Hamelberg et al. 2004 ) globally boosts the potential energy surface to overcome energy barriers. Many prominent enhanced sampling techniques, including Metadynamics ( Barducci et al. 2011 ) and on-the-fly probability enhanced sampling ( Invernizzi & Parrinello 2020 , OPES) , rely on biasing the simulations along a molecular configuration projected onto a set of coordinates, known as Collective Variables . Collective variables (CVs) are low-dimensional functions of atomic coordinates designed to represent the transition-relevant slow degree of freedom ( Torrie & Valleau 1977 ; Valsson et al. 2016 ) . For example, in Alanine Dipeptide, the two dihedral angles of the backbone atoms are considered the CVs. By applying biases along these CVs in simulations, enhanced sampling techniques efficiently drive the configuration over energy barriers and enable transitions between meta-stable states. For example, Metadynamics ( Barducci et al. 2011 ) and OPES ( Invernizzi & Parrinello 2020 ) employ time-dependent bias potentials to progressively fill free-energy wells along the CV space, thereby accelerating transitions. Furthermore, steered molecular dynamics ( Izrailev et al. 1999 ; Fiorin et al. 2013 , SMD) adds a harmonic restraint along the CVs, pulling the molecular configuration from one state to another. Recently, machine learning (ML) methods have emerged as a promising approach for automating CV discovery, reducing reliance on human intuition, domain knowledge, and extensive trial and error. Supervised methods, such as DeepLDA ( Bonati et al. 2020 ) and DeepTDA ( Trizio & Parrinello 2021 ) , train neural networks to discriminate labeled meta-stable states. Time-lagged methods, including DeepTICA ( Bonati et al. 2021 ) and time-lagged autoencoders ( Bonati et al. 2021 ; Wehmeyer & Noé 2018 , TAE) explicitly incorporate temporal correlations by reconstructing or predicting time-lagged configurations. In this work, we propose TLC, a novel framework for discovering CVs from time-lagged conditional distributions learned via generative modeling. Using the transferable Boltzmann generators ( Klein & Noé 2024 , TBG) , we model the time-lagged conditional distribution p(x_{t+\tau}\mid x_{t}) for a time lag \tau , rather than the equilibrium Boltzmann distribution p(x) . Inspired by the concept of time-lagged encoder ( Wehmeyer & Noé 2018 , TAE) , we encode a molecular configuration x_{t} into a low-dimensional condition s_{t} and train the generative model to predict a time-lagged configuration x_{t+\tau} resulting CVs to capture slow dynamics. We compare TLC against existing MLCVs approaches with two downstream enhanced sampling techniques; on-the-fly probability enhanced sampling ( Invernizzi & Parrinello 2020 , OPES) and additionally steered molecular dynamics ( Izrailev et al. 1999 ; Fiorin et al. 2013 , SMD) , on the Alanine Dipeptide system without using any transition data. In short, our contributions can be summarized as follows: • We introduce a novel framework for learning collective variables from the time-lagged conditions of a generative modeling approach. • We demonstrate that our MLCVs captures the slow degree of freedom with two CV-based enhanced sampling techniques, achieving competitive or superior performance compared to existing methods. 2 Background Molecular dynamics simulations. Molecular dynamics (MD) describe the temporal evolution of molecular systems by integrating stochastic differential equations (SDEs). In particular, we consider under-damped Langevin dynamics ( Bussi & Parrinello 2007 ) , which combine deterministic forces with stochastic fluctuations as follows: \displaystyle\mathrm{d}x_{t} \displaystyle=v_{t}\,\mathrm{d}{t}\,, (1) \displaystyle\mathrm{d}v_{t} \displaystyle=\frac{-\nabla U(x_{t})}{m}\,\mathrm{d}{t}-\gamma v_{t}\,\mathrm{d}{t}+\sqrt{\frac{2\gamma k_{B}T}{m}}\,\mathrm{d}W_{t}\,. (2) Here, x_{t} and v_{t} denotes atomic position and velocity at time {t} , m the diagonal matrix consisting of the mass of the corresponding atom, U(x) the potential energy function, and \nabla U(x_{t}) its gradient concerning position, i.e., the negative force. Parameters \gamma , k_{B} , T , and W_{t} represent the friction coefficient, the Boltzmann constant, the absolute temperature, and the standard Brownian motion, respectively. Despite their theoretical accuracy, conventional MD simulations face practical time scale limitations that hinder observation of rare events, such as transitions between meta-stable states. Enhanced sampling. Enhanced sampling techniques play a vital role in modern simulation techniques, overcoming timescale limitations inherent to standard MD simulations enabling efficient exploration of rarely visited molecular states ( Torrie & Valleau 1977 ; Valsson et al. 2016 ; Invernizzi & Parrinello 2020 ; Barducci et al. 2011 ; Fiorin et al. 2013 ) . Many enhanced sampling techniques rely on collective variables (CVs) as a biasing coordinate, resulting simulations to facilitate transitions. For example, on-the-fly probability-enhanced simulations ( Invernizzi & Parrinello 2020 , OPES) construct time-dependent bias potential on previously observed CV values, accelerating rare transitions and exploring high-energy regions. Collective variables (CVs). CVs are low-dimensional functions of atomic coordinates designed to capture the system’s slow dynamical modes and essential transition pathways ( Bonati et al. 2023 ) . Formally, given a molecular configuration x\in\mathbb{R}^{3N} where N is the number of particles, CVs are defined by a small set of functions s=\{\xi_{i}(x)\}^{k}_{i=1}(k\ll 3N) where \xi_{i}(x) are scalar functions. For example, the two backbone dihedral angles \phi and \psi are the optimal CVs for the Alanine Dipeptide system. To use collective variables in enhanced sampling , e.q., Metadynamics ( Barducci et al. 2011 ) and umbrella sampling ( Torrie & Valleau 1977 ; Laio & Parrinello 2002 ) , it must satisfy three key criteria as follows: • Capable of distinguishing meta-stable states • Limited in number, ensuring low dimensionality • Encoding the slow degree of freedom, i.e., characterizing the correct transition state when using a biasing force or potential to overcome the energy barrier where the third criterion is considered particularly challenging ( Fu et al.

Read the complete text