Modeling Protein Evolution with Generative Models: from Extant Sequence Data to Evolutionary Dynamics

Matteo Bisardi, Leonardo Di Bari, Saverio Rossi, Karol Buda, Francesco Zamponi, Martin Weigt · 2026

Read Modeling Protein Evolution with Generative Models: from Extant Sequence Data to Evolutionary Dynamics by Matteo Bisardi, Leonardo Di Bari, Saverio Rossi, Karol Buda, Francesco Zamponi, Martin Weigt (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-29529.txt.

Introduction

Bisardi and five colleagues review how generative models, trained on families of related protein sequences, can shed light on protein evolution. A protein sequence records a past shaped by mutation, selection, drift, and epistasis, where one mutation's effect depends on others. A trained model defines a landscape that scores sequences, proposes plausible variants, and captures constraints that experiments struggle to measure.

The review centres on Direct Coupling Analysis, a clear and experimentally tested framework, set within the wider field. Early sections explain how such landscapes are inferred and assessed. Later sections couple the landscapes to population models of evolution, simulating change over lab and deep-time scales. Uses include viral evolution, lab drift experiments, and long-term exploration of sequence space. Open challenges close the review: calibrating scores against fitness, handling family tree structure, codon-level biases, insertions and deletions, and adding experimental data.

Catalog record

CREATORMatteo Bisardi, Leonardo Di Bari, Saverio Rossi, Karol Buda, Francesco Zamponi, Martin Weigt
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE95 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.29529

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Modeling Protein Evolution with Generative Models: from Extant Sequence Data to Evolutionary Dynamics Matteo Bisardi, Leonardo Di Bari, Saverio Rossi, Karol Buda, Francesco Zamponi, Martin Weigt Abstract Protein sequences carry a record of evolutionary history shaped by mutation, selection, drift, and epistasis. Recent generative models trained on homologous sequence families offer a new way to read this record: they define probabilistic landscapes that score sequences, generate viable variants, and capture constraints that are difficult to measure experimentally. In this review, we discuss how such landscapes can be used not only for protein design or mutation-effect prediction, but also for modeling evolutionary dynamics. We focus particularly on Direct Coupling Analysis as an interpretable and experimentally validated framework, while placing it in the broader context of generative sequence modeling. We first describe how generative sequence landscapes are inferred and assessed, then review how they can be coupled to population-genetic or substitution-model dynamics to simulate protein evolution across experimental and phylogenetic timescales. Applications include viral evolution, laboratory drift experiments, historical contingency, entrenchment, epistatic drift over time, and long-term sequence-space exploration. We conclude by discussing open challenges, including score–fitness calibration, phylogenetic structure, codon-level mutation biases, indels, and the integration of experimental data. I Introduction Throughout billions of years of evolutionary history, organisms have continuously adapted to ever-changing ecological niches. During this time, natural selection has generated an astounding diversity of molecular solutions to the challenges and opportunities encountered in the environment. Consequently, every extant organism carries a record of its evolutionary history written at the molecular scale. Thus, by studying the underlying variation in these biomolecules, it is possible to gain insight into the fundamental principles governing evolutionary dynamics. While the physical sciences have historically relied on universal mathematical laws to explain the natural world, our understanding of biology has often been distorted by system-specific complexity and apparent stochasticity stemming from historical contingency that arises during evolution. This distinction has frequently made it difficult to apply the rigorous, first-principles approach of physics to biological systems. Nevertheless, physicists’ and mathematicians’ interest in biological processes dates back many decades, leading to the application of mathematical methods across multiple biological disciplines. For a long time, however, these approaches remained largely theoretical. A lack of extensive, reliable genetic data limited the ability to directly confront mathematical models with reality, let alone with experiments. However, this situation has changed dramatically over the past few decades, with an explosion in both the quantity and quality of molecular biological data. In particular, the availability of large-scale protein sequence datasets, stemming from improvements in next-generation sequencing throughput and costs 156 , now enables a direct, high-resolution comparison between models and the actual evolutionary history of amino acid sequences. These developments in sequencing technology and data availability have paralleled the rise of powerful generative architectures in machine learning, inspired by physics like Boltzmann machines 1 and, more recently, rooted in natural language processing like transformers 157 . Just as unsupervised generative models trained on vast textual corpora have demonstrated remarkable capabilities in generating coherent text, similar advanced statistical tools are now being applied to the “language” of proteins. In this biological context, generative sequence models are trained on large sets of homologous protein sequences that display high sequence variability while retaining similar biological functions. These models have been applied to a wide range of problems, including protein structure prediction 89 , cellular localization 143 , mutation-effect prediction 25 , and the extraction of sequence representations useful for protein engineering 91 . By contrast, comparatively less attention has been devoted to the use of these models for studying and simulating protein evolution itself, even though evolution is precisely the process that generated these sequences and the underlying variation on which these models are trained. In this review, we place this question at the center. In other words, we move the focus from static properties and applications of generative sequence models to dynamical ones, in which sequence landscapes can be navigated in silico . More specifically, we argue that the synthetic fitness landscapes defined by generative sequence models provide a suitable effective space in which to model protein evolution. Unlike biophysical models that require the explicit encoding of structural or biochemical constraints, generative models infer the underlying constraints of protein “fitness” directly from the statistical patterns found in nature. As such, they represent effective and simplified descriptions of the complex genotype-to-fitness relationship that characterizes proteins. In this review, we introduce foundational concepts and methods of this emerging field and highlight recent advances arising from the synthesis of data-driven sequence landscapes and classical protein evolution modeling. In particular, we discuss how to integrate generative sequence landscapes with classical population genetic and substitution models to produce realistic simulations of protein evolution across a range of temporal and phylogenetic scales. We refer to this general methodology as generative protein evolution . While the methods and results discussed in this review apply in principle to every class of generative models, particular emphasis is placed on models based on Direct Coupling Analysis (DCA), which have thus far provided some of the most quantitative and interpretable applications of generative models to understand the evolutionary dynamics of protein sequences. Review structure In section II , we introduce generative sequence landscapes and how to construct them from collections of homologous protein sequences. In particular, we focus on a specific model, direct coupling analysis, in its generative version. We argue that it is a good proxy for realistic fitness landscapes, and we summarize a body of results that showcase its predictive ability and relevance to modeling evolution. In particular, we show that DCA captures epistatic constraints from sequence data, and we discuss their relevance for experimental fitness and natural mutability prediction as well as artificial protein generation. In section III , we present generative protein evolution models. We discuss two main approaches to modeling evolution on fitness landscapes: population genetics and substitution models. We outline their key differences and highlight how generative models can be incorporated into these evolutionary frameworks. We further establish a connection between classical substitution models and the Markov Chain Monte Carlo (MCMC) dynamics commonly used in statistical physics. This allows us to define, more generally, a class of substitution models that we call Generative Substitution Models (GSM). This methodological section aims to bridge these complementary perspectives and to develop a common language. In section IV , we collect and summarize the results published in the field of GSMs and generative population genetics modeling. We identify a few common themes and modeling goals, and we separate results based on the availability of experimental data to substantiate the predictions. The most timely application of these models relies on simulations and the prediction of short-time evolutionary dynamics, with a focus on pathogenic proteins. The comparison of synthetic results with natural and experimental observations shows strong correlations. A more speculative and theoretical stream of works instead makes use of models to move beyond the time scales accessible by experiments and give insights into the long-time features of protein evolution. In section V , we discuss future directions in the field. On one hand, we argue about what can be done in order to improve the performance of the generative modeling (e.g., via integration of

Read the complete text