Completion of partial structures using Patterson maps with the CrysFormer machine learning model

Tom Pan [email protected], Evan Dramko [email protected], Mitchell D. Miller [email protected], Anastasios Kyrillidis [email protected], George N. Phillips, Jr. [email protected] · 2025

Read Completion of partial structures using Patterson maps with the CrysFormer machine learning model by Tom Pan [email protected], Evan Dramko [email protected], Mitchell D. Miller [email protected], Anastasios Kyrillidis [email protected], George N. Phillips, Jr. [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-10440.txt.

Introduction

Tom Pan and four co-authors, including George N. Phillips, attack a stubborn step in protein crystallography: finishing structures that are only partly known. Machine learning models rarely use the raw diffraction measurements directly. Their model, CrysFormer, mixes a three-dimensional vision transformer with a convolutional network and feeds it both kinds of evidence at once.

One input is a Patterson map, computed straight from crystallographic data. The other is a partial structure map, built from an AlphaFold prediction with pieces removed. The model outputs electron density maps that standard refinement then turns into atomic models. On test fragments it improved phase estimates, filled the missing regions, and brought density maps closer to the true structures.

Catalog record

CREATORTom Pan [email protected], Evan Dramko [email protected], Mitchell D. Miller [email protected], Anastasios Kyrillidis [email protected], George N. Phillips, Jr. [email protected]
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-10440

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Completion of partial structures using Patterson maps with the CrysFormer machine learning model Tom Pan [email protected], Evan Dramko [email protected], Mitchell D. Miller [email protected], Anastasios Kyrillidis [email protected], George N. Phillips, Jr. [email protected] Abstract Protein structure determination has long been one of the primary challenges of structural biology, to which deep machine learning (ML)-based approaches have increasingly been applied. However, these ML models generally do not incorporate the experimental measurements directly, such as X-ray crystallographic diffraction data. To this end, we explore an approach that more tightly couples these traditional crystallographic and recent ML-based methods, by training a hybrid 3-d vision transformer and convolutional network on inputs from both domains. We make use of two distinct input constructs / Patterson maps, which are directly obtainable from crystallographic data, and “partial structure” template maps derived from predicted structures deposited in the AlphaFold Protein Structure Database with subsequently omitted residues. With these, we predict electron density maps that are then post-processed into atomic models through standard crystallographic refinement processes. Introducing an initial dataset of small protein fragments taken from Protein Data Bank entries and placing them in hypothetical crystal settings, we demonstrate that our method is effective at both improving the phases of the crystallographic structure factors and completing the regions missing from partial structure templates, as well as improving the agreement of the electron density maps with the ground truth atomic structures. This work has been accepted in Acta Crystallographic section D. 1 Introduction Proteins are essential components of nearly all biochemical mechanisms performed in living cells ( Tanford & Reynolds 2004 ) . They are composed of small organic molecules called amino acids (of which there are 20 typical proteinogenic ones) linked by peptide bonds; a single amino acid is often referred to as a residue. Proteins’ functions are largely facilitated by their ability to bind only to specific molecules at specific sites on the protein, such that its 3-D shape significantly informs its cellular activity. Thus, determining the characteristic complex 3D structure of a protein (which had folded from a polymer of amino acid residues) is a long-standing problem of structural biology, having first been achieved by X-ray crystallography, and later by Nuclear Magnetic Resonance (NMR) and cryoelectronmicroscopy (cryo-EM). All of these approaches face the problem of reconstructing an atomic structure given incomplete or imperfect experimental data ( Drenth 2007 ) . In recent years, due to the wealth of high-quality information that has been accumulated in the Protein Data Bank (PDB) and vast sequence databases, machine learning has become another widespread approach for predicting protein structure, often with model architectures based on the transformer self-attention mechanism. Initiatives such as AlphaFold2 ( Jumper et al. 2021 ) and AlphaFold3 ( Abramson et al. 2024 ) , which use sequence data in conjunction with co-evolutionary information in the form of multiple sequence alignments (MSAs), have demonstrated the ability of deep learning models to produce variously precise atomic-level predictions. Other established ML-based approaches include RoseTTAFold ( Baek et al. 2021 ) , Boltz ( Wohlwend et al. 2025 ) and ESMFold ( Lin et al. 2023 ) , which does not depend on the creation of MSAs. However, certain issues remain (Terwilliger et al., 2023b), and X-ray crystallography is still frequently employed despite its well-known associated difficulties (i.e. the crystallographic phase problem). Thus, several projects have been developed with the purpose of bridging the gap between experimental crystallographic methods and ML techniques, see ( Matinyan et al. 2024 ) . In this work, we build upon our previous work ( Pan et al. 2023 ; Pan et al. 2025 ) in this area by developing an ML-based approach for improving predictions provided by other ML models, i.e. those in the AlphaFold Protein Structure Database (AFDB) ( Varadi et al. 2023 ) , given Patterson maps, which can be directly calculated from X-ray crystallography diffraction patterns without the need for phase information. We develop a novel synthetic dataset of crystals of protein segments taken from PDB structures and corresponding AFDB entries, with a subset of residues subsequently omitted from the AFDB prediction templates, and show that a hybrid 3D vision transformer and convolutional neural network (CNN) can be trained to complete and improve the templates extracted the AlphaFold predictions. 2 Problem Setup and Related Work 2.1 X-ray crystallography. X-ray crystallography is one of the most commonly used experimental methods for determining the atomic-level structures of proteins and other large macromolecules ( Lattman & Loll 2008 ) . In this technique, molecular crystals are exposed to X-ray beams, which diffract in specific directions according to the regular internal structure of the crystal to produce a pattern of spots (known as reflections). Each reflection with a crystallographic diffraction pattern is associated with a set of three Miller indices h,k,l that indicate the orientation of sets of parallel planes within the crystal’s unit cell that contribute to producing the reflection ( Ashcroft & Mermin 2022 ) , and can be shown to have an underlying representation known as a structure factor. Formally, a structure factor is the Fourier transformation of the electron density within the unit cell (the smallest repeating unit within a crystal). However, it can be well-approximated as a discrete Fourier transform dependent on the atoms present in the crystal’s unit cell: \displaystyle F(h,k,l)=\sum_{j=1}^{n}f_{j}\cdot e^{2\pi i(hx_{j}+ky_{j}+lz_{j})}\cdot e^{-\tfrac{B_{j}}{4}(\tfrac{1}{d_{hkl}})^{2}}, (1) where f_{j} refers to the scattering factor property, B_{j} refers to the crystallographic B-factor, (x_{j},y_{j},z_{j}) refers to the fractional coordinates of the j -th atom within the cell (and all occupancies are assumed to be 1.0 ). Each of these structure factors is known to be a complex number, with both an amplitude and a phase (denoted by \phi ) component. An inverse Fourier transform can be taken over all such reflection structure factors to obtain an initial estimate of the electron density \rho at all points (x,y,z) within the unit cell, as: \displaystyle\rho(x,y,z)=\tfrac{1}{V}\cdot\sum_{h,k,l}|F(h,k,l)|\cdot e^{-2\pi i(hx+ky+lz-\phi(h,k,l))}, (2) where V is the volume of the unit cell. Once such a map of the electron density within the unit cell is estimated, it is used to produce an initial input into iterative refinement programs, which perform repeated comparisons of the expected diffraction pattern given the current estimated model with experimental measurements, and eventually output a final atomic model. However, while the amplitude |F(h,k,l)| of any reflection’s underlying structure factor is simply proportional to the square root of its measured intensity, corresponding phase information cannot be immediately calculated from experimental crystallographic data. This is known as the crystallographic phase problem ( Lattman & Loll 2008 ) . 2.2 Previous work for solving the crystallographic phase problem. Traditionally, three of the most widely used methods for addressing the crystallographic phase problem have been isomorphous replacement (IR), anomalous dispersion (AD), and molecular replacement (MR) ( Lattman & Loll 2008 ; Jin et al. 2020 ) . IR and AD almost always require multiple experimental settings, often with the production of molecular crystals with heavy atom substitutions. On the other hand, MR requires the availability of homologous structures known to be similar to the current desired one, to be used as an initial template or phase estimate after a rotational and then translational search. Predictions made by the AlphaFold2 machine learning model (

Read the complete text