Towards Interpretable Protein Structure Prediction with Sparse Autoencoders

Nithin Parsan, David J. Yang, John J. Yang · 2025

Read Towards Interpretable Protein Structure Prediction with Sparse Autoencoders by Nithin Parsan, David J. Yang, John J. Yang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-08764.txt.

Description

Nithin Parsan, David Yang, and John Yang make protein structure prediction easier to interpret, in work from 2025. Protein language models predict structure well, but their inner steps stay hard to read. Sparse autoencoders can give clearer linear features, yet past work used only small models that cannot predict structure.

The team scales sparse autoencoders to a large protein model that underlies a folding system. A nested variant learns features in ordered groups that can each rebuild the input alone. The large model version beat small model versions on concept discovery and contact map prediction. A case study shows guided steering of folding output, raising solvent access while the input sequence stays fixed. Code, data, and models are shared openly.

Catalog record

CREATORNithin Parsan, David J. Yang, John J. Yang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-08764

Browse the full library · About the Tower of Babel