Towards Interpretable Protein Structure Prediction with Sparse Autoencoders
Nithin Parsan, David J. Yang, John J. Yang · 2025
Read Towards Interpretable Protein Structure Prediction with Sparse Autoencoders by Nithin Parsan, David J. Yang, John J. Yang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-08764.txt.
Description
Nithin Parsan, David Yang, and John Yang make protein structure prediction easier to interpret, in work from 2025. Protein language models predict structure well, but their inner steps stay hard to read. Sparse autoencoders can give clearer linear features, yet past work used only small models that cannot predict structure.
The team scales sparse autoencoders to a large protein model that underlies a folding system. A nested variant learns features in ordered groups that can each rebuild the input alone. The large model version beat small model versions on concept discovery and contact map prediction. A case study shows guided steering of folding output, raising solvent access while the input sequence stays fixed. Code, data, and models are shared openly.
Catalog record
| CREATOR | Nithin Parsan, David J. Yang, John J. Yang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 34 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-08764