Inference-Time Toxicity Mitigation in Protein Language Models

Manuel Fernández Burda, Santiago Aranguri, Ivan Arcuschin Moreno, Enzo Ferrante, [0.5em] Laboratory of Applied Artificial Intelligence (LIAA), Institute of Computer Sciences (ICC)CONICET - Universidad de Buenos · 2026

Read Inference-Time Toxicity Mitigation in Protein Language Models by Manuel Fernández Burda, Santiago Aranguri, Ivan Arcuschin Moreno, Enzo Ferrante, [0.5em] Laboratory of Applied Artificial Intelligence (LIAA), Institute of Computer Sciences (ICC)CONICET - Universidad de Buenos (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-04045.txt.

Description

Fernández Burda and others adapt Logit Diff Amplification for inference-time toxicity mitigation in protein models. Protein language models aid de novo protein design, yet tuning to given taxonomic groups can draw out toxic output even absent toxicity as a training goal. The method amplifies the gap between baseline and toxicity-finetuned model logits, modifying token probabilities with no retraining.

Catalog record

CREATORManuel Fernández Burda, Santiago Aranguri, Ivan Arcuschin Moreno, Enzo Ferrante, [0.5em] Laboratory of Applied Artificial Intelligence (LIAA), Institute of Computer Sciences (ICC)CONICET - Universidad de Buenos
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE26246
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.04045

Browse the full library · About the Tower of Babel