TamperBench : Systematically Stress-Testing LLM Safety Under Fine-Tuning and Tampering

Saad Hossain Tom Tseng Punya Syon Pandey Samanvay Vajpayee, Matthew Kowal Nayeema Nonta Samuel Simko Stephen Casper Zhijing Jin, Kellin Pelrine Sirisha Rambhatla · 2026

Read TamperBench : Systematically Stress-Testing LLM Safety Under Fine-Tuning and Tampering by Saad Hossain Tom Tseng Punya Syon Pandey Samanvay Vajpayee, Matthew Kowal Nayeema Nonta Samuel Simko Stephen Casper Zhijing Jin, Kellin Pelrine Sirisha Rambhatla (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-06911.txt.

Description

Saad Hossain and ten co-authors built the first common test rig for tamper resistance in open-weight language models. Such models can be changed by fine-tuning or by editing their inner states, by accident or on purpose, and those changes can strip safety behavior away. Until now, varied data sets, scores, and attack setups made fair comparison across models and defenses hard.

Their rig, TamperBench, gathers top weight-space and latent-space attacks plus alignment-stage defenses, and runs each attack-model pair through a full sweep of settings, scoring both safety and skill. They ran it on 21 open models across nine tampering threats. Jailbreak-style fine-tuning came out as the worst attack in most cases, and current alignment-stage defenses largely fell apart under full sweeps.

Catalog record

CREATORSaad Hossain Tom Tseng Punya Syon Pandey Samanvay Vajpayee, Matthew Kowal Nayeema Nonta Samuel Simko Stephen Casper Zhijing Jin, Kellin Pelrine Sirisha Rambhatla
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE60 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-06911

Browse the full library · About the Tower of Babel