Learning Safety Constraints for Large Language Models

Xin Chen, Yarden As, Andreas Krause · 2025

Read Learning Safety Constraints for Large Language Models by Xin Chen, Yarden As, Andreas Krause (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-24445.txt.

Description

Xin Chen, Yarden As, and Andreas Krause present SaP, a shape based way to keep large language models safe. Such models can yield harmful text and can be tricked by crafted attacks. Their work came out in twenty twenty-five.

SaP learns a many sided shape, a polytope, in the model's inner space that marks safe and unsafe zones. Its faces let the method spot unsafe input and steer output back to safe ground. It works after training, with no change to model weights, so core skills stay intact. Tests across models cut attack success while task scores held. The faces also showed a split by type of safety theme, which aids reading how models store safety.

Catalog record

CREATORXin Chen, Yarden As, Andreas Krause
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE69 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-24445

Browse the full library · About the Tower of Babel