Test-Time Detoxification without Training or Learning Anything

Baturay Saglam Dionysis Kalogerias · 2026

Read Test-Time Detoxification without Training or Learning Anything by Baturay Saglam Dionysis Kalogerias (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-02498.txt.

Description

Baturay Saglam and 1 co-author detoxify language model output at test time without training or learning anything new, in a 2026 arXiv paper. Models can emit toxic text even for harmless prompts, and most fixes need retraining, gradients, or extra learned components that may not transfer to black-box systems.

Their procedure approximates how completion toxicity changes with the input embeddings, the numeric vectors representing the prompt. A few descent steps on those embeddings, computed with zeroth-order optimization that needs only forward evaluations, steer generation toward safer continuations. The method needs just embedding access and a toxicity scoring function. Across models and prompts it delivered robust toxicity reductions. In most settings it achieved the best overall balance between safety and generation quality. The authors frame embeddings as practical control knobs for black-box optimization.

Catalog record

CREATORBaturay Saglam Dionysis Kalogerias
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE54 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-02498

Browse the full library · About the Tower of Babel