Exposing Long-Tail Safety Failures in Large Language Models through Efficient Diverse Response Sampling

Suvadeep Hajra [email protected], Palash Nandi [email protected], Tanmoy Chakraborty [email protected] · 2026

Read Exposing Long-Tail Safety Failures in Large Language Models through Efficient Diverse Response Sampling by Suvadeep Hajra [email protected], Palash Nandi [email protected], Tanmoy Chakraborty [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-14355.txt.

Description

Hajra, Nandi, and Chakraborty show that diverse sampling alone can expose rare safety failures in language models. Safety tuning usually hides, rather than removes, unsafe behavior in the long tail of outputs. For one fixed risky prompt, more and more varied samples steadily raise the jailbreak rate. Their PDPS method grows and prunes sample sets in stages to stay cheap. It matches huge random sampling at a small share of the cost. Under tight budgets, it beats plain sampling and diverse beam search by wide margins.

Catalog record

CREATORSuvadeep Hajra [email protected], Palash Nandi [email protected], Tanmoy Chakraborty [email protected]
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE60960
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.14355

Browse the full library · About the Tower of Babel