Manifold of Failure: Behavioral Attraction Basins in Language Models

Sarthak Munshi, Manish Bhatt, Vineeth Sai Narajala, Idan Habler, Ammar Al-Kahfah, Ken Huang, Blake Gatto · 2026

Read Manifold of Failure: Behavioral Attraction Basins in Language Models by Sarthak Munshi, Manish Bhatt, Vineeth Sai Narajala, Idan Habler, Ammar Al-Kahfah, Ken Huang, Blake Gatto (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-22291.txt.

Description

AI safety usually studies how to push hostile examples back onto safe ground, but Sarthak Munshi and six co-authors argue for mapping the unsafe regions themselves. They introduce a framework for charting the Manifold of Failure in large language models, reframing flaw search as a quality-diversity problem. A search algorithm illuminates the continuous shape of failure regions, called behavioral attraction basins.

An Alignment Deviation metric steers the search toward behavior farthest from intended alignment. Across three models, the method reaches nearly two-thirds behavioral coverage and uncovers hundreds of distinct flaw niches, revealing sharply different shape signatures per model. Safety teams gain a map of where models break, not just a list of broken prompts.

Catalog record

CREATORSarthak Munshi, Manish Bhatt, Vineeth Sai Narajala, Idan Habler, Ammar Al-Kahfah, Ken Huang, Blake Gatto
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE33 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-22291

Browse the full library · About the Tower of Babel