Manifold of Failure: Behavioral Attraction Basins in Language Models
Sarthak Munshi, Manish Bhatt, Vineeth Sai Narajala, Idan Habler, Ammar Al-Kahfah, Ken Huang, Blake Gatto · 2026
Read Manifold of Failure: Behavioral Attraction Basins in Language Models by Sarthak Munshi, Manish Bhatt, Vineeth Sai Narajala, Idan Habler, Ammar Al-Kahfah, Ken Huang, Blake Gatto (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-22291.txt.
Description
AI safety usually studies how to push hostile examples back onto safe ground, but Sarthak Munshi and six co-authors argue for mapping the unsafe regions themselves. They introduce a framework for charting the Manifold of Failure in large language models, reframing flaw search as a quality-diversity problem. A search algorithm illuminates the continuous shape of failure regions, called behavioral attraction basins.
An Alignment Deviation metric steers the search toward behavior farthest from intended alignment. Across three models, the method reaches nearly two-thirds behavioral coverage and uncovers hundreds of distinct flaw niches, revealing sharply different shape signatures per model. Safety teams gain a map of where models break, not just a list of broken prompts.
Catalog record
| CREATOR | Sarthak Munshi, Manish Bhatt, Vineeth Sai Narajala, Idan Habler, Ammar Al-Kahfah, Ken Huang, Blake Gatto |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 33 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-22291