Adversarial Moral Stress Testing of Large Language Models

Saeid Jamshidi, Foutse Khomh, Arghavan Moradi Dakhel, Amin Nikanjam, Mohammad Hamdaqa, Kawser Wazed Nafi · 2026

Read Adversarial Moral Stress Testing of Large Language Models by Saeid Jamshidi, Foutse Khomh, Arghavan Moradi Dakhel, Amin Nikanjam, Mohammad Hamdaqa, Kawser Wazed Nafi (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-01108.txt.

Description

Jamshidi and colleagues introduce Adversarial Moral Stress Testing, a test suite for judging AI models under multi-round chats. One-shot benchmarks with overall scores miss rare failures and decay, so AMST applies stress changes and spread-aware scores that track swing, tail risk and drift across rounds. Tests on several models reveal varied hardiness and decay patterns hidden from one-shot rules. Toughness rests on steady scores and rare-case handling rather than mean scores alone, and AMST gives a model-free route to toughness testing and watch.

Catalog record

CREATORSaeid Jamshidi, Foutse Khomh, Arghavan Moradi Dakhel, Amin Nikanjam, Mohammad Hamdaqa, Kawser Wazed Nafi
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE100007
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.01108

Browse the full library · About the Tower of Babel