TukaBench: A Culturally Grounded Jailbreak Benchmark for African Languages

Victor Akinode, Senyu Li, Wassim Hamidouche, Waqas Zamir, Inbal Becker-Reshef, David Ifeoluwa Adelani · 2026

Read TukaBench: A Culturally Grounded Jailbreak Benchmark for African Languages by Victor Akinode, Senyu Li, Wassim Hamidouche, Waqas Zamir, Inbal Becker-Reshef, David Ifeoluwa Adelani (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-01322.txt.

Description

Akinode and co-authors build TukaBench for jailbreak tests in African languages. Safety tests for large models lean hard on English. Low-resource languages get far less coverage in such tests. African languages are critically underexplored in this work. TukaBench covers seven African languages. It extends JailbreakBench past direct translation alone. Four prompt settings separate language, culture, and evasiveness effects.

Prompts come via human translation and African-context adaptation. Some are hand-curated and checked against a top model. Code-switched prompts mix English with African languages. Refusal drops in African languages versus English. Culturally adapted prompts draw the least refusal of all. Judge agreement with humans also drops in low-resource tongues.

Catalog record

CREATORVictor Akinode, Senyu Li, Wassim Hamidouche, Waqas Zamir, Inbal Becker-Reshef, David Ifeoluwa Adelani
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE71 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.01322

Browse the full library · About the Tower of Babel