CSSBench: Evaluating the Safety of Lightweight LLMs against Chinese-Specific Adversarial Patterns
Zhenhong Zhou, Shilinlu Yan, Chuanpu Liu, Qiankun Li, Kun Wang, Zhigang Zeng · 2026
Read CSSBench: Evaluating the Safety of Lightweight LLMs against Chinese-Specific Adversarial Patterns by Zhenhong Zhou, Shilinlu Yan, Chuanpu Liu, Qiankun Li, Kun Wang, Zhigang Zeng (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-00588.txt.
Description
Zhenhong Zhou and colleagues build a safety benchmark for lightweight language models facing Chinese-specific attacks. Safety testing has advanced mainly in English, but malicious Chinese queries often hide intent through homophones, pinyin spellings, symbol splitting, and similar tricks that English benchmarks never exercise. Small, cheap models meant for on-device use may be especially exposed.
Their benchmark, CSSBench, organizes these adversarial patterns across six domains common in Chinese scenarios, including illegal activity and compliance, privacy leakage, health misinformation, and fraud. Models are tested on how well their guardrails hold when the harmful request is disguised in these language-specific ways. The work gives developers a more realistic picture of safety for Chinese deployments.
Catalog record
| CREATOR | Zhenhong Zhou, Shilinlu Yan, Chuanpu Liu, Qiankun Li, Kun Wang, Zhigang Zeng |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 63 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-00588