CSSBench: Evaluating the Safety of Lightweight LLMs against Chinese-Specific Adversarial Patterns

Zhenhong Zhou, Shilinlu Yan, Chuanpu Liu, Qiankun Li, Kun Wang, Zhigang Zeng · 2026

Read CSSBench: Evaluating the Safety of Lightweight LLMs against Chinese-Specific Adversarial Patterns by Zhenhong Zhou, Shilinlu Yan, Chuanpu Liu, Qiankun Li, Kun Wang, Zhigang Zeng (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-00588.txt.

Description

Zhenhong Zhou and colleagues build a safety benchmark for lightweight language models facing Chinese-specific attacks. Safety testing has advanced mainly in English, but malicious Chinese queries often hide intent through homophones, pinyin spellings, symbol splitting, and similar tricks that English benchmarks never exercise. Small, cheap models meant for on-device use may be especially exposed.

Their benchmark, CSSBench, organizes these adversarial patterns across six domains common in Chinese scenarios, including illegal activity and compliance, privacy leakage, health misinformation, and fraud. Models are tested on how well their guardrails hold when the harmful request is disguised in these language-specific ways. The work gives developers a more realistic picture of safety for Chinese deployments.

Catalog record

CREATORZhenhong Zhou, Shilinlu Yan, Chuanpu Liu, Qiankun Li, Kun Wang, Zhigang Zeng
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE63 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-00588

Browse the full library · About the Tower of Babel