Yuvion LLM: An Adversarially-Aware Large Language Model for Content And AI Safety
Yuvion Team, Alibaba Security AGI Lab · 2026
Read Yuvion LLM: An Adversarially-Aware Large Language Model for Content And AI Safety by Yuvion Team, Alibaba Security AGI Lab (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-27632.txt.
Introduction
Safety failures in deployed language models often come from attacks, not accidents. Users may plan multi-step tricks to evade a model's rules. General-purpose training mostly ignores this adversarial side of safety. Measured safety then overstates real robustness. The Yuvion Team at the Alibaba Security AGI Lab built Yuvion LLM in 2026 to face that problem directly.
Training treats adversarial robustness and agentic skill as first-class goals. The pipeline starts with adversarially aware data construction. Knowledge-enhanced continued pretraining follows. Policy-grounded safety post-training comes next, mixing risk-aware fine-tuning with reinforcement learning. Tool use and multi-step reasoning get their own safety-aware training. The team also built RiskEval, a set of ninety-three benchmarks in four categories. Across them, Yuvion shows clear safety advantages and strong robustness under attack. The eight-billion-parameter version beat most larger baselines on several safety tasks, the team reports.
Catalog record
| CREATOR | Yuvion Team, Alibaba Security AGI Lab |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 122 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.27632
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Yuvion LLM: An Adversarially-Aware Large Language Model for Content And AI Safety Yuvion Team, Alibaba Security AGI Lab Abstract As large language models are increasingly deployed in real-world systems, safety failures can still lead to harmful outputs and dangerous misuse. We argue that the essence of safety is adversarial: many failures arise not from natural inputs alone, but from strategic attempts to evade model policies and safeguards. However, existing general-purpose model development largely overlook this adversarial nature, and often remain insufficient for realistic safety scenarios involving planning, tool use, and multi-step reasoning, causing measured safety performance to overestimate real deployment robustness. To address this gap, we present Yuvion LLM , a large language model built for adversarially robust content safety and broader AI safety. Yuvion LLM treats adversarial robustness and agentic capability as first-class objectives. Its pipeline combines adversarially aware data construction, knowledge-enhanced continued pretraining, and policy-grounded multi-task safety post-training, including risk-aware supervised fine-tuning and reinforcement learning-based policy optimization, together with safety-aware agentic reinforcement learning for tool use and multi-step reasoning in complex safety scenarios. We further introduce the Yuvion LLM RiskEval (YLRE) , a collection of 93 benchmarks across four evaluation categories, covering diverse open and internal evaluations with a focus on safety, adversarial robustness, and real-world capability requirements. Across these evaluations, Yuvion LLM demonstrates clear advantages on safety-focused benchmarks and particularly strong robustness under adversarial conditions, while maintaining solid overall capability. Notably, Yuvion-8B outperforms most state-of-the-art baselines, including substantially larger models such as GPT-5.4 and Qwen3-MAX, on several safety tasks. † † footnotetext: Partial open-source release is planned. For trial access, contact [email protected] . Figure 1: Evaluation overview across benchmark settings: Open-source Safety (Macro F1 on public content safety benchmarks), Adversarial Safety Static and Dynamic (F1 and 100- Combined Score on self-constructed red-team adversarial benchmarks), and Industrial Deployment (in-house capability and business composite). Yuvion-32B achieves the best results across all panels, with scores of 78.2, 94.2, 79.4, and 86.1, outperforming all baselines including GPT-5.4 and Qwen3-MAX. Yuvion-8B also surpasses most baselines and remains competitive against substantially larger models. 1 Introduction Large language models (LLMs) are increasingly being deployed in real-world systems for content moderation, user interaction, decision support, tool use, and multi-step task execution ( 4 ; 1 ; 57 ; 71 ; 65 ; 50 ) . As these systems become integrated into social and economic activity, safety failures can lead to harmful content, prohibited transactions, and dangerous information access through jailbreaks or policy circumvention. Recent LLM-based safety systems ( 27 ; 39 ; 50 ) have helped mitigate many of these risks. However, we identify a fundamental limitation shared by these systems: fragility under human adversarial behavior . Figure 2 illustrates this limitation concretely. The underlying unsafe intent remains unchanged, yet a general LLM that correctly rejects the original input fails once the request is reframed through euphemism, symbolic substitution, or cross-lingual mixing. This points to the core challenge: unsafe behaviors in deployment arise not from natural inputs alone, but from strategic, adaptive attempts to evade model safeguards. In content safety, harmful intent can be hidden through lexical obfuscation, coded language, contextual disguise, or off-platform traffic obfuscation; in broader AI safety, models can be manipulated through jailbreaks, prompt injection, role-playing, and multi-turn attacks ( 46 ; 67 ; 38 ) . Existing general-purpose models are developed and evaluated largely without accounting for such strategic human behavior, causing measured safety performance to systematically overestimate real deployment robustness. This adversarial challenge intensifies in agentic settings. Production safety scenarios often involve cascading policy rules, cross-modal evidence gathering, and specialized tool invocation. For example, determining whether a product listing infringes a registered trademark may require following a multi-step decision procedure, invoking image detection tools, and synthesizing cross-modal evidence before rendering a judgment. These operational demands require genuine agentic capabilities : planning multi-step reasoning chains, invoking external tools, retrieving and grounding decisions in evolving policy documents, and adapting execution paths based on intermediate results. However, existing safety-oriented models, including dedicated guard models ( 27 ; 39 ; 50 ) , remain confined to single-turn safety judgment and lack support for tool use, policy retrieval, or multi-step execution. As content safety systems scale from text classification toward multi-modal, multi-tool audit pipelines, agentic capability becomes a structural requirement for practical deployment. These two gaps, fragility under adversarial evasion and the absence of agentic capability, motivate the central premise of our work: adversarial robustness and agentic safety capability must be built into model development and evaluation by design, rather than added only as post-hoc safeguards. Robust safety requires models that can recognize obfuscated risks, remain aligned under adversarial pressure, and operate reliably in realistic safety scenarios involving planning, policy grounding, tool use, and adaptive multi-step reasoning. Figure 2: Illustrative examples of adversarial safety evasion. Left: a violent or terror-related request is progressively obfuscated through euphemistic expression and cross-lingual mixing (Pinyin substitution). Right: an extremism-related request escalates from direct attack planning queries to euphemistic framing and authority-based context reframing. To this end, we present Yuvion LLM , a large language model built for adversarially robust content safety and broader AI safety. Yuvion LLM is designed around two first-class objectives: robust safety under adversarial conditions and agentic safety capability for realistic deployment scenarios . To realize these objectives, Yuvion adopts a progressive safety training paradigm consisting of three stages: knowledge-enhanced continued pretraining, which injects safety-domain knowledge; policy-grounded multi-task safety post-training, which elicits risk understanding, fine-grained risk identification, and policy-consistent decision making under adversarial variation; and safety-aware agentic reinforcement learning, which extends the model to retrieval, tool use, and multi-step reasoning in safety scenarios. Together, these stages strengthen the model’s safety-relevant knowledge, adversarial robustness, policy-grounded decision capability, and trajectory-level reliability in realistic safety scenarios. In this way, Yuvion LLM is intended not merely as a guard classifier, but as a more general safety-oriented model for practical deployment. We further introduce the Yuvion LLM RiskEval (YLRE) , a four-level progressive evaluation framework covering 93 benchmarks across open-source general benchmarks, open-source safety benchmarks, a self-constructed adversarial safety benchmark, and in-house capability and business benchmarks. This framework is designed to jointly evaluate general capability retention, public safety performance, adversarial robustness, and real-world operational value. More specifically, the first two levels measure whether safety specialization preserves general competence and remains competitive on established public benchmarks; the third level stresses adversarial robustness under controlled yet realistic transformation patterns; and the fourth level evaluates performance in practical settings involving agentic capabilities and business-facing requirements. This progressive design enables us to examine not only whether a model understands risk and safety in principle, but also whether it remains reliable and precise in real-world, complex, multi-turn, and adversarially intensive production environments at scale. The main contributions of this work are as follows: • We argue that safety should be treated as an inherently adversarial problem, and that both adversarial robustness and agentic capability must be built into model development by design. Guided by this principle, we present Yuvion LLM , a large language model built for adversarially robust content safety and broader AI safety, with a development pipeline integrating adversarially aware data construction, knowledge-enhanced continued pretraining, post-training for safety tasks, and agentic reinforcement learning that equips the model with tool invocation, multi-step reasoning, and task