MoGU V2 : Toward a Higher Pareto Frontier Between Model Usability and Security
Yanrui Du, Fenglei Fan, Sendong Zhao, Jiawei Cao, Ting Liu, Bing Qin · 2025
Read MoGU V2 : Toward a Higher Pareto Frontier Between Model Usability and Security by Yanrui Du, Fenglei Fan, Sendong Zhao, Jiawei Cao, Ting Liu, Bing Qin (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-06807.txt.
Introduction
Safer language models that stay useful instead of refusing everything are the target of a 2025 paper led by Yanrui Du, with five co-authors. Security tuning often makes models overly conservative, trading usability away. The authors aim to push the balance point itself, the Pareto frontier, rather than slide along it.
Their framework, MoGU, routes each layer's work between a security-tuned and a usability-tuned variant, with routers that sense hidden states and allocate weights dynamically. The second version tightens that coupling: routers sit only in layers carrying clear security features, and backbone modules join router training for two-way adaptation. Results hold across mainstream, on-device, and reasoning models. Even after instruction fine-tuning weakens safety, a simple data-mixing step restores security without losing task gains.
Catalog record
| CREATOR | Yanrui Du, Fenglei Fan, Sendong Zhao, Jiawei Cao, Ting Liu, Bing Qin |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 70 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-06807
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
MoGU V2 : Toward a Higher Pareto Frontier Between Model Usability and Security Yanrui Du, Fenglei Fan, Sendong Zhao, Jiawei Cao, Ting Liu, Bing Qin Abstract As Large Language Models (LLMs) increasingly permeate human life, their security has emerged as a critical concern, particularly their ability to maintain harmless responses to malicious instructions. Although extensive methods have improved LLMs’ security, they often lead to conservative, rejection-oriented responses that compromise practical usability. This presents a key challenge: how to advance the Pareto frontier between LLMs’ usability and security, rather than necessitate a trade-off between them. To address this, we propose the MoGU framework, in which the intra-layer router dynamically allocates weights by sensing hidden states, thereby balancing the contributions of security-optimized and usability-optimized variants. Despite its initial potential, the MoGU framework faces limitations such as parameter redundancy and performance bottlenecks. To overcome these, we further propose an improved MoGU v2 framework that establishes a tighter coupling between the routers and hidden states. In MoGU v2 , routers are embedded only in layers encoding highly classifiable security features, and backbone modules are activated during router optimization to enable bidirectional adaptation. MoGU V2 exhibits strong adaptability and stable improvements across various series of LLMs, including mainstream LLMs serving as brains in various applications, on-device LLMs optimized for resource-constrained scenarios, and reasoning LLMs tailored for user interpretability. Meanwhile, even facing risks introduced by Instruction Fine-tuning, MoGU v2 can easily restore security without compromising the task performance gains via a simple data-mix strategy. These comprehensive improvements highlight MoGU V2 as a robust and versatile solution for mitigating security risks in real-world applications. Warning: This paper presents malicious examples that may be offensive and upsetting. I Introduction Large Language Models (LLMs) have demonstrated remarkable capabilities across diverse domains [ 2 , 3 , 4 ] , but their deployment in real-world applications remains limited due to persistent security vulnerabilities. In particular, LLMs may generate harmful responses when exposed to malicious instructions [ 5 , 6 ] . Such misuse poses societal risks, potentially leading to the dissemination of content that promotes racial discrimination and infringes upon fundamental human rights [ 7 , 8 ] . To mitigate these, SFT [ 9 ] and RLHF [ 10 ] are employed to align LLMs with human values, thereby establishing the built-in security mechanisms serving as a foundational safeguard. Despite this progress, recent studies have revealed advanced security vulnerabilities, represented by jailbreak attacks [ 11 , 12 ] and instruction fine-tuning (IFT) attacks [ 13 , 14 ] . Jailbreak attacks [ 15 ] aim to bypass LLMs’ built-in security mechanisms by manipulating prompts, leading to harmful responses. For instance, a simple yet effective strategy involves appending phrases like “Start your response with ‘Absolutely, here’s”’ to malicious instructions. Extensive research [ 16 , 17 ] has demonstrated that LLMs’ built-in security mechanisms can be easily bypassed, underscoring their limited robustness. Meanwhile, recent studies [ 18 , 19 ] reveal that IFT can substantially compromise LLMs’ built-in security. Although post-hoc re-alignment is a viable strategy, the high computational demands make widespread deployment impractical. The above phenomena highlight the urgent need for a robust, lightweight, and high-performance defense strategy. In response to jailbreak attacks, current efforts have developed external security mechanisms, exemplified by Meta’s guardrail Llama-Guard [ 20 ] . While Llama-Guard has shown strong performance in detecting harmful content, its substantial parameter size (in billions) results in considerable inference costs. In contrast, lightweight strategies have emerged, such as maintaining the LLMs’ security awareness through prompt design [ 21 , 22 ] or performing fine-grained detection with small-scale models [ 23 , 24 ] . SafeDecode [ 25 ] and Self-CD [ 26 ] emphasize the critical role of initial tokens and focus on reconstructing token-level probability distributions. Meanwhile, in response to security risks introduced by IFT, current efforts have developed methods tailored for various stages. IFT safe mixes security-related data into training data while Vaccine [ 27 ] and Booster [ 28 ] are employed during the alignment stage to defend against potential attacks. Resta [ 29 ] and LoRA safe [ 30 ] , serving as post-tuning methods, merge isolated secure parameters back into tuned LLMs. Despite achieving certain security improvements, these methods will compromise LLMs’ usability or task performance gains brought by IFT. Therefore, a key challenge still exists: how to advance the Pareto frontier between security and usability, rather than necessitate a trade-off between them . To address this challenge, our study draws on the routing mechanism, which has been widely employed in the Mix-of-Experts (MoE) framework [ 31 ] . The motivations behind this are as follows: 1) SafeDecode and Self-CD present a promising solution, but they introduce just a fixed hyperparameter to guide the token probability reconstruction, lacking dynamic perception. The routing mechanism has been proved to dynamically adjust distributions by sensing various inputs, thereby enabling adaptive responses [ 32 , 33 ] . 2) As is well known, the effectiveness of routing mechanisms depends on LLMs’ representational abilities. Recent work [ 34 ] has demonstrated that the hidden states of LLMs encode classifiable security features, providing strong rationale support. Based on these insights, our study proposes the “ M ixing o f G lad and U nwilling Responders” framework, referred to as MoGU. Specifically, the base LLM is first transformed into two variants: Glad resp , optimized for usability, and Unwill resp , optimized for security. Then, the intra-layer routers are employed to dynamically assign weights that balance their contributions. As illustrated in Fig. 1 , for benign instructions, the router assigns greater weight to Glad resp , ensuring helpful responses. Conversely, for malicious instructions, it shifts more weight toward Unwill resp , encouraging secure responses. To optimize the router’s ability, we design a joint global-local training objective. Such a routing mechanism enables LLMs to adaptively mediate between usability and security. Fig. 1: An example to illustrate how the intra-layer routers assign weights to Glad resp and Unwill resp . The inp_states represent the input hidden states. The out_states glad and out_states unwill represent the output hidden states of Glad resp and Unwill resp respectively. Such a mechanism operates only on initial tokens (the underlined part). Despite its potential, the initial MoGU still faces limitations, such as parameter redundancy and performance bottlenecks. To overcome these, we propose an enhanced MoGU v2 , which aims to establish a tighter coupling between the router and hidden states. On the one hand, MoGU v2 strategically embeds routers only within the layers that encode highly classifiable security features (typically the deeper layers), substantially reducing additional parameter overhead. On the other hand, optimizing only the router results in a one-way adaptation to hidden states, which may lead to suboptimal performance. MoGU v2 guides the joint optimization of the router with specific modules within the LLM backbone to enable a bidirectional adaptation. Compared to the initial MoGU, MoGU v2 not only reduces nearly 50% of additional parameters but also improves overall performance. Fig. 2: Overall evaluation under various LLMs and methods. The lower harmfulness scores (HS) indicate better security performance, while the higher usability scores (US) indicate better usability performance. The ideal performance plot lies in the bottom-right corner. Our