Chuancheng Shi

* · 2026

Read Chuancheng Shi by * (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-21900.txt.

Introduction

Large foundation models can be manipulated by adversarial inputs, and most defenses rest on a locality idea. Find the isolated neurons or features that carry the harmful behavior, and suppress them. The 2026 preprint behind this entry argues that this picture is wrong in a way that matters.

Harmful meanings, the author contends, act as distributed circuits spread across layers, not as single switches. Interventions aimed at one spot are therefore brittle, and they tend to damage the model's usefulness as well. A defense that respects how meaning is actually spread through a network would need to work at the level of those circuits. The argument speaks to anyone deploying large models in settings where attacks are a real threat.

Catalog record

CREATOR*
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE57 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-21900

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Chuancheng Shi * Abstract Despite their capabilities, large foundation models (LFMs) remain susceptible to adversarial manipulation. Current defenses predominantly rely on the “locality hypothesis”, suppressing isolated neurons or features. However, harmful semantics act as distributed, cross-layer circuits, rendering such localized interventions brittle and detrimental to utility. To bridge this gap, we propose TraceRouter , a path-level framework that traces and disconnects the causal propagation circuits of illicit semantics. TraceRouter operates in three stages: (1) it pinpoints a sensitive onset layer by analyzing attention divergence; (2) it leverages sparse autoencoders (SAEs) and differential activation analysis to disentangle and isolate malicious features; and (3) it maps these features to downstream causal pathways via feature influence scores (FIS) derived from zero-out interventions. By selectively suppressing these causal chains, TraceRouter physically severs the flow of harmful information while leaving orthogonal computation routes intact. Extensive experiments demonstrate that TraceRouter significantly outperforms state-of-the-art baselines, achieving a superior trade-off between adversarial robustness and general utility. Our code will be publicly released. WARNING: This paper contains unsafe model responses. TraceRouter: Robust Safety for Large Foundation Models via Path-Level Intervention † † footnotetext: 1 The University of Sydney, Sydney, Australia 2 Nanjing University of Science and Technology, Nanjing, China 3 Nanjing University, Nanjing, China 4 National University of Singapore, Singapore, Singapore. Correspondence to: Fei Shen <[email protected]>. Preprint. August 10, 2026. Figure 1: Neuron-level vs. Path-level Intervention. (a) The former fails to block distributed harmful semantics, often causing semantic leakage. (b) The latter physically severs the causal propagation path, ensuring robust safety without compromising utility. 1 Introduction The widespread deployment of large foundation models (LFMs), spanning diffusion models (DMs) 36 ; 45 ; 22 , large language models (LLMs) 12 ; 20 , and multimodal large language models (MLLMs) 49 ; 25 , is accompanied by significant adversarial risks. Existing safety interventions predominantly rely on the locality hypothesis, attempting to mitigate harmful concepts by suppressing specific, isolated neurons or features. However, semantic representations in LFMs are inherently distributed; harmful semantics are not confined to single components but are encoded across multiple layers, propagating through complex cross-layer computation paths. Such localized interventions are brittle: they not only fail to prevent semantic leakage under adversarial induction but also frequently compromise the model’s general capabilities by inadvertently disrupting polysemantic neurons. Consequently, shifting from localized suppression to precise, architecture-agnostic interventions at the causal path level has become essential for securing LFMs. Current internal interventions 14 ; 41 ; 50 typically focus on suppressing features or local neurons under the assumption that harmful semantics are spatially localized. However, this component-level perspective overlooks the distributed nature and cross-layer evolution of representations: harmful information exists in superposition across layers and propagates through dynamic pathways. Recent neuroscientific evidence 23 ; 19 further corroborates that complex behaviors arise from circuit structures rather than isolated neurons. Consequently, localized suppression acts merely as a roadblock at specific intersections, failing to disrupt the overall logic flow, which leaves models vulnerable to “semantic escape” under adversarial attacks. Moreover, indiscriminate suppression of polysemantic units disrupts internal routing, resulting in degradation of performance. Building on these insights, we formulate the path-level representation hypothesis : sensitive semantics in LFMs are encoded and propagated through specific neural paths, rather than being determined by isolated components. Accordingly, as illustrated in Figure 1 (b), we contend that intervening in the information flow along these critical pathways is key to achieving precise safety modulation without compromising the model’s foundational capabilities. To validate this hypothesis and enable precise safety modulation, we propose TraceRouter , a universal “Discover-Trace-Disconnect” framework. In the discovery stage, we localize the sensitive onset layer, where harmful semantics first emerge from the background context, by analyzing attention divergence. We then employ a Top-K sparse autoencoder (SAE) 4 to disentangle dense neural activity into interpretable features, isolating source neurons uniquely activated by illicit concepts. In the tracing stage, we project these sparse features back into the backbone and utilize zero-out interventions to quantify the feature influence score (FIS) across downstream layers. This process moves beyond isolated nodes to reconstruct the cross-layer propagation pathways that orchestrate the violating logic. Finally, in the disconnect stage, TraceRouter employs path decomposition to disentangle sensitive circuit components from orthogonal computational routes. By shifting the focus from point-wise inhibition to path-level regulation, our approach physically severs the causal propagation of harmful semantics without compromising the model’s general utility. We highlight the following contributions: • We propose TraceRouter, a universal “discover-trace-disconnect” framework that enables the automated identification and causal blockade of harmful information loops across diverse model architectures. • We integrate SAEs with FIS to achieve fine-grained disentanglement and causal mapping of internal logic flow at the routing level. • We demonstrate across diverse benchmarks that our method significantly enhances adversarial robustness while precisely preserving general utility. 2 Related Work Safety Intervention in Foundation Models. Safety intervention mechanisms for LFMs 38 ; 32 ; 35 have been extensively studied across diffusion models, large language models, and multimodal large language models. Current methodologies can be categorized by their intervention granularity . Foundational approaches 5 ; 47 typically employ weight-level fine-tuning or machine unlearning to suppress harmful concepts, frequently incurring high computational costs and compromising generalization. To address these inefficiencies, subsequent research 18 ; 6 ; 29 has introduced lightweight parameter editing or closed-form erasure methods, aiming to confine the impact of concept removal to a specific parameter subset. Most recently, attention has shifted toward neuron- and feature-level interventions, which leverage sparse or interpretable units to suppress concept-related activations at inference time 14 ; 48 . Crucially, however, these methods 33 ; 37 ; 27 implicitly rely on the assumption of semantic locality. This reliance often results in incomplete suppression and semantic leakage against adversarial attacks, while simultaneously degrading benign generation fidelity due to the disruption of polysemantic units. Path-Level Analysis of Neural Representations. Emerging research 31 in mechanistic interpretability suggests that semantic behaviors in deep neural networks arise from distributed computations routed across layers, rather than residing in isolated neurons. In transformer architectures 42 , multiple interacting components assemble into functional circuits that implement high-level behaviors, with information propagating along structured and often redundant computational paths. Contextualizing this to diffusion models, prior studies 15 ; 1 ; 8 demonstrate that textual concepts influence generation through multi-layer attention trajectories and intermediate feature flows, where modifying attention patterns or feature routing can significantly alter semantic expression. Parallel findings 42 in LLMs indicate that semantic behaviors are mediated by overlapping pathways across layers, enabling concepts to persist or re-emerge under targeted interventions. Despite these advances, most existing safety interventions fail to address these propagation pathways, creating a gap between path-level mechanistic understanding and practical safety control. Figure 2: Overall of the TraceRouter. First, TraceRouter identifies sensitive onset layers and extracts features via a Top- K SAE. It then traces causal semantic pathways. Finally, selective path-level suppression blocks harmful propagation while preserving general utility. Figure 3: Sensitive Onset Layer Detection. Sensitive onset layer is identified as the first local peak of the \operatorname{SS}(l) along depth. 3 TraceRouter: Robust Safety via Path-Level Intervention As shown in Figure 2 , we propose TraceRouter, a universal path-level safety intervention framework. It first identifies the sensitive onset layer by analyzing attention divergence (see 3.1 ).

Read the complete text