Watermarking Kolmogorov-Arnold Networks for Emerging Networked Applications via Activation Perturbation
Chia-Hsun Lu 1 , Guan-Jhih Wu 1 , Ya-Chi Ho 2 , and Chih-Ya Shen 1 · 2025
Read Watermarking Kolmogorov-Arnold Networks for Emerging Networked Applications via Activation Perturbation by Chia-Hsun Lu 1 , Guan-Jhih Wu 1 , Ya-Chi Ho 2 , and Chih-Ya Shen 1 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-06676.txt.
Introduction
Watermarks let model owners prove a neural network is theirs, but a new network family breaks the usual tricks. Chia-Hsun Lu and co-authors design a watermark made for Kolmogorov-Arnold networks in a 2025 paper.
These networks learn their own activation curves, which is exactly where the new method hides its mark. It perturbs activation outputs through a frequency transform, leaving the model's task behavior almost untouched. Because the mark rides on activations rather than task data, it works across many uses. In tests, the mark survived fine-tuning, pruning, and retraining after pruning, the standard attacks owners fear. The authors frame the method as a guard for models shared across networked applications.
Catalog record
| CREATOR | Chia-Hsun Lu 1 , Guan-Jhih Wu 1 , Ya-Chi Ho 2 , and Chih-Ya Shen 1 |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 33 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-06676
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Watermarking Kolmogorov-Arnold Networks for Emerging Networked Applications via Activation Perturbation Chia-Hsun Lu 1 , Guan-Jhih Wu 1 , Ya-Chi Ho 2 , and Chih-Ya Shen 1 Abstract With the increasing importance of protecting intellectual property in machine learning, watermarking techniques have gained significant attention. As advanced models are increasingly deployed in domains such as social network analysis, the need for robust model protection becomes even more critical. While existing watermarking methods have demonstrated effectiveness for conventional deep neural networks, they often fail to adapt to the novel architecture, Kolmogorov-Arnold Networks (KAN), which feature learnable activation functions. KAN holds strong potential for modeling complex relationships in network-structured data. However, their unique design also introduces new challenges for watermarking. Therefore, we propose a novel watermarking method, Discrete Cosine Transform-based Activation Watermarking ( DCT-AW ) , tailored for KAN. Leveraging the learnable activation functions of KAN, our method embeds watermarks by perturbing activation outputs using discrete cosine transform, ensuring compatibility with diverse tasks and achieving task independence. Experimental results demonstrate that DCT-AW has a small impact on model performance and provides superior robustness against various watermark removal attacks, including fine-tuning, pruning, and retraining after pruning. I Introduction With the rapid development of machine learning, it has achieved significant success in various critical fields, such as recommendation systems and social network analysis. As the importance of deep learning models continues to grow, protecting their intellectual property becomes a challenge. To address this problem, model watermarking methods have gained interest. These methods involve embed identifiable features within the model, enabling effective ownership verification and enhancing the protection of intellectual property [ 1 ] . Generally, a good model watermarking technique should have the following two characteristics: i) Functionality preservation : The embedding of the watermark should not significantly affect the model’s performance. ii) Robustness against watermark removal attack : The watermarking technique needs to resist watermark removal attacks and still be able to extract watermark information from the model. Traditional watermarking techniques have achieved some success in protecting in protecting deep neural networks (DNNs) [ 2 , 3 ] . However, these methods primarily focus on common neural network architectures (e.g. CNNs) and do not explore specialized models with unique and powerful representational capabilities. For instance, Kolmogorov-Arnold Networks (KAN) [ 4 ] are a class of neural networks based on the Kolmogorov-Arnold representation theorem [ 5 ] , have recently gained significant attention. With their exceptional expressive power, KAN is considered highly promising in various fields [ 6 , 7 ] . Even with such potential, intellectual property protection for KAN remains largely unexplored due to their relatively recent development. An intuitive approach is to apply existing DNN watermarking techniques to KAN, but we find two main weaknesses. Weakness W1. Task dependency of watermarking methods. Many existing DNN watermarking techniques are designed with task-specific assumptions, limiting their generalizability to other problem settings. Weakness W2. Vulnerability to attacks in KAN. Due to the unique architecture and learnable activation functions of KAN, traditional DNN watermarking methods may not be as effective in watermark removal attacks such as retraining after pruning. To address these challenges, we propose D iscrete C osine T ransform-based A ctivation W atermarking ( DCT-AW ) , a novel watermarking method that embeds watermarks by perturbing activation functions in KAN. This approach effectively mitigates the above weaknesses by being task-independent and more resistant to attacks. We demonstrate the effectiveness of DCT-AW through comprehensive experiments compared with multiple state-of-the-art DNN watermarking approaches. The results show that our proposed method achieves strong performance in functional preservation and outperforms state-of-the-art methods against different watermark removal attacks, i.e., fine-tuning attacks, pruning attacks, and retraining after pruning attacks, when KAN is applied to different task, including classification and regression. Our contributions can be summarized as follows: \bullet We observe two major weaknesses, W1 and W2 , when applying existing watermarking approaches to Kolmogorov-Arnold Networks (KAN), and conduct a preliminary analysis to illustrate them. \bullet We propose Discrete Cosine Transform-based Activation Watermarking ( DCT-AW ) , the watermarking framework designed specifically for KAN. \bullet Experimental results show that our proposed DCT-AW are task-independent and more robust against various watermark removal attacks outperforming the state-of-the-art baselines. The rest of this paper is organized as follows. Sec. II introduces the related works. Sec. III provides the details about KAN and introduces the problem definition. Sec. IV conducts the preliminary analysis. Sec. V provides the details of our proposed method. Sec. VI presents the experimental results. Finally, Sec. VII concludes this paper. II Related Works DNN Watermark technique. Watermarking has long been used to protect intellectual property. Uchida et al. [ 8 ] propose the first method for embedding watermarks into DNN parameters. Since then, many methods have been developed. Trigger-set-based methods use specific samples as key samples, which are embedded into the model as watermarks. These key samples can be used to verify the watermark in the model. Adi et al. [ 9 ] and Zhang et al. [ 10 ] both generate trigger samples with pre-defined labels as the watermarks and then train the watermarked model with the training set and trigger set. Feature-based methods embed specific information into the model to incorporate the watermark. This method also requires providing a corresponding extractor to perform parameter extraction for ownership verification on suspicious models in the future. Fan et al. [ 11 ] propose a passport-based watermarking method; this approach deteriorates DNN performance with forged passports, thus providing strong protection against forged watermarks. Signal-based methods embed watermarks by adding perturbations to the model’s output. The model owner can claim ownership by observing whether the suspicious model’s output contains this specific perturbation. Chien et al. [ 3 ] present customized soft-label perturbation to embed different perturbations into different models, achieving customized watermarking effects and resisting existing watermark removal attacks. Kolmogorov-Arnold Networks (KAN). Kolmogorov-Arnold Networks (KAN) [ 4 ] represent a novel approach in the landscape of neural network architectures. Traditional multi-layer perceptrons (MLP) is designed based on the universal approximation theorem [ 12 ] , whereas KAN is inspired by the Kolmogorov-Arnold representation theorem [ 13 , 14 ] . Many techniques have been developed based on KAN. Abueidda et al. [ 15 ] replace B-spline functions with Gaussian radial basis functions in KAN neurons, achieving significant speedup and applying the method to various mechanical problems. Considering the development and potential of KAN, there is a need to propose a method for protecting the intellectual property of KAN model architectures. However, no watermarking methods specifically designed for KAN have been proposed so far, highlighting the need for such an approach. III Preliminary III-A Details of Kolmogorov-Arnold Networks (KAN) Kolmogorov-Arnold Networks (KAN) [ 4 ] replace fixed activation functions in traditional networks (e.g., MLPs) with learnable spline-based functions. The design is inspired by the Kolmogorov-Arnold theorem, which states that any continuous multivariate function can be expressed as a sum of univariate functions. KAN improves expressiveness by learning activation behaviors. Generally, KAN can be expressed as follow: \text{KAN}(x)=(\Psi_{L-1}\circ\Psi_{L-2}\circ\cdots\circ\Psi_{1}\circ\Psi_{0})x. (1) Where \Psi_{l} is the function matrix corresponding to the l -th KAN layer. Specifically, the activation function \phi_{l,i,j}\in\Psi_{l} is a crucial component for the network’s expressiveness and performance. In KAN, the activation function is constructed using