SONNI: Secure Oblivious Neural Network Inference
Luke Sperling and Sandeep S. Kulkarni Department of Computer Science and Engineering Michigan State University { sperli14, sandeep } @msu.edu · 2025
Read SONNI: Secure Oblivious Neural Network Inference by Luke Sperling and Sandeep S. Kulkarni Department of Computer Science and Engineering Michigan State University { sperli14, sandeep } @msu.edu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-18974.txt.
Introduction
Luke Sperling and Sandeep Kulkarni present a 2025 computing paper on a hidden flaw in private machine learning services. In the standard setup, a client encrypts data and sends it to a server that runs a model on it. The client alone can read the result, which sounds safe.
The authors show a model-stealing attack they call Silver Platter that works without detection. It succeeds even when keys are split so that simple collusion fails. Their fix, SONNI, adds a results-checking protocol that proves the computation was done right without exposing client data. Even a server colluding with a client or with the model owner cannot extract the model. The privacy failure chance is vanishingly small, and batching power barely drops.
Catalog record
| CREATOR | Luke Sperling and Sandeep S. Kulkarni Department of Computer Science and Engineering Michigan State University { sperli14, sandeep } @msu.edu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 40 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-18974
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
SONNI: Secure Oblivious Neural Network Inference Luke Sperling and Sandeep S. Kulkarni Department of Computer Science and Engineering Michigan State University { sperli14, sandeep } @msu.edu Abstract In the standard privacy-preserving Machine learning as-a-service (MLaaS) model, the client encrypts data using homomorphic encryption and uploads it to a server for computation. The result is then sent back to the client for decryption. It has become more and more common for the computation to be outsourced to third-party servers. In this paper we identify a weakness in this protocol that enables a completely undetectable novel model-stealing attack that we call the Silver Platter attack. This attack works even under multikey encryption that prevents a simple collusion attack to steal model parameters. We also propose a mitigation that protects privacy even in the presence of a malicious server and malicious client or model provider (majority dishonest). When compared to a state-of-the-art but small encrypted model with 32k parameters, we preserve privacy with a failure chance of 1.51 × 10 − 28 1.51\times 10^{-28} while batching capability is reduced by 0.2 % 0.2\% . Our approach uses a novel results-checking protocol that ensures the computation was performed correctly without violating honest clients’ data privacy. Even with collusion between the client and the server, they are unable to steal model parameters. Additionally, the model provider cannot learn any client data if maliciously working with the server. 1 Introduction Training ChatGPT3 [ Brown et al., 2020 ] took 3.14\times 10^{23} floating point operations or an estimated \$4.6 M if replicated using a Tesla V100 cloud instance 1 1 1 https://lambdalabs.com/blog/demystifying-gpt-3 . QuillBot uses a variety of models for grammar checking, paraphrasing, etc, some of which contain billions of parameters and a took team of engineers to develop 2 2 2 https://quillbot.com/blog/compressing-large-language-generation-models-with-sequence-level-knowledge-distillation/ . One way for a provider to recuperate the cost of generating machine learning models is to provide machine learning-as-a-service (MLaaS) where the provider permits a client to compare their data with the model. For example, a hospital could pay to have automated screenings for skin cancer. Moreover, millions of users pay for their queries to be answered by ChatGPT or to have their writings improved by QuillBot’s premium offerings. This incentivizes the costly training process with financial gain. The use of MLaaS generates an issue of privacy for the client, as the data it is using is private and the client is concerned about possible leak of this private data to provider. The issue of privacy is especially important to client as the data is often one-of-a-kind and cannot be replaced/regenerated, such as in the case of medical or biometric data. For this reason, for several years, MLaaS systems have been designed with client data privacy in mind. However, as MLaaS becomes more widespread and the models become more complex, the provider lacks the computational power needed to provide MLaaS on its own. Especially in the context of availability of third-party servers to provide computational capability, it is in the interest of the provider to outsource the MLaaS service to a server that will only provide the computational capability. Even in this context, the client privacy is crucial. Additionally, in this context, the privacy of the provider is critical as well. Specifically, since the development of the model requires significant computational and financial investment, it is critical that the model remains a secret and not revealed to anyone including the client and the server. Our work focuses on using oblivious neural networks with mulitikey encryption [ Chen et al., 2019b ] . Here, both the client and model provider each hold a secret key and both are needed for decryption. The result is computed by the third-party server and sent back to the client and model provider. The model provider applies their secret key to get a partial decryption and sends it back to the client who is able to fully decrypt and learn the result. The protocol in [ Chen et al., 2019b ] provides privacy only for the honest-but-curious and collusion models. In other words, if the server, model provider or client is only going to try to infer from the data it has learned, the privacy property is satisfied. However, if the server is malicious and violates the protocol even slightly, it can leak model parameters without being detected. One way to do this is to encrypt the model parameters as the return value and send them to the client instead of sending the actual result of the model. In this case, the server will not be able to detect this as the data it sees is encrypted with the client’s key. It follows that this attack would go completely undetected by the model provider 100% of the time. A simple solution would be to have the model provider check the result before returning it to the client but this is insufficient. The output of the model applied to the private data is, itself, private data as well. Additionally, it is possible in certain applications to recreate the original data from the output [ Mai et al., 2018 ] . Therefore, there is a strong need for a solution that ensures the result was computed correctly without revealing what the output is to the model provider. In this paper, we identify a novel attack against oblivious neural network inference and propose a secure protocol that we call Secure Oblivious Neural Network Inference, or SONNI, to combat it and ensure security in the presence of a dishonest server and dishonest client/provider (majority dishonest). The contributions of the paper are as follows: • We introduce a novel attack, called the Silver Platter attack, to enable model stealing in the oblivious neural network inference setting. • We propose a novel protocol for oblivious neural network inference that mitigates this novel attack and does not violate the client’s data privacy. • We evaluate our protocol in terms of the level of privacy it provides and the overhead of providing that privacy. In Section 2 we provide background of the encryption schemes employed in this work. In Section 3 we detail the vulnerability of the existing outsourced neural network inference protocol and the novel attack we construct. We propose a solution and prove its security in Section 4 . We provide related work in Section 5 and closing remarks in Section 6 . Figure 1: Standard Outsourced Oblivious Neural Network Inference Model 2 Background 2.1 Fully Homomorphic Encryption Traditional encryption schemes require decryption before any data processing can occur. Homomorphic encryption (HE) allows arithmetic directly over ciphertexts without requiring access to the secret key needed for decryption, enabling data oblivious protocols. Fully homomorphic encryption (FHE) schemes support an unlimited number of multiple types of operations. The Cheon-Kim-Kim-Song (CKKS) [ Cheon et al., 2017 ] cryptosystem supports additions as well as multiplications of ciphertexts. The message space of CKKS is vectors of complex numbers. A small amount of error is injected into each ciphertext at the time of encryption to guarantee the security of the scheme. This error grows each arithmetic operation performed. Therefore, once a certain threshold of multiplications are performed the error grows too large to decrypt correctly. Although the bootstrap operation reduces this