Label Privacy in Split Learning for Large Models with Parameter-Efficient Training

Philip Zmushko ♯ Yandex, MIPT ⋄, Marat MansurovYandex, Ruslan SvirschevskiYandex, HSE University, Denis KuznedelevYandex, Skoltech, Max RyabininTogether AI, Aleksandr BeznosikovMIPT ⋄ , ISP RAS † , Innopolis ‡ · 2024

Read Label Privacy in Split Learning for Large Models with Parameter-Efficient Training by Philip Zmushko ♯ Yandex, MIPT ⋄, Marat MansurovYandex, Ruslan SvirschevskiYandex, HSE University, Denis KuznedelevYandex, Skoltech, Max RyabininTogether AI, Aleksandr BeznosikovMIPT ⋄ , ISP RAS † , Innopolis ‡ (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-16669.txt.

Introduction

Philip Zmushko and co-authors protect label privacy in split fine tuning in a 2024 paper. Fine tuning services split work between a client that owns data and a server that hosts a large model. The client's labels can leak during training, which breaks trust in the service.

The team first probes how a popular light tuning method leaks labels through an application interface. Their new algorithm shares the work across parties in a way that keeps labels hidden while adding little overhead. Tests fine tuned three large models on language tasks with the method in place. Accuracy rivaled past privacy methods in both two party and multi party setups, often with a lead. The work suits firms that must outsource model training.

Catalog record

CREATORPhilip Zmushko ♯ Yandex, MIPT ⋄, Marat MansurovYandex, Ruslan SvirschevskiYandex, HSE University, Denis KuznedelevYandex, Skoltech, Max RyabininTogether AI, Aleksandr BeznosikovMIPT ⋄ , ISP RAS † , Innopolis ‡
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE40 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-16669

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Label Privacy in Split Learning for Large Models with Parameter-Efficient Training Philip Zmushko ♯ Yandex, MIPT ⋄, Marat MansurovYandex, Ruslan SvirschevskiYandex, HSE University, Denis KuznedelevYandex, Skoltech, Max RyabininTogether AI, Aleksandr BeznosikovMIPT ⋄ , ISP RAS † , Innopolis ‡ Abstract As deep learning models become larger and more expensive, many practitioners turn to fine-tuning APIs. These web services allow fine-tuning a model between two parties: the client that provides the data, and the server that hosts the model. While convenient, these APIs raise a new concern: the data of the client is at risk of privacy breach during the training procedure. This challenge presents an important practical case of vertical federated learning, where the two parties perform parameter-efficient fine-tuning (PEFT) of a large model. In this study, we systematically search for a way to fine-tune models over an API while keeping the labels private . We analyze the privacy of LoRA, a popular approach for parameter-efficient fine-tuning when training over an API. Using this analysis, we propose P 3 EFT, a multi-party split learning algorithm that takes advantage of existing PEFT properties to maintain privacy at a lower performance overhead. To validate our algorithm, we fine-tune DeBERTa-v2-XXLarge, Flan-T5 Large and LLaMA-2 7B using LoRA adapters on a range of NLP tasks. We find that P 3 EFT is competitive with existing privacy-preserving methods in multi-party and two-party setups while having higher accuracy. $\sharp$ $\sharp$ footnotetext: The corresponding author: [email protected] $\diamond$ $\diamond$ footnotetext: Moscow Institute of Physics and Technology \ddagger Innopolis University $\dagger$ $\dagger$ footnotetext: Ivannikov Institute for System Programming of the Russian Academy of Sciences 1 Introduction One of the main reasons behind deep learning success is its ability to transfer knowledge between tasks ( Tan et al., 2018 ) . When training a model for any particular problem, it is common to reuse previously trained models from other, related problems. In the past, this was typically done by downloading pre-trained model weights from public hubs, then fine-tuning the said models on the downstream task. However, as models grow larger and more compute-intensive, fine-tuning them locally becomes an increasingly difficult task. Furthermore, many recent models are not released, but instead made available as proprietary services. When a model cannot be fine-tuned locally, many practitioners opt instead for the so-called fine-tuning APIs ( OpenAI, 2024 ; Hugging Face, 2024 ; Dreambooth API, 2024 ; OctoAI, 2024 ) . These APIs are web services that host one or several pre-trained models and allow clients to perform limited fine-tuning. More specifically, APIs usually allow their clients to run parameter-efficient fine-tuning (PEFT), such as LoRA ( Hu et al., 2022 ) or Prefix-tuning ( Li & Liang, 2021 ) . These techniques allow adapting a model to a dataset while training a relatively small number of additional weights, which is particularly important for large language or image generation models that have billions of parameters. Although the fine-tuning APIs can be convenient, they also introduce new risks in terms of data privacy. When a client uses such an API to train on sensitive data, they need to ensure that their data will stay private Duan et al. (2023) . This is particularly important when dealing with patients’ medical records, personal user data, or trade secrets McMahan et al. (2017) ; Li et al. (2021) . The two main threats to data privacy are that the API provider obtains the private data and that a third party intercepts data in transit. Therefore, data privacy is not guaranteed even if the API provider is trusted. Several recent works propose LLM fine-tuning protocols that establish a certain level of privacy for multi-party fine-tuning Xiao et al. (2023) ; Duan et al. (2023) ; Li et al. (2023b) . Unfortunately, these algorithms work for a narrow class of fine-tuning algorithms, specifically prompt-tuning, or assume that a client can run LLM training locally using an obfuscated version of the model, provided by a remote server Xiao et al. (2023) . As a result, these algorithms are impractical for our use case of fine-tuning over an API. The few algorithms that are suitable for API fine-tuning guarantee the privacy of input tokens Li et al. (2023b) , meaning that the attacker can infer private training labels . In this work, we seek to alleviate this problem by designing a two-party fine-tuning protocol that performs standard parameter-efficient fine-tuning with privacy guarantees. We formulate our protocol as a special case of split learning (or vertical federated learning), where one side (server) holds the pre-trained model and the other (client) has private training data. More specifically, we focus on the privacy of client’s training labels . While input privacy is often crucial, there are scenarios where input data is publicly available, such as social media user pages. In these cases, labels could include ad clicks (known to the social network) or financial information (known to a bank that matches social profiles to its internal records). This example further justifies the use of LLMs, as social media pages often contain substantial amounts of text, and LLMs excel at processing long-context data. Instead of developing a specific privacy-preserving architecture, we seek algorithms that can work with popular existing models and PEFT algorithms. Furthermore, our approach relies on the properties of parameter-efficient fine-tuning. Notably, since the adapters are compact, both parties can maintain multiple sets of adapters and swap between them with relative ease. This allows us to design a PEFT-specific algorithm that can solve its task more effectively than general split learning strategies Li et al. (2022) . We summarize our main contributions as follows: • We analyze Low-Rank Adaptation, a common parameter-efficient fine-tuning algorithm, from the perspective of label privacy in the split learning setup. We observe that, despite fine-tuning less than 0.1\% of model parameters, PEFT algorithms leak client’s training labels against simple attacks that work for modern pretrained transformers. • Based on our analysis, we formulate a framework for privacy-preserving parameter-efficient fine-tuning (P 3 EFT). This framework leverages the properties of PEFT to obfuscate the gradients and parameters communicated during fine-tuning with little impact on the fine-tuned model quality. • To verify the practical viability of P 3 EFT, we conduct experiments on popular real-world PEFT workloads 1 1 1 The code is available at github.com/p3eft-iclr-2025/p3eft-iclr-2025 . Specifically, we fine-tune DeBERTa-v2-XXL ( He et al., 2021 ) , Flan-T5-Large ( Chung et al., 2022 ) and LLaMA-2 7B ( Touvron et al., 2023 ) on a set of standard language understanding problems. We find that, compared to prior split learning algorithms, P 3 EFT can maintain label privacy throughout training with a significantly smaller accuracy drop. 2 Background 2.1 Federated learning and split learning Privacy preservation in machine learning has been a subject of active study within several frameworks. An important branch of privacy-preserving learning methods is federated learning, or FL ( McMahan et al., 2017 ) , which can be broadly described as an approach allowing several parties to train a model jointly without sharing their private data. In particular, vertical federated learning ( Hardy et al., 2017 ; Yang et al., 2019 ) targets the scenario where different features (including the label) of each training instance are kept by different parties.

Read the complete text