SA-ADP: Sensitivity-Aware Adaptive Differential Privacy for Large Language Models Author’s draft for soliciting feedback - August 10, 2026

Stella Etuk, Ashraf Matrawy · 2025

Read SA-ADP: Sensitivity-Aware Adaptive Differential Privacy for Large Language Models Author’s draft for soliciting feedback - August 10, 2026 by Stella Etuk, Ashraf Matrawy (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-01748.txt.

Description

Stella Etuk and Ashraf Matrawy add sensitivity-aware privacy to language model training. Models can memorize training text, which risks leaking private facts. Differential privacy adds noise to guard that data. Classic methods add the same noise to all parameters.

Uniform noise wastes privacy budget on low-risk parts. Their SA-ADP method scales noise by sensitivity. Sensitive parts get more guard, dull parts get less. That split aims to keep model quality higher at the same privacy level for downstream tasks. Sensitivity scores come from the training data itself, so no hand-made list of private fields is needed before the method can run.

Catalog record

CREATORStella Etuk, Ashraf Matrawy
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE20 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-01748

Browse the full library · About the Tower of Babel