Concept-Aware Privacy Mechanisms for Defending Embedding Inversion Attacks
Yu-Che Tsai, Hsiang Hsiao, Kuan-Yu Chen, Shou-De Lin · 2026
Read Concept-Aware Privacy Mechanisms for Defending Embedding Inversion Attacks by Yu-Che Tsai, Hsiang Hsiao, Kuan-Yu Chen, Shou-De Lin (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-07090.txt.
Description
Yu-Che Tsai and three co-authors defend text embeddings against inversion attacks. Embeddings power many language applications, yet attacks can expose sensitive attributes or rebuild raw text from them. Old privacy defenses assume every embedding dimension is equally sensitive. That forces excess noise and degrades utility. Their system, SPARSE, gives concept-specific privacy protection shaped by user-defined concepts.
Two parts work together. Mask learning that can be differentiated finds the dimensions that are privacy-sensitive for each concept. A Mahalanobis mechanism then applies shaped noise tuned by dimension risk, perturbing sensitive dimensions while sparing non-sensitive meaning. Tests span six data sets, three embedding models, and several attack scenarios. SPARSE cut privacy leakage while beating top privacy methods on downstream scores.
Catalog record
| CREATOR | Yu-Che Tsai, Hsiang Hsiao, Kuan-Yu Chen, Shou-De Lin |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 73 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-07090