LAGO: Few-shot Crosslingual Embedding Inversion Attacks via Language Similarity-Aware Graph Optimization

Wenrui Yu, Yiyi Chen, Johannes Bjerva, Sokol Kosta, Qiongxiu Li · 2025

Read LAGO: Few-shot Crosslingual Embedding Inversion Attacks via Language Similarity-Aware Graph Optimization by Wenrui Yu, Yiyi Chen, Johannes Bjerva, Sokol Kosta, Qiongxiu Li (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-16008.txt.

Introduction

Text can be pried out of the number vectors that encode it, and a 2025 paper by Wenrui Yu and co-authors shows the attack works across languages with very little data. Embedding inversion turns those stored vectors back into words, a privacy risk for multilingual systems.

Their method, LAGO, links languages in a graph whose edges carry how alike two tongues are in word order and vocabulary. Learning then proceeds jointly across the graph, so a data-poor language borrows strength from its relatives. With as few as ten samples per language, the shared setup stays aligned. Tests across languages and models beat older attacks by ten to twenty percent on a standard overlap score.

Catalog record

CREATORWenrui Yu, Yiyi Chen, Johannes Bjerva, Sokol Kosta, Qiongxiu Li
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE37 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-16008

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

LAGO: Few-shot Crosslingual Embedding Inversion Attacks via Language Similarity-Aware Graph Optimization Wenrui Yu, Yiyi Chen, Johannes Bjerva, Sokol Kosta, Qiongxiu Li Abstract We propose LAGO - L anguage Similarity- A ware G raph O ptimization - a novel approach for few-shot cross-lingual embedding inversion attacks, addressing critical privacy vulnerabilities in multilingual NLP systems. Unlike prior work in embedding inversion attacks that treat languages independently, LAGO explicitly models linguistic relationships through a graph-based constrained distributed optimization framework. By integrating syntactic and lexical similarity as edge constraints, our method enables collaborative parameter learning across related languages. Theoretically, we show this formulation generalizes prior approaches, such as ALGEN, which emerges as a special case when similarity constraints are relaxed. Our framework uniquely combines Frobenius-norm regularization with linear inequality or total variation constraints, ensuring robust alignment of cross-lingual embedding spaces even with extremely limited data (as few as 10 samples per language). Extensive experiments across multiple languages and embedding models demonstrate that LAGO substantially improves the transferability of attacks with 10 10 - 20 % 20\% increase in Rouge-L score over baselines. This work establishes language similarity as a critical factor in inversion attack transferability, urging renewed focus on language-aware privacy-preserving multilingual embeddings. 1 Introduction Text embeddings, which encode semantic and syntactic information into dense vector representations, serve as the backbone of modern natural language processing (NLP) systems. They are also powering the Large Language Models, whose impact stretches far beyond NLP and is steadily shaping everyday lives and business operations. However, their widespread deployment in cloud-based services introduces significant privacy risks. A particularly concerning threat is the embedding inversion attack ( Song and Raghunathan 2020 ; Chen et al. 2025b ) , where the adversaries can decode sensitive and private data directly from the embedding vectors. The security of the system can be compromised when malicious users abuse the embedding model API, collecting massive datasets to train attack models. Data leakage, whether accidental or deliberate, further exacerbates this vulnerability. As vector databases and generative-AI services proliferate across the globe, the embedding vectors offered as commodities are mostly multilingual. Yet, prior researches in this attack space mostly concentrate on inverting English embeddings ( Song and Raghunathan 2020 ; Li et al. 2023 ; Morris et al. 2023 ; Huang et al. 2024 ) . While recent efforts ( Chen et al. 2024a ; Chen et al. 2024b ; Chen et al. 2025b ) touch upon multilingual and cross-lingual inversion attacks, they lack an explicit modeling of language similarities , resulting in poor generalization across languages. Figure 1: Few-shot Cross-lingual Textual Embedding Inversion Leveraging Language Similarities. Example: Attack model trained on English embeddings is used to attack embeddings in other languages, using language similarities as a prior. In real-world adversarial scenarios, such as specialized domains or low-resource languages, attackers may only have access to a handful of embedding-text pairs. Although ALGEN ( Chen et al. 2025b ) partially addresses the few-shot regime through decoder transfer, it lacks mechanisms to exploit language similarity, which we hypothesize is a key factor in crosslingual generalization failure. Prior studies have shown that language similarities, simulated from typological features and lexical overlapping, correlate with structural variations in inversion outputs ( Chen et al. 2024a ; Chen et al. 2025a ) , providing empirical motivation for incorporating such relationships into attack models. To address this, we propose LAGO ( L anguage Similarity- A ware G raph O ptimization ) for few-shot crosslingual embedding inversion. LAGO explicitly models linguistic relationships by constructing a topological graph over languages, where nodes represent languages and edges encode similarity. As illustrated in Fig. 1 , this graph is used to guide collaborative optimization of decoder alignment functions across languages, enabling knowledge transfer from typologically related neighbors. We formalize the attack objective as a distributed optimization problem, where each node corresponds to a language and constraints encode similarity-based consistency. We present two algorithmic variants: (1) an inequality-constrained approach based on IEQ-PDMM ( Heusdens and Zhang 2024b ) , and (2) a total variation regularized formulation ( Peng et al. 2021 ) that softly penalizes parameter drift across similar languages. Our main contributions include: • We propose LAGO, the first framework for few-shot crosslingual embedding inversion that incorporates language similarity as a structural prior in a graph-constrained optimization problem. • We develop two algorithmic variants, one using inequality constraints and one using total variation penalties, that enable collaborative parameter learning across languages. Prior work, including ALGEN, emerges as a special case within our framework (cf. Section 4.3 ). • Experiments across multiple embedding models and diverse languages show that language similarity strongly correlates with attack transferability, improving performance by 10 - 20% over prior methods. By exposing overlooked vulnerabilities in multilingual embedding systems and demonstrating effective inversion under realistic low-resource conditions, our work underscores the urgent need for stronger privacy protections in cross-lingual NLP deployments. While differential privacy offers some protection against our attack, it also significantly degrades downstream utility ( Chen et al. 2025b ) , highlighting the need for more targeted and efficient defense mechanisms. 2 Related Work 2.1 Embedding Inversion Attacks Early work on embedding inversion framed the task as classification over fixed vocabularies. For example, Song and Raghunathan 2020 aim to recover input tokens directly from embeddings, achieving up to 70% reconstruction. Subsequent advances recast the task as generation: Li et al. 2023 introduce a decoder-based approach to produce fluent text, while Morris et al. 2023 further improve accuracy through iterative refinement. Several work have since then extended inversion attacks to multilingual scenarios ( Chen et al. 2024b ; Chen et al. 2024a ) . Moreover, Huang et al. 2024 trains a surrogate model to conduct transfer attack on victim embeddings under black-box access. These methods, however, typically rely on massive training samples (8k to 5 million victim embeddings) and are primarily evaluated in monolingual or well-resourced settings. In practice, attackers often face few-shot scenarios. For example, reconstructing text in low-resource languages or specialized domains with only a handful of available samples. ALGEN ( Chen et al. 2025b ) introduces a linear alignment technique, allowing a decoder trained in one domain to be reused in another. While effective in few-shot transfer, ALGEN does not explicitly model language similarity or structural relationships between languages (cf. Section 3.2 ). Our framework improves ALGEN by directly incorporating linguistic knowledge to achieve stronger few-shot cross-lingual inversion. 2.2 Cross-lingual Transferability Crosslingual transferability is an central research topic in multilingual NLP. Prior researches leverage crosslingual transferability to improve downstream task performances in target languages, mainly through fine-tuning LLMs on related source languages ( Choenni et al. 2023 ) , or using zero-shot transfer ( Adelani et al. 2022 ; de Vries et al. 2022 ; Blaschke et al. 2025 ) or few-shot trasnfer with pre-trained MLLMs ( Lauscher et al. 2020 ) . Language similarity based on linguistic data, such as typological features ( Littell et al. 2017 ) and lexical databases ( Wichmann et al. 2022 ) , have been used extensively in facilitating crosslingual transfer ( Philippy et al. 2023 ) . In this work, we leverage language similarity generated from both syntactic features and lexical overlap to provide alternative perspectives on constructing graphs, to assist crosslingual inversion

Read the complete text