AlienLM: Alienization of Language for API-Boundary Privacy in Black-Box LLMs

Jaehee Kim, Pilsung Kang · 2026

Read AlienLM: Alienization of Language for API-Boundary Privacy in Black-Box LLMs by Jaehee Kim, Pilsung Kang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-22710.txt.

Introduction

Jaehee Kim and Pilsung Kang built AlienLM, a privacy layer that scrambles text before it reaches a black-box model API. Users must send prompts and data to outside providers, which puts private text at risk at that border. Their 2026 preprint translates the text into an alien tongue by a fixed word swap.

The swap is a bijection, so the text can be restored on return. The provider sees only the scrambled form. A deployable, API-only layer needs no change at the provider's end. The work seeks privacy without losing the model's use. That balance is the hard part.

Catalog record

CREATORJaehee Kim, Pilsung Kang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE79 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-22710

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

AlienLM: Alienization of Language for API-Boundary Privacy in Black-Box LLMs Jaehee Kim, Pilsung Kang Abstract Modern LLMs are increasingly accessed via black-box APIs, requiring users to transmit sensitive prompts, outputs, and fine-tuning data to external providers, creating a critical privacy risk at the API boundary. We introduce AlienLM, a deployable API-only privacy layer that protects text by translating it into an Alien Language via a vocabulary-scale bijection, enabling lossless recovery on the client side. Using only standard fine-tuning APIs, Alien Adaptation Training (AAT) adapts target models to operate directly on alienized inputs. Across four LLM backbones and seven benchmarks, AlienLM retains over 81% of plaintext-oracle performance on average, substantially outperforming random-bijection and character-level baselines. Under adversaries with access to model weights, corpus statistics, and learning-based inverse translation, recovery attacks reconstruct fewer than 0.22% of alienized tokens. Our results demonstrate a practical pathway for privacy-preserving LLM deployment under API-only access, substantially reducing plaintext exposure while maintaining task performance. 1 Introduction Large language models (LLMs) are commonly accessed through commercial black-box APIs. ( 33 ; 2 ; 13 ) Prompts, responses, and fine-tuning corpora transmitted through these APIs can contain sensitive information such as personally identifiable information, clinical notes, financial records, and proprietary documents. ( 34 ) This creates a concrete API-boundary exposure risk because users must transmit human-readable text to an external provider to obtain responses, exposing plaintext at the boundary. This exposure raises practical concerns for users and organizations. Recent user studies of LLM-based conversational agents report privacy concerns and show that disclosure behavior is shaped by interface framing such as perceived ephemerality. ( 27 ; 8 ) Even when providers offer data retention opt-outs, plaintext is still transmitted and processed on external infrastructure. ( 33 ; 2 ; 13 ) Users must still trust provider policies that cannot be independently verified. In the event of a data breach or unauthorized access, plaintext prompts and responses are immediately interpretable. These concerns motivate a mechanism that reduces plaintext exposure at the point of transmission, independent of provider-side policies and without claiming a formal privacy guarantee. We consider an API-only threat model in which the provider (or an observer of API traffic/logs) sees the transmitted text but does not have access to any client-held mapping configuration. Success is measured by the ability to recover readable plaintext or token-level mappings from the observed alien text. Given these concerns, a practical framework must satisfy three constraints. First, protection must work at the text level because users interact with APIs solely through text transmission without access to internal computations. Second, the framework must assume no model access, since commercial APIs do not expose model weights, gradients, or activations. Third, the primary goal is reducing exposure of prompts and responses at inference time, where sensitive content is actually exchanged. Existing privacy-preserving approaches fall into two families, neither of which satisfies these constraints. Cryptographic methods for secure inference, including fully homomorphic encryption, garbled circuits, secure multi-party computation, and trusted execution environments, can protect both model and inputs ( 12 ; 18 ; 29 ) . However, these techniques typically incur substantial latency overhead and assume access to model internals or specialized runtimes, making them incompatible with commercial black-box APIs. Training-time methods such as differential privacy and federated learning protect training data and fine-tuning pipelines ( 1 ; 21 ; 42 ) . However, they offer limited protection for inference-time prompt and response exposure, which constitutes the primary vulnerability in API-based applications. This leaves text-level privacy at the API boundary unaddressed. No existing method transforms plaintext into a form unreadable to humans while remaining processable by the model. We address this gap by framing exposure-reducing transformation as language translation. Our key insight is that if we can teach an LLM to ”speak” an artificial language that humans cannot read, we can transmit semantically meaningful content through the API without exposing plaintext. Building on this insight, we propose AlienLM. Using only public information, specifically the tokenizer and vocabulary, we construct an Alien Language by applying a bijective permutation to the base vocabulary. We then adapt the model to this new language via API-only fine-tuning, which we call Alien Adaptation Training (AAT). The bijection seed remains client-side; if disclosed, the protection is lost. Figure 1 illustrates the overall workflow. The client-side translator converts human-readable prompts into Alien Language before API transmission, and converts alien responses back to human-readable text after receiving them. The API only observes alien text in both directions, while authorized users with the translator can recover the original content. Specifically, we make the following contributions: • First black-box compatible text-level exposure-reduction layer. AlienLM operates entirely through API-only fine-tuning while preserving full vocabulary expressivity over 10^{5} + tokens. It differs from white-box approaches such as SentinelLM and symbol-limited schemes such as EmojiPrompt, which impose stronger access assumptions or restrict expressivity. ( 28 ; 23 ) • Effective adaptation without internal access. We show that optimizing bijections via proxy embeddings achieves 81%+ Oracle performance across four LLMs and seven benchmarks, demonstrating that cross-model representation alignment enables effective adaptation even without access to target model internals. • Controllable opacity-utility trade-off. The alienization ratio \rho enables fine-grained control: from selective alienization of sensitive fields ( \rho=0.3 , 93% Oracle) to full protection ( \rho=1.0 , 82% Oracle), supporting diverse deployment requirements. Figure 1 : Overview of AlienLM : client-side translation via a vocabulary-level bijection, server-side processing on alien text, and lossless decoding back to plaintext using shared token IDs under a permuted mapping. 2 Related Works Prior work on API-based LLM privacy largely falls into two categories: cryptographic secure inference (HE/MPC/TEE) and privacy-preserving training (DP/FL). Cryptographic systems can protect model and inputs but typically assume white-box access or specialized runtimes and incur substantial overheads, limiting practicality for black-box API deployment ( 12 ; 18 ; 29 ; 30 ; 26 ; 5 ) . DP/FL methods protect training data or fine-tuning pipelines but do not hide inference-time prompts and outputs—the primary exposure point in API settings ( 20 ; 42 ; 43 ) . This leaves a gap for deployable, text-level protection at the API boundary. Recent API-focused mechanisms aim to reduce prompt exposure through obfuscation or local filtering, but each involves notable trade-offs. EmojiPrompt ( 23 ) transforms prompts into emoji sequences before cloud submission; however, its restricted symbolic vocabulary can limit expressivity and reduce fidelity for technical inputs. PAPILLON ( 25 ) uses a local LLM (e.g., Llama-3.1-8B) to detect and mask PII before sending to cloud APIs; while effective for structured PII, this approach requires running a capable local model and leaves semantic content beyond explicit PII exposed. InferDPT ( 39 ) applies local differential privacy to perturb prompts, providing formal per-token guarantees but often incurring significant utility degradation under strong privacy parameters. Letter-level bijection attacks ( 15 ) demonstrate that LLMs can learn arbitrary encodings in-context, but operate at character level with only 26 symbols. The most closely related work is SentinelLM ( 28 ) , which also fine-tunes models on obfuscated inputs via token-level substitution. Our approach differs in that it performs a vocabulary-scale, lossless text transformation and adapts the target model via API-only fine-tuning, without relying on in-context decoding or local model infrastructure. However, SentinelLM

Read the complete text