Public-Decay Homomorphic State Space Models for Private Sequence Inference

Luís Brito · 2026

Read Public-Decay Homomorphic State Space Models for Private Sequence Inference by Luís Brito (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-16647.txt.

Introduction

Brito presents public-decay state space models for sequence inference under fully homomorphic encryption, which keeps data encrypted during computation. The carried state updates through public decay, while costly ciphertext-ciphertext multiplication stays on a local write path. On Rotten Tomatoes and SST-2 validation sets, the encrypted path matches plaintext results exactly. It also runs about five times faster than polynomial attention of similar quality.

Catalog record

CREATORLuís Brito
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE59365
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.16647

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Public-Decay Homomorphic State Space Models for Private Sequence Inference Luís Brito Abstract Fully homomorphic encryption (FHE) changes sequence-model design because rotations, encrypted products, ciphertext materialization, multiplicative depth, and bootstrapping pressure can dominate ordinary neural-network costs. This paper presents public-decay homomorphic state space models (HSSMs), recurrent/state-space blocks whose carried state is updated through ciphertext-plaintext public decay while ciphertext-ciphertext multiplication remains on a local write path. The design keeps a fixed encrypted state across the sequence. The evaluated workflow separates client-side tokenization, frozen fastText lookup, projection, clipping, encryption, decryption, and thresholding from server-side encrypted evaluation over bounded projected features. On full Rotten Tomatoes and SST-2 validation splits, the encrypted HSSM path exactly matches plaintext classifications and reaches 0.7505 and 0.7420 accuracy. Against HE-friendly polynomial attention on the same fastText workloads, HSSM matches or exceeds full-sequence task quality while running about 5 × 5\times faster. Paired L40S operation-level rows show 1.34 1.34 – 1.62 × 1.62\times lower latency than cached final-token polynomial attention, 30 30 – 258 × 258\times lower latency than full-sequence polynomial attention, and lower logical encrypted-state footprint. A T = 16 / 32 T=16/32 comparator with encrypted public-linear input and Q/K/V projections shows projected HSSM succeeding under depth 8/ring 32768, while projected attention succeeds under depth 10/ring 65536. A matched T = 8 T=8 OpenFHE/FIDESlib trace finishes at final level 3 and noise-scale degree 2 on both backends. These results make public-decay carry a practical FHE co-design lever for encrypted sequence inference from bounded projected features. ACM CCS Concepts: Security and privacy Privacy-preserving protocols; Computing methodologies Neural networks. Keywords: fully homomorphic encryption, encrypted inference, state space models, private sequence inference. 1 Introduction Fully homomorphic encryption (FHE) offers a direct privacy promise for language inference: a client can encrypt inputs, a server can evaluate a model over ciphertexts, and only the client decrypts the output. The difficulty is that FHE changes the cost model of sequence modeling. Operations that are routine in plaintext neural networks, such as non-polynomial activations, softmax, layer normalization, matrix multiplication, rotations, packing conversions, and context-wide attention, become first-order systems constraints under encrypted execution. Recent HE/FHE language-model systems such as THE-X, Powerformer, EncryptedLLM, MOAI, Cachemir, AEGIS, and PriTran are predominantly transformer-shaped responses to those constraints [ 1 , 2 , 3 , 4 , 5 , 6 , 7 ] . This paper studies a focused architectural question: can a recurrent or state-space-style block be designed so that its encrypted carry path avoids ciphertext-ciphertext multiplication through time? A naive encrypted selective recurrence can still be expensive under FHE, because an encrypted input-dependent carry gate multiplied by an encrypted carried state consumes multiplicative depth at each step. HSSM instead fixes the recurrent carry to a public/plaintext decay and confines required ciphertext-ciphertext multiplication to a local write path: h_{t}=a\,h_{t-1}+g(x_{t})u(x_{t}) Here h_{t} is the encrypted recurrent state, a is public/plaintext, g(x_{t}) and u(x_{t}) are encrypted low-degree gate and write values, and client-side output handling remains outside the server-side homomorphic computation. In the measured task workflow, this boundary is concrete: tokenization, frozen fastText lookup, train-normalized random projection, clipping, encryption, decryption, and thresholding are client-side; the server receives encrypted bounded projected features. For the existing augmented-HSSM L40S task rows, each example enters the encrypted runner as T=4 chunks of width 128, or 512 bounded projected scalars, and server encrypted HSSM evaluation accounts for 10.61–10.65% of measured encryption/evaluation/decryption component time. The resulting design contribution is a public-decay recurrent/state-space-style block for FHE-oriented server-side sequence evaluation from this bounded-feature interface, with a clear encrypted carry-path depth argument when the public-decay invariant is preserved. The contribution is fourfold. First, the paper specifies the minimal HSSM block and its interface assumptions, including public model parameters, encrypted state, client-side preprocessing, and client-side output handling. Second, it compares HSSM symbolically with transformer-style encrypted inference and a naive encrypted selective recurrence in terms of state/cache growth, ciphertext-ciphertext products, rotations, and multiplicative-depth pressure. Third, it reports real FHE artifacts across OpenFHE CPU and FIDESlib CUDA, including L40S measurements and a matched OpenFHE/FIDESlib level trace for the same expanded HSSM path. Fourth, it separates task quality from systems cost: audited toy-feature runs are treated as latency/null-quality telemetry, the repaired fastText branch supplies the main encrypted task evidence, and the attention comparators now include both polynomial readouts and an operation-level projected-Q/K/V attention block. The strongest task-level signal comes from the repaired L40S fastText workflow. On Rotten Tomatoes and GLUE/SST-2, the selected HSSM encrypted forward path exactly matches plaintext classifications and reaches 0.7505 and 0.7420 accuracy, respectively. A joint fastText comparison then evaluates HSSM against two HE-friendly polynomial-attention readouts under the same bounded-feature task boundary. In this workflow, HSSM beats full-sequence polynomial attention on both datasets, uses a smaller logical encrypted-state footprint, and is about 4.9\times faster in encrypted evaluation. Cached final-token polynomial attention remains a strong short-context readout, especially on Rotten Tomatoes, which makes the result more informative: the public-decay design advantage appears when the comparator must represent sequence structure rather than only a final-token summary. The operation-level evidence addresses the stronger comparator question at block scope. The projected-attention artifact includes homomorphic public-linear input and Q/K/V projections from encrypted bounded features at T\in\{16,32\} . Under the measured L40S profiles, corrected projected HSSM succeeds at depth 8/ring 32768, while the encrypted-Q/K/V attention block succeeds at depth 10/ring 65536; in those rows, HSSM is faster and uses lower peak process GPU memory. A matched T=8 expanded HSSM trace also reconciles OpenFHE CPU and FIDESlib CUDA metadata: both backends finish the same path at final level 3 and noise-scale degree 2, while the earlier OpenFHE zero-remaining-level observation belongs to a different streaming recurrent schedule. Taken together, these results establish HSSM as a concrete FHE co-design pattern for server-side encrypted sequence computation from bounded features. The paper reserves causal-language-modeling extensions for a separate fixed-protocol encrypted LM study, keeping the present contribution centered on the measured sequence-inference path and its attention comparators. 2 Background and Related Work The recent private language-inference literature under HE/FHE is largely organized around making transformer blocks executable under encryption. THE-X frames encrypted transformer inference around polynomial approximations for operations that are not directly supported by standard HE tooling, including GELU, softmax, and layer normalization [ 1 ] . Powerformer continues that adaptation line by replacing softmax and layer normalization with HE-friendlier functions and optimizing homomorphic matrix multiplication [ 2 ] . EncryptedLLM studies GPU-accelerated FHE execution for an encrypted GPT-2 forward pass and activation approximations [ 3 ] . Later systems sharpen the bottleneck picture. MOAI targets packing flow, rotation-free softmax and layer-normalization algorithms, and reduced rotations in transformer-module execution [ 4 ] . Cachemir focuses on autoregressive decoding and the transformer KV-cache interaction with HE packing and bootstrapping placement [ 5 ] . AEGIS studies long-sequence encrypted transformers across multiple GPUs, where encoded weights and encrypted activations stress single-GPU memory and communication [ 6 ] . PriTran reports CPU-side CKKS transformer acceleration by reducing rotations and multiplications in ciphertext-plaintext and ciphertext-ciphertext matrix operations [ 7 ] . Together these works support the motivation for HSSM: transformer-shaped encrypted inference is possible, but the cost model is dominated by encrypted approximation, rotations, packing/layout, matrix operations, cache behavior, and long-context memory. For these 2026 references, Cachemir is cited as an under-review arXiv preprint, AEGIS as an

Read the complete text