Scaling Long-Sequence Homomorphic Encrypted Transformer Inference via Hybrid Parallelism on Multi-GPU Systems CCS: Security and privacy Cryptography CCS: Computer systems organization Distributed architectures CCS: Computing methodologies Parallel algorithms

Zhaoting Gong, Ran Ran, Fan Yao, Wujie Wen · 2026

Read Scaling Long-Sequence Homomorphic Encrypted Transformer Inference via Hybrid Parallelism on Multi-GPU Systems CCS: Security and privacy Cryptography CCS: Computer systems organization Distributed architectures CCS: Computing methodologies Parallel algorithms by Zhaoting Gong, Ran Ran, Fan Yao, Wujie Wen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-03425.txt.

Description

Gong and colleagues scale encrypted transformer inference across many graphics cards, where long inputs exceed single-card memory. Their AEGIS system places data by ciphertext links so communication happens only when app needs demand it, with the rest hidden behind compute. Communication falls about 58 percent in feed-forward layers and 81 percent in attention, with a scaling rate near 97 percent on four cards.

Catalog record

CREATORZhaoting Gong, Ran Ran, Fan Yao, Wujie Wen
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE72213
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.03425

Browse the full library · About the Tower of Babel