TL++: Accuracy and Privacy Preserving Traversal Learning for Distributed Intelligent Systems DOI: XXXXXXX.XXXXXXX Journal: TIST CCS: Computing methodologies Distributed artificial intelligence CCS: Security and privacy Systems security
Erdenebileg Batbaatar, Young Yoon · 2026
Read TL++: Accuracy and Privacy Preserving Traversal Learning for Distributed Intelligent Systems DOI: XXXXXXX.XXXXXXX Journal: TIST CCS: Computing methodologies Distributed artificial intelligence CCS: Security and privacy Systems security by Erdenebileg Batbaatar, Young Yoon (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-25627.txt.
Introduction
Hospitals and fleets cannot pool their raw data, yet models trained across silos usually lose accuracy or leak private details in transit. Erdenebileg Batbaatar and Young Yoon present TL++ in 2026, a traversal learning framework with two modes. Virtual batches are stitched across nodes so gradients behave like centralised training. The base mode swaps only cut layer activations and gradients instead of whole models, shrinking each step's traffic. A secure mode secret shares those tensors between two non colluding servers, so neither sees plaintext.
On an image benchmark the base and exact secure variants scored near ninety one percent. That beat the strongest rival baseline by over twelve points. Per step communication also fell thirteen fold against full model synchronisation. A medical question answering task under two tuning styles also favoured the framework. The authors scope the privacy claim carefully to honest, non colluding servers.
Catalog record
| CREATOR | Erdenebileg Batbaatar, Young Yoon |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 76 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.25627
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
TL++: Accuracy and Privacy Preserving Traversal Learning for Distributed Intelligent Systems DOI: XXXXXXX.XXXXXXX Journal: TIST CCS: Computing methodologies Distributed artificial intelligence CCS: Security and privacy Systems security Erdenebileg Batbaatar, Young Yoon Abstract . Distributed intelligent systems increasingly need to train across data silos without centralizing raw data. Federated learning keeps data local, but heterogeneous partitions can degrade accuracy and require repeated full-model exchange. Split learning reduces communication through cut-layer activations, but standard protocols do not generally recover pooled mini-batch gradients and may expose activations and gradients in plaintext. We present TL++, a two-mode traversal-learning framework that constructs virtual batches across nodes to recover centralized mini-batch gradient behavior under explicit synchronization assumptions. Base mode exchanges cut-layer activations and gradients instead of full models. Secure mode secret-shares each cut-layer activation and gradient between an orchestrator and a non-colluding helper, so neither server alone observes plaintext cut-layer tensors. This protection is limited to a semi-honest, non-colluding two-server setting; labels and output values used for loss remain visible to the orchestrator. In the lightweight secure path evaluated here, exactness requires the sharewise server path to be linear or affine; nonlinear server operations require nonlinear MPC or are approximate. We formalize TL++, analyze communication and computation costs, and evaluate it against federated- and split-learning baselines on CIFAR-10 and BioGPT/PubMedQA using full fine-tuning and LoRA. On CIFAR-10, TL++ base cut 1 and exact secure cut 3 achieve 91.41 ± 0.19 % 91.41\pm 0.19\% and 90.93 ± 0.17 % 90.93\pm 0.17\% accuracy, outperforming the strongest measured non-TL++ baseline by more than 12 percentage points. TL++ base cut 1 also reduces per-step communication payload by 13.1 × 13.1\times relative to full-model synchronization. PubMedQA results similarly favor TL++ under both tuning settings, though they remain descriptive without paired trajectories. Overall, TL++ approaches centralized-level utility while reducing communication and supporting scoped activation-level secret sharing. 1. Introduction Edge and distributed intelligent systems—including clinical monitors, autonomous fleets, and industrial sensors—generate sensitive data that could improve model robustness if pooled centrally. Centralization, however, raises privacy and bandwidth costs and can conflict with data-sovereignty regulations such as GDPR ( 12 ) and HIPAA ( 55 ) , as well as broader privacy and federated-learning concerns ( 25 ; 30 ) . A central challenge for distributed artificial intelligence (AI) is therefore to combine centralized-gradient equivalence , communication efficiency , and security of intermediate computations . Here, “accuracy losslessness” means producing the same mini-batch gradient update that centralized training would compute on the same sampled batch, not guaranteeing identical final test accuracy across all seeds or implementations. No existing paradigm satisfies all three requirements simultaneously. Federated Learning (FL) ( 38 ) keeps raw data on-device and aggregates local model updates, but falls short on each dimension. Under non-independent and identically distributed (non-IID) data, local/global gradient divergence degrades convergence with label skew ( 65 ; 26 ; 59 ; 2 ; 31 ) . Full-parameter exchange grows costly with model size; compression and quantization reduce bytes but may compound approximation error under heterogeneity ( 27 ; 36 ; 4 ; 6 ) . Finally, shared model updates can reveal training samples ( 66 ; 64 ; 13 ) , while secure aggregation ( 7 ) adds overhead and does not protect intermediate split-learning computations. Clustered Federated Learning (CFL) ( 48 ) improves personalization by partitioning incompatible clients into specialized models, but it remains an FL-family method: clients exchange model updates, the target is no longer the pooled centralized objective, and intermediate split-learning activations or gradients are not protected. CFL is therefore complementary to TL++ rather than a substitute for its virtual-batch and activation-level security design. Split Learning (SL) ( 18 ; 56 ) improves communication by transmitting cut-layer activations rather than full parameters, but it still processes one client’s samples per forward pass, precluding cross-participant gradient aggregation and large-batch benefits under heterogeneity ( 33 ) . It also sends cut-layer activations and gradients in plaintext, exposing them to gradient inversion ( 66 ) , model inversion ( 19 ) , and optimization-based reconstruction even at deep cuts ( 45 ) . Traversal Learning (TL) ( 5 ) resolves the accuracy limitation by coordinating mini-batch construction across distributed nodes. TL assembles virtual batches spanning multiple participants, enabling gradient aggregation mathematically equivalent to centralized training on pooled data, while retaining SL’s communication advantage of transmitting only cut-layer activations. TL satisfies accuracy losslessness and communication efficiency , but transmits activations and gradients in plaintext, offering no privacy guarantee against a semi-honest or compromised server. TL++ extends TL with two modes. Base mode reproduces TL’s plaintext protocol for trusted environments. Secure mode adds additive-secret-sharing-based multi-party computation (MPC) ( 9 ) through a non-colluding helper server, following common PPML designs ( 42 ; 41 ; 58 ) , so cut-layer activations and gradients are split rather than exposed. The helper provides privacy separation, not optimization: it owns no training data, does not define the objective, and only processes the second masked share. Without this non-colluding holder, the orchestrator would receive or reconstruct plaintext tensors, reducing secure TL++ to the trusted base setting. The cut also does not itself cause accuracy loss: it only assigns the upper-model forward pass and corresponding backpropagation to the server partition. If that partition evaluates the same f_{\text{server}} and returns the centralized cut-layer gradient, the node-side update remains centralized-gradient equivalent by the chain rule. Thus, f_{\text{server}} may be nonlinear in base mode. The linearity condition is narrower: the lightweight secure protocol can evaluate shares independently without changing the result only when the sharewise path is linear or affine. For a cut activation a=a^{(1)}+a^{(2)} , a linear/affine map L satisfies L(a^{(1)}+a^{(2)})=L(a^{(1)})+L(a^{(2)}) once the bias is handled once or shared consistently, and its Jacobian is independent of the hidden plaintext. ReLU, pooling, normalization, and softmax generally violate this identity; secure TL++ can still support them with secure nonlinear protocols, otherwise sharewise evaluation is an approximation. The current additive-sharing protocol therefore makes only some cuts exact; it does not require linear server networks in all TL++ architectures. This integration raises three corresponding challenges. (1) Accuracy: The server partition must return the same cut-layer gradient that centralized backpropagation would produce. Plain delegation of upper-layer backpropagation does not break accuracy losslessness; approximating or incorrectly evaluating the server-side computation under sharing does. (2) Communication: Secret sharing doubles cut-path activation traffic and adds helper/server coordination, so the useful operating point depends on cut depth and synchronization cost. (3) Security: The protocol must keep intermediate activations and cut-layer gradients shared while reconstructing only values needed for loss computation. Table 1 positions TL++ relative to prior paradigms. The main contributions are as follows. Table 1. Comparison of distributed learning paradigms. (A) Centralized-gradient equivalence under non-IID data. (C) Communication efficiency vs. full parameter transmission. (S) Protection for intermediate values under the stated threat model. ✓ satisfied; × not satisfied; \sim partial. For TL++ secure, the ✓ entries assume semi-honest non-colluding servers and an exact additive-share evaluation path. In the lightweight implementation evaluated here, exactness holds when the operations applied independently to additive shares are linear/affine. Nonlinear server-side operations require additional secure nonlinear protocols; otherwise the corresponding secure run is approximate. Method Transmission (A) (C) (S) FL ( 38 ) Model params × × × CFL ( 48