XShare: Collaborative in-Batch Expert Sharing for Faster MoE Inference
Daniil Vankov, Nikita Ivkin, Kyle Ulrich, Xiang Song, Ashish Khetan, George Karypis · 2026
Read XShare: Collaborative in-Batch Expert Sharing for Faster MoE Inference by Daniil Vankov, Nikita Ivkin, Kyle Ulrich, Xiang Song, Ashish Khetan, George Karypis (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-07265.txt.
Description
Mixture-of-experts models save compute by activating only some experts per token, but batching and speculative decoding activate far more experts than expected, eroding the savings. Daniil Vankov and five co-authors present XShare, a method that treats batch-aware expert choice as an tuning problem.
Greedy methods pick experts to maximize total gating score for each batch, with no retraining and adaptation to every batch, including mixed data sets. Reported gains include up to 30 percent fewer expert activations under standard batching and up to three times lower peak GPU load in expert-parallel setups. Inference builders get a drop-in efficiency win for production MoE serving.
Catalog record
| CREATOR | Daniil Vankov, Nikita Ivkin, Kyle Ulrich, Xiang Song, Ashish Khetan, George Karypis |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 41 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-07265