Efficient Quantization of Mixture-of-Experts with Theoretical Generalization Guarantees
Mohammed Nowaz Rabbani Chowdhury, Kaoutar El Maghraoui, Hsinyu Tsai, Naigang Wang, Geoffrey W. Burr, Liu Liu, Meng Wang · 2026
Read Efficient Quantization of Mixture-of-Experts with Theoretical Generalization Guarantees by Mohammed Nowaz Rabbani Chowdhury, Kaoutar El Maghraoui, Hsinyu Tsai, Naigang Wang, Geoffrey W. Burr, Liu Liu, Meng Wang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-06515.txt.
Description
Chowdhury and six colleagues assign different precisions to experts in sparse mixture-of-experts models, where only a few experts fire per input yet memory stays heavy. Their theory-backed rule keys bit-width mainly to how much each expert's router norm shifted during training. Steadier experts carry rare but critical features and suffer most from coarse quantization, so they stay precise, as do high-variance experts. On Switch Transformer and Mixtral it beat existing methods while trimming inference cost with negligible assignment overhead.
Catalog record
| CREATOR | Mohammed Nowaz Rabbani Chowdhury, Kaoutar El Maghraoui, Hsinyu Tsai, Naigang Wang, Geoffrey W. Burr, Liu Liu, Meng Wang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 106626 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.06515