Efficient Quantization of Mixture-of-Experts with Theoretical Generalization Guarantees

Mohammed Nowaz Rabbani Chowdhury, Kaoutar El Maghraoui, Hsinyu Tsai, Naigang Wang, Geoffrey W. Burr, Liu Liu, Meng Wang · 2026

Read Efficient Quantization of Mixture-of-Experts with Theoretical Generalization Guarantees by Mohammed Nowaz Rabbani Chowdhury, Kaoutar El Maghraoui, Hsinyu Tsai, Naigang Wang, Geoffrey W. Burr, Liu Liu, Meng Wang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-06515.txt.

Description

Chowdhury and six colleagues assign different precisions to experts in sparse mixture-of-experts models, where only a few experts fire per input yet memory stays heavy. Their theory-backed rule keys bit-width mainly to how much each expert's router norm shifted during training. Steadier experts carry rare but critical features and suffer most from coarse quantization, so they stay precise, as do high-variance experts. On Switch Transformer and Mixtral it beat existing methods while trimming inference cost with negligible assignment overhead.

Catalog record

CREATORMohammed Nowaz Rabbani Chowdhury, Kaoutar El Maghraoui, Hsinyu Tsai, Naigang Wang, Geoffrey W. Burr, Liu Liu, Meng Wang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE106626
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.06515

Browse the full library · About the Tower of Babel