MeKi: Memory-based Expert Knowledge Injection for Efficient LLM Scaling
Ning Ding, Fangcheng Liu, Kyungrae Kim, Linji Hao, Kyeng-Hun Lee, Hyeonmok Ko, Yehui Tang · 2026
Read MeKi: Memory-based Expert Knowledge Injection for Efficient LLM Scaling by Ning Ding, Fangcheng Liu, Kyungrae Kim, Linji Hao, Kyeng-Hun Lee, Hyeonmok Ko, Yehui Tang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-03359.txt.
Description
Model capacity stored on disk rather than computed is proposed by Ning Ding, with 6 co-authors, in a system called MeKi for edge devices. Scaling language models usually means more settings or more test-time computation, both impractical on phones with limited memory and processing units. Performant on-device models still matter for user experience, so a other scaling axis is needed for deployment under tight hardware budgets in consumer devices.
Each transformer layer gets token-level memory experts that inject pre-stored meaning knowledge during output. A re-parameterization strategy folds training matrices into a compact static lookup table stored in read-only memory. Capacity thus decouples from computational cost, with zero added use latency. Tests showed significant gains over dense earlier methods at identical use speed, validating memory-based scaling for on-device language models.
Catalog record
| CREATOR | Ning Ding, Fangcheng Liu, Kyungrae Kim, Linji Hao, Kyeng-Hun Lee, Hyeonmok Ko, Yehui Tang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 37 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-03359