MeKi: Memory-based Expert Knowledge Injection for Efficient LLM Scaling

Ning Ding, Fangcheng Liu, Kyungrae Kim, Linji Hao, Kyeng-Hun Lee, Hyeonmok Ko, Yehui Tang · 2026

Read MeKi: Memory-based Expert Knowledge Injection for Efficient LLM Scaling by Ning Ding, Fangcheng Liu, Kyungrae Kim, Linji Hao, Kyeng-Hun Lee, Hyeonmok Ko, Yehui Tang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-03359.txt.

Description

Model capacity stored on disk rather than computed is proposed by Ning Ding, with 6 co-authors, in a system called MeKi for edge devices. Scaling language models usually means more settings or more test-time computation, both impractical on phones with limited memory and processing units. Performant on-device models still matter for user experience, so a other scaling axis is needed for deployment under tight hardware budgets in consumer devices.

Each transformer layer gets token-level memory experts that inject pre-stored meaning knowledge during output. A re-parameterization strategy folds training matrices into a compact static lookup table stored in read-only memory. Capacity thus decouples from computational cost, with zero added use latency. Tests showed significant gains over dense earlier methods at identical use speed, validating memory-based scaling for on-device language models.

Catalog record

CREATORNing Ding, Fangcheng Liu, Kyungrae Kim, Linji Hao, Kyeng-Hun Lee, Hyeonmok Ko, Yehui Tang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE37 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-03359

Browse the full library · About the Tower of Babel