D-Legion: A Scalable Many-Core Architecture for Accelerating Matrix Multiplication in Quantized LLMs PubID: pubid: This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible.

Ahmed J. Abdelmaksoud, Cristian Sestito, Member, IEEE, Shiwei Wang, Senior Member, IEEE, Themis Prodromakis, Senior Member, IEEE · 2026

Read D-Legion: A Scalable Many-Core Architecture for Accelerating Matrix Multiplication in Quantized LLMs PubID: pubid: This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible. by Ahmed J. Abdelmaksoud, Cristian Sestito, Member, IEEE, Shiwei Wang, Senior Member, IEEE, Themis Prodromakis, Senior Member, IEEE (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-06252.txt.

Description

Matrix multiplication dominates the cost of running large language models, especially ones squeezed to very few bits per weight. Ahmed J Abdelmaksoud and 3 co-authors propose D-Legion, a many-core chip design built for exactly that work. Its cores are systolic arrays, grids that pass data rhythmically, and they adjust their precision to the numbers at hand.

Cores group into Legions that handle dense and sparse quantized multiplication in several modes. Partial sums are accumulated in parallel to cut memory traffic, and matrix tiles are broadcast across Legions to reuse data. A design sweep picked the best grouping. On attention workloads from two tiny-bit models, latency and memory use fell sharply.

Catalog record

CREATORAhmed J. Abdelmaksoud, Cristian Sestito, Member, IEEE, Shiwei Wang, Senior Member, IEEE, Themis Prodromakis, Senior Member, IEEE
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE48 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-06252

Browse the full library · About the Tower of Babel