LLMForge: Multi-Backend Hardware-Aware Neural Architecture Search with Infinite-Head Attention for Edge Language Models

Xinting Jiang, Junyi Luo, Ruichen Qi, Kauna Lei, Ben Laurie, Gregory Kielian, Mehdi Saligane, [0.4em] Brown University · 2026

Read LLMForge: Multi-Backend Hardware-Aware Neural Architecture Search with Infinite-Head Attention for Edge Language Models by Xinting Jiang, Junyi Luo, Ruichen Qi, Kauna Lei, Ben Laurie, Gregory Kielian, Mehdi Saligane, [0.4em] Brown University (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-17653.txt.

Description

Xinting Jiang and colleagues present LLMForge, a hardware-aware search for edge models. Sub-billion-parameter edge models gain privacy and latency, yet budgets make architecture cost central. Infinite-Head Attention decouples query heads, KV groups, and per-head dimensions. Forge-DSE pairs Forge-Former with a cost model for GPUs and ring accelerators. On the ring substrate, co-search returns three Pareto variants. The accurate variant has the lowest loss, the energy variant cuts energy per token by 40 percent, and the latency variant cuts TTFT and TPOT by 43 percent.

Catalog record

CREATORXinting Jiang, Junyi Luo, Ruichen Qi, Kauna Lei, Ben Laurie, Gregory Kielian, Mehdi Saligane, [0.4em] Brown University
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE59256
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.17653

Browse the full library · About the Tower of Babel