LLMForge: Multi-Backend Hardware-Aware Neural Architecture Search with Infinite-Head Attention for Edge Language Models
Xinting Jiang, Junyi Luo, Ruichen Qi, Kauna Lei, Ben Laurie, Gregory Kielian, Mehdi Saligane, [0.4em] Brown University · 2026
Read LLMForge: Multi-Backend Hardware-Aware Neural Architecture Search with Infinite-Head Attention for Edge Language Models by Xinting Jiang, Junyi Luo, Ruichen Qi, Kauna Lei, Ben Laurie, Gregory Kielian, Mehdi Saligane, [0.4em] Brown University (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-17653.txt.
Description
Xinting Jiang and colleagues present LLMForge, a hardware-aware search for edge models. Sub-billion-parameter edge models gain privacy and latency, yet budgets make architecture cost central. Infinite-Head Attention decouples query heads, KV groups, and per-head dimensions. Forge-DSE pairs Forge-Former with a cost model for GPUs and ring accelerators. On the ring substrate, co-search returns three Pareto variants. The accurate variant has the lowest loss, the energy variant cuts energy per token by 40 percent, and the latency variant cuts TTFT and TPOT by 43 percent.
Catalog record
| CREATOR | Xinting Jiang, Junyi Luo, Ruichen Qi, Kauna Lei, Ben Laurie, Gregory Kielian, Mehdi Saligane, [0.4em] Brown University |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 59256 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.17653