AHASD: Asynchronous Heterogeneous Architecture for LLM Adaptive Drafting Speculative Decoding on Mobile Devices
Zirui Ma 1,2 , Zhihua Fan 1 *, Wenxing Li 1 , Haibin Wu 1,2 , Fulin Zhang 1,2 , Wenming Li 1,2 *, Xiaochun Ye 1,2 · 2026
Read AHASD: Asynchronous Heterogeneous Architecture for LLM Adaptive Drafting Speculative Decoding on Mobile Devices by Zirui Ma 1,2 , Zhihua Fan 1 *, Wenxing Li 1 , Haibin Wu 1,2 , Fulin Zhang 1,2 , Wenming Li 1,2 *, Xiaochun Ye 1,2 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-25326.txt.
Description
Ma and six colleagues put forth AHASD, a phone NPU-PIM set-up for speculative decoding. In that scheme a small model drafts text and a large model checks it in batches. But phone drafting wastes work out of step and idles in step. AHASD drafts on the PIM and checks on one NPU at the same time, splitting draft from check, with controls that cut low-trust drafts. It beats GPU-only and GPU plus PIM baselines on speed and power, with cost below 3 percent of DRAM area.
Catalog record
| CREATOR | Zirui Ma 1,2 , Zhihua Fan 1 *, Wenxing Li 1 , Haibin Wu 1,2 , Fulin Zhang 1,2 , Wenming Li 1,2 *, Xiaochun Ye 1,2 |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 33524 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.25326