AHASD: Asynchronous Heterogeneous Architecture for LLM Adaptive Drafting Speculative Decoding on Mobile Devices

Zirui Ma 1,2 , Zhihua Fan 1 *, Wenxing Li 1 , Haibin Wu 1,2 , Fulin Zhang 1,2 , Wenming Li 1,2 *, Xiaochun Ye 1,2 · 2026

Read AHASD: Asynchronous Heterogeneous Architecture for LLM Adaptive Drafting Speculative Decoding on Mobile Devices by Zirui Ma 1,2 , Zhihua Fan 1 *, Wenxing Li 1 , Haibin Wu 1,2 , Fulin Zhang 1,2 , Wenming Li 1,2 *, Xiaochun Ye 1,2 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-25326.txt.

Description

Ma and six colleagues put forth AHASD, a phone NPU-PIM set-up for speculative decoding. In that scheme a small model drafts text and a large model checks it in batches. But phone drafting wastes work out of step and idles in step. AHASD drafts on the PIM and checks on one NPU at the same time, splitting draft from check, with controls that cut low-trust drafts. It beats GPU-only and GPU plus PIM baselines on speed and power, with cost below 3 percent of DRAM area.

Catalog record

CREATORZirui Ma 1,2 , Zhihua Fan 1 *, Wenxing Li 1 , Haibin Wu 1,2 , Fulin Zhang 1,2 , Wenming Li 1,2 *, Xiaochun Ye 1,2
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE33524
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.25326

Browse the full library · About the Tower of Babel