Cross-Family Speculative Decoding for Polish Language Models on Apple Silicon: An Empirical Evaluation of Bielik 11B with UAG-Extended MLX-LM
Krzysztof Fonał · 2026
Read Cross-Family Speculative Decoding for Polish Language Models on Apple Silicon: An Empirical Evaluation of Bielik 11B with UAG-Extended MLX-LM by Krzysztof Fonał (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-16368.txt.
Description
Fonal tests whether a small draft model from a different model family can speed up a large Polish language model on Apple Silicon. Extending the MLX-LM framework with Universal Assisted Generation, he pairs the Bielik 11B target with three smaller drafters and compares naive and context-aware token translation. Context-aware translation raised acceptance throughout, yet the Polish-specialized drafter lagged general-purpose rivals. Structured text reached 1.7 times normal speed, while varied instructions defeated the speedup, because verification costs stayed high on unified memory.
Catalog record
| CREATOR | Krzysztof Fonał |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 82302 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.16368