Cross-Family Speculative Decoding for Polish Language Models on Apple Silicon: An Empirical Evaluation of Bielik 11B with UAG-Extended MLX-LM

Krzysztof Fonał · 2026

Read Cross-Family Speculative Decoding for Polish Language Models on Apple Silicon: An Empirical Evaluation of Bielik 11B with UAG-Extended MLX-LM by Krzysztof Fonał (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-16368.txt.

Description

Fonal tests whether a small draft model from a different model family can speed up a large Polish language model on Apple Silicon. Extending the MLX-LM framework with Universal Assisted Generation, he pairs the Bielik 11B target with three smaller drafters and compares naive and context-aware token translation. Context-aware translation raised acceptance throughout, yet the Polish-specialized drafter lagged general-purpose rivals. Structured text reached 1.7 times normal speed, while varied instructions defeated the speedup, because verification costs stayed high on unified memory.

Catalog record

CREATORKrzysztof Fonał
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE82302
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.16368

Browse the full library · About the Tower of Babel