Super Apriel: One Checkpoint, Many Speeds

2026

Read Super Apriel: One Checkpoint, Many Speeds (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-19877.txt.

Introduction

The SLAM Labs team releases Super Apriel, a 15-billion-parameter language-model supernet whose every decoder layer offers four mixer choices, from full attention to gated delta variants. Any layer-by-layer placement can switch between requests without reloading weights, giving many speed presets from one checkpoint. Recommended hybrid presets run markedly faster at decoding while retaining 77 to 96 percent of quality, and the shared checkpoint also enables draft-free speculative decoding.

Catalog record

YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE143865
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.19877

Browse the full library · About the Tower of Babel