S 0 Tuning: Zero-Overhead Adaptation of Hybrid Recurrent-Attention Models
Jack Young · 2026
Read S 0 Tuning: Zero-Overhead Adaptation of Hybrid Recurrent-Attention Models by Jack Young (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-01168.txt.
Description
Young proposes S0 tuning, a way to adapt hybrid recurrent-attention language models by adjusting one starting state matrix in each recurrent layer while all weights stay frozen. With roughly 48 checked training examples and no added cost at run time, the method beats LoRA on HumanEval and lifts greedy accuracy on Qwen3.5-4B by 23.6 points. Gains carry over to math tasks but not to a text-to-SQL test.
Catalog record
| CREATOR | Jack Young |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 40388 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.01168