Less Is More: Engineering Challenges of On-Device Small Language Model Integration in a Mobile Application
William Oliveira Independent Researcher [email protected] · 2026
Read Less Is More: Engineering Challenges of On-Device Small Language Model Integration in a Mobile Application by William Oliveira Independent Researcher [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-24636.txt.
Description
Oliveira documents a five-day, 204-commit effort to put small language models into Palabrita. Palabrita is a production Android word-guessing game, run fully on device. The design retreats from letting the model generate whole structured puzzles. Instead, curated word lists supply the words. The model writes only three short hints, falling back deterministically if it fails. He catalogs five failure types, from format and constraint violations to latency and model-selection instability. Defensive parsing, retry and prompt-hardening tactics tamed them.
Catalog record
| CREATOR | William Oliveira Independent Researcher [email protected] |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 80223 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.24636