Less Is More: Engineering Challenges of On-Device Small Language Model Integration in a Mobile Application

William Oliveira Independent Researcher [email protected] · 2026

Read Less Is More: Engineering Challenges of On-Device Small Language Model Integration in a Mobile Application by William Oliveira Independent Researcher [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-24636.txt.

Description

Oliveira documents a five-day, 204-commit effort to put small language models into Palabrita. Palabrita is a production Android word-guessing game, run fully on device. The design retreats from letting the model generate whole structured puzzles. Instead, curated word lists supply the words. The model writes only three short hints, falling back deterministically if it fails. He catalogs five failure types, from format and constraint violations to latency and model-selection instability. Defensive parsing, retry and prompt-hardening tactics tamed them.

Catalog record

CREATORWilliam Oliveira Independent Researcher [email protected]
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE80223
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.24636

Browse the full library · About the Tower of Babel