Expressiveness Limits of Autoregressive Semantic ID Generation in Generative Recommendation
Yupeng Hou, Haven Kim, Clark Mingxuan Ju, Eduardo Escoto, Neil Shah, Julian McAuley · 2026
Read Expressiveness Limits of Autoregressive Semantic ID Generation in Generative Recommendation by Yupeng Hou, Haven Kim, Clark Mingxuan Ju, Eduardo Escoto, Neil Shah, Julian McAuley (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-06331.txt.
Description
Yupeng Hou and five co-authors expose an expressiveness limit in generative recommendation and propose a simple fix. Such models recommend by generating an item's semantic identifier token by token, which arranges all items on a single decoding tree. Items sitting close on that tree receive strongly correlated probabilities for any user, so the model struggles to rank near neighbors by personal taste, the authors observe, however well it is trained.
Theory confirms the structural coupling blocks even simple preference patterns that classic collaborative filtering captures easily. Their modification, Latte, inserts a latent token before each semantic identifier. One tree becomes many latent conditioned trees, giving items multiple paths at varied distances and loosening the coupling. The change improved a standard ranking metric by an average of about three and a half percent.
Catalog record
| CREATOR | Yupeng Hou, Haven Kim, Clark Mingxuan Ju, Eduardo Escoto, Neil Shah, Julian McAuley |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 63 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.06331