LLMs Need Encoders for Semantic IDs Too DOI: XXXXXXX.XXXXXXX Conference: XXX; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2026/10 Conference: XXX; June 03–05, 2018; Woodstock, NY CCS: Information systems Recommender systems CCS: Computing methodologies Natural language generation

Xiangyi Chen, Zelun Wang, Xinyi Li, Yi-Ping Hsu, Jaewon Yang, Jiajing Xu · 2026

Read LLMs Need Encoders for Semantic IDs Too DOI: XXXXXXX.XXXXXXX Conference: XXX; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2026/10 Conference: XXX; June 03–05, 2018; Woodstock, NY CCS: Information systems Recommender systems CCS: Computing methodologies Natural language generation by Xiangyi Chen, Zelun Wang, Xinyi Li, Yi-Ping Hsu, Jaewon Yang, Jiajing Xu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-00324.txt.

Description

Xiangyi Chen and co-authors argue that semantic codes in shop tools need their own encoder. Such codes stack in layers to name goods for dream-based picks. A code chip means one thing in one stack and a next in the next. Stock tools just add chips to the word list.

Their tool, PrefixMem, reads each chip in light of its stack so far. Small n-gram note boards hold those stack-based traits. The tool can train on its own, then plug into any big model. Tests use large Pinterest data across model lines. Deep chip scores jump by up to near half in fair terms. Full-code hunt marks rise too, most on hard cases where fast picks fail.

Catalog record

CREATORXiangyi Chen, Zelun Wang, Xinyi Li, Yi-Ping Hsu, Jaewon Yang, Jiajing Xu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE41 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.00324

Browse the full library · About the Tower of Babel