Intent-Driven Semantic ID Generation for Grounded Conversational News Recommendation

Hongyang Su, Beibei Kong, Lei Cheng, Chengxiang Zhuo, Zang Li, Chenyun Yu · 2026

Read Intent-Driven Semantic ID Generation for Grounded Conversational News Recommendation by Hongyang Su, Beibei Kong, Lei Cheng, Chengxiang Zhuo, Zang Li, Chenyun Yu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-07613.txt.

Description

Hongyang Su and five co-authors tackle conversational news recommendation, where suggestions must stay grounded in a fast-changing article pool while users hint at what they want only indirectly. From production dialogues they identify six intent types, five of them implicit, which create a retrieve-first bottleneck for standard retrieval pipelines.

Their system generates intent-driven semantic IDs in a generate-then-match scheme. A language model maps an intent to hierarchical ID prefixes. Those prefixes are fuzzy-matched against the live news pool, guaranteeing grounded picks. A profile-aware reasoning step serves brand-new users from profile data alone. On a large Chinese news platform, their model reported zero hallucination. It matched a GPT-4 hybrid system on top-level accuracy, beat it on finer measures, and cost about one hundred times less.

Catalog record

CREATORHongyang Su, Beibei Kong, Lei Cheng, Chengxiang Zhuo, Zang Li, Chenyun Yu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE69 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.07613

Browse the full library · About the Tower of Babel