Navigating User Behavior toward Personalized Multimodal Generation
Hengji Zhou, Yufeng Liu, Ye Liu, Yong Xu, Lianghao Xia, Liqiang Nie · 2026
Read Navigating User Behavior toward Personalized Multimodal Generation by Hengji Zhou, Yufeng Liu, Ye Liu, Yong Xu, Lianghao Xia, Liqiang Nie (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-24196.txt.
Description
Zhou and colleagues teach image and video generators to tailor content for users who cannot describe what they want. Modern pipelines assume a well-formed instruction. Real users rarely articulate visual detail, so output drifts from their taste. Their 2026 system, NaviGen, builds a usable instruction for the next generator out of what the user has done before.
Each item gets a dual identifier. It pairs a collaborative code, capturing how users behave toward the item, with a textual code carrying its semantics. Behaviour thus becomes legible to language reasoning in one token stream. Training runs in two stages. Supervised fine-tuning distils preference reasoning and instruction writing from searched examples. Reinforcement learning then aligns output with user intent, through ranked, self-consistent rewards. Across product, game, and short-video domains, NaviGen improves tailored generation and next-item prediction. Its instructions grow more specific and relevant.
Catalog record
| CREATOR | Hengji Zhou, Yufeng Liu, Ye Liu, Yong Xu, Lianghao Xia, Liqiang Nie |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 41 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.24196