AlpsBench: An LLM Personalization Benchmark for Real-Dialogue Memorization and Preference Alignment ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Information systems Personalization
Jianfei Xiao 1 , Xiang Yu 1 , Chengbing Wang 1 , Wuqiang Zheng 1 , Xinyu Lin 2 , Kaining Liu 1 , Hongxun Ding 1 , Yang Zhang 2 , Wenjie Wang 1 , Fuli Feng 1 , and Xiangnan He 1 · 2026
Read AlpsBench: An LLM Personalization Benchmark for Real-Dialogue Memorization and Preference Alignment ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Information systems Personalization by Jianfei Xiao 1 , Xiang Yu 1 , Chengbing Wang 1 , Wuqiang Zheng 1 , Xinyu Lin 2 , Kaining Liu 1 , Hongxun Ding 1 , Yang Zhang 2 , Wenjie Wang 1 , Fuli Feng 1 , and Xiangnan He 1 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-26680.txt.
Description
Xiao and co-authors introduce AlpsBench, a benchmark for personalisation in language models built from real chats. Lifelong assistants must manage personal facts over time, yet past tests lean on synthetic dialogue. AlpsBench holds 2,500 long interaction sequences from WildChat, paired with human-checked structured memories. Four tasks cover extracting, updating, retrieving, and using personal facts across a memory's life. Frontier models struggle to spot hidden user traits, memory updates hit a ceiling, and recall drops sharply when distractor pools grow.
Catalog record
| CREATOR | Jianfei Xiao 1 , Xiang Yu 1 , Chengbing Wang 1 , Wuqiang Zheng 1 , Xinyu Lin 2 , Kaining Liu 1 , Hongxun Ding 1 , Yang Zhang 2 , Wenjie Wang 1 , Fuli Feng 1 , and Xiangnan He 1 |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 36306 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.26680