AlpsBench: An LLM Personalization Benchmark for Real-Dialogue Memorization and Preference Alignment ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Information systems Personalization

Jianfei Xiao 1 , Xiang Yu 1 , Chengbing Wang 1 , Wuqiang Zheng 1 , Xinyu Lin 2 , Kaining Liu 1 , Hongxun Ding 1 , Yang Zhang 2 , Wenjie Wang 1 , Fuli Feng 1 , and Xiangnan He 1 · 2026

Read AlpsBench: An LLM Personalization Benchmark for Real-Dialogue Memorization and Preference Alignment ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Information systems Personalization by Jianfei Xiao 1 , Xiang Yu 1 , Chengbing Wang 1 , Wuqiang Zheng 1 , Xinyu Lin 2 , Kaining Liu 1 , Hongxun Ding 1 , Yang Zhang 2 , Wenjie Wang 1 , Fuli Feng 1 , and Xiangnan He 1 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-26680.txt.

Description

Xiao and co-authors introduce AlpsBench, a benchmark for personalisation in language models built from real chats. Lifelong assistants must manage personal facts over time, yet past tests lean on synthetic dialogue. AlpsBench holds 2,500 long interaction sequences from WildChat, paired with human-checked structured memories. Four tasks cover extracting, updating, retrieving, and using personal facts across a memory's life. Frontier models struggle to spot hidden user traits, memory updates hit a ceiling, and recall drops sharply when distractor pools grow.

Catalog record

CREATORJianfei Xiao 1 , Xiang Yu 1 , Chengbing Wang 1 , Wuqiang Zheng 1 , Xinyu Lin 2 , Kaining Liu 1 , Hongxun Ding 1 , Yang Zhang 2 , Wenjie Wang 1 , Fuli Feng 1 , and Xiangnan He 1
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36306
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.26680

Browse the full library · About the Tower of Babel