ALPBench: A Benchmark for Attribution-level Long-term Personal Behavior Understanding Lu Ren 1,* , Junda She 1,* , Xinchen Luo 1,* , Tao Wang 1,* , Xin Ye 1 , Xu Zhang 1 , Muxuan Wang 1 , Xiao Yang 1 , Chenguang Wang 1 , Fei Xie 1 , Yiwei Zhou 1 , Danjun Wu 1 , Guodong Zhang 1 , Yifei Hu 1 , Guoying Zheng 1 , Shujie Yang 1 , Xingmei Wang 1 , Shiyao Wang 1 , Yukun Zhou 1 , Fan Yang 1 , Size Li 1 , Kuo Cai 1 , Qiang Luo 1 , Ruiming Tang 1, † \dagger , Han Li 1 , Kun Gai 1 1 KuaiShou Inc., Beijing, China * Equal contribution {renlu05, shejunda, luoxinchen, wangtao37, tangruiming}@kuaishou.com Abstract Recent advances in large language models (LLMs) have highlighted their potential for personalized recommendation, where accurately capturing user preferences remains a key challenge. Leveraging their strong reasoning and generalization capabilities, LLMs offer new opportunities for modeling long-term user behavior. To systematically evaluate this, we introduce ALPBench, a Bench mark for A ttribution-level L ong-term P ersonal Behavior Understanding. Unlike item-focused benchmarks, ALPBench predicts user-interested attribute combinations, enabling ground-truth evaluation even for newly introduced items. It models preferences from long-term historical behaviors rather than users’ explicitly expressed requests, better reflecting enduring interests. User histories are represented as natural language sequences, allowing interpretable, reasoning-based personalization. ALPBench enables fine-grained evaluation of personalization by focusing on the prediction of attribute combinations task that remains highly challenging for current LLMs due to the need to capture complex interactions among multiple attributes and reason over long-term user behavior sequences. The dataset is available at ALP-Bench on Hugging Face . 1 Introduction Large language models (LLMs) 6 ; 31 ; 20 ; 1 have achieved remarkable success across diverse general-purpose tasks, exhibiting strong capabilities in language understanding 28 ; 11 , programming 5 ; 23 , and other complex reasoning scenarios. As these models continue to mature, an increasingly important direction is the shift from general intelligence toward personalized intelligence 21 , where models are expected to adapt their behavior to individual users rather than serving a generic population. Personalized intelligence is inherently multi-faceted, and can manifest across multiple dimensions, including writing style 25 , conversational tone 25 , and recommendation 12 . Among these dimensions, recommendation ability plays a particularly critical role in evaluating personalized intelligence. From a practical perspective, recommendation systems lie at the core of many real-world applications and directly influence the user experience. When applied to recommendation, LLMs can leverage rich and diverse user interaction histories, providing abundant signals for modeling individual preferences. Moreover, recommendation outcomes are grounded in observable user behaviors, making them relatively straightforward to verify and evaluate at scale. These properties make recommendation a compelling and well-defined testbed for studying how well LLMs can understand and adapt to individual users. Most existing benchmarks 12 ; 29 for evaluating recommendation capabilities frame the task as predicting a specific item that a user will interact with. While this formulation has been effective for traditional recommendation models, it introduces fundamental challenges when used to assess the reasoning and personalization abilities of large language models. In practical recommendation systems, item-level predictions are strongly influenced by real-time factors, such as cold-start effects for newly introduced items, item popularity, and platform dynamics. As a result, the ground-truth item is often influenced by factors that are orthogonal to the user’s stable interests. For example, a user who is interested in basketball may be recommended very different videos at different times depending on the NBA schedule, trending events, or platform-wide exposure strategies. Accurate prediction requires not only understanding the user’s underlying preferences, but also modeling system-level dynamics and real-time signals. However, these real-time factors are neither the focus nor the strength of LLMs, and conflating them with preference modeling can obscure the true personalized reasoning capability of the model. Therefore, we argue that a more appropriate evaluation should decouple stable user interests from transient system dynamics and focus on the aspects of recommendation that are amenable to reasoning and generalization. To achieve this goal, we propose the Long-Term Personal Behavior Understanding Bench (ALPBench), a benchmark that reformulates recommendation evaluation as an attribute prediction task based on user historical behavior. This formulation directly targets the preference modeling component of recommendation, which is stable over time and amenable to reasoning. Furthermore, the task remains easy to verify, as ground-truth labels are naturally derived from the attributes of items actually consumed by the user. Finally, the attribute prediction task can support a wide range of downstream applications. For example, predicted attribute can be further integrated with external retrieval components, such as lexical indices 9 , to match an item for recommendation. In addition to the novel task design, our benchmark also enables a systematic investigation of long-term user understanding. We construct multiple versions of the task with increasing historical sequence lengths, allowing us to study how models scale with more extensive user histories. This setting reveals whether a model can consistently aggregate long-term behavioral signals into coherent preference representations, a capability that is essential for personalized intelligence but remains challenging for current LLMs. Our contributions are summarized as follows: • We propose attribute-level user interest prediction as a principled objective for evaluating personalized intelligence in LLMs, explicitly decoupling stable user preferences from transient real-time factors (e.g., popularity and platform dynamics) and focusing on long-term, inferable personalization signals. • We introduce a new benchmark for long-sequence personalized intelligence, constructed from real-world industrial user behavior data with long historical contexts, covering eight categories and rich attribute annotations. • Through extensive evaluations of state-of-the-art LLMs (including Claude, Qwen, GLM, Kimi, Gemini, GPT, DouBao-seed, Minimax and Deepseek families), we show that existing LLMs, despite strong general capabilities, still struggle to effectively exploit long behavioral sequences for personalized user understanding. 2 Related Works 2.1 Benchmarks for Long Context Early benchmarks for long-context evaluation primarily focused on Needle-in-a-Haystack tests 35 ; 17 ; 27 , assessing a model’s ability to retrieve specific facts from very long sequences. Subsequent benchmarks 37 ; 16 extended this to summarization and reasoning, still assuming all relevant information is fully contained in the context. L-Eval 2 and LongBench 3 aggregate existing datasets (e.g., QASPER 7 , GovReport 13 ) into large-scale long-context evaluation suites covering QA, summarization, retrieval, and coding. DeepSearch 8 specifically targets evaluation of Deep Research Agents. More recent work studies long-context evaluation in interactive dialogue. Some generate sessions exceeding 100k tokens 24 ; 4 , while benchmarks such as LongMemEval 34 and PersonaMem 14 scale contexts up to nearly 1M tokens using persistent persona-driven conversations. 2.2 Benchmarking Personal Performance Table 1: Detailed statistics of the ALPBench . Context Token Range (k) indicates the min/max sequence lengths (in thousands of tokens) for the 3-month (3-M), 6-month (6-M), and 1-year (1-Y) interaction history. Avg. #Item. denote the average interactions per user. #Users represents the total number of unique users. Categories Context Token Range (k) Avg. #Inter. #Users 3-M 6-M 1-Y 3-M 6-M 1-Y Pants 0.9\sim 220.2 0.9\sim 244.6 2.3\sim 251.1 339 591 1049 100 Shoes 0.6\sim 146.5 5.5\sim 204.3 5.5\sim 273.3 362 652 1098 100 Apparel 0.7\sim 158.6 1.8\sim 189.9 2.1\sim 274.5 367 665 1147 100 Snacks 0.6\sim 211.7 5.1\sim 217.5 5.9\sim 284.7 429 696 1102 100 Baijiu 0.8\sim 123.9 0.8\sim 159.8 1.2\sim 185.4 194 256 455 100 Badminton Racket 0.8\sim 216.9 0.8\sim 276.1 1.4\sim 338.9 285 380 527 100 Cell Phones 0.8\sim 186.4 0.8\sim 186.9 1.0\sim 187.0 216 294 487 100 Fishing Rods 0.9\sim 125.4 0.9\sim 223.9 1.2\sim 322.5 201 284 496 100 Existing benchmarks for evaluating personalization in LLMs can be roughly grouped by focus. Some, such as LaMP 25 ; 26 , PDR-Bench 19 , PrefEval 38 and PersonaFeedback 30 , emphasize fine-grained response-level personalization, providing classification or generation tasks, research-focused scenarios, or human-annotated benchmarks for tailoring responses to explicitly specified personas. Others, including PersonaMem 14 , PersonaLLM 15 , and PREFDISCO 18 , evaluating the ability of LLMs to follow or adapt to evolving user personas over multi-round conversations, including dialogues exceeding 100k tokens and multiple topics. 3 Long-Term Personal Behavior Understanding Benchmark Figure 1: The complete data collection process of ALPBench, including four stages: data collection, data filtering, data cleaning, and data review. The Long-Term Personal Behavior Understanding Benchmark (ALPBench) is constructed from real-world Chinese e-commerce interaction data collected on the Kuaishou platform and is designed to evaluate large language models in long-context, language-grounded personalization scenarios. Leveraging users’ historical item interactions—including clicks, add-to-cart actions, and purchases ALPBench requires models to predict the attributes of items that users are most likely to purchase next. Unlike setups where models respond to explicit user queries, ALPBench requires the implicit inference of user preferences from historical behavioral trajectories. All ground-truth labels are derived directly from authentic user interactions, ensuring an objective and verifiable evaluation. To support effective long-context modeling, input contexts are enriched with comprehensive behavioral and item-level features, providing dense signals to enable accurate preference prediction. 3.1 Overview of ALPBench Context. User historical behavior sequences are constructed from e-commerce interactions, including clicks, add-to-cart actions, and purchases, spanning three temporal horizons: 3, 6, and 12 months. All interactions are ordered chronologically to form a long-range behavioral context. For each item within the behavioral sequence, we incorporate a multi-faceted set of attributes to enrich the semantic representation: • Title. The original product title, which provides a summary of the item. • Selling Points. A distilled, platform-curated summary highlighting core functionalities and value propositions. This attribute captures the specific item characteristics most likely to trigger user engagement. • Price Tiers. We categorize price into three levels (low, medium and high), encompassing both the final transaction price for orders and the displayed price during interactions. The statistical metadata of ALPBench, including context length, the number of interacted items, and user population, are summarized in Table 1 , while the attribute prediction details for the eight sub-tasks are provided in the Appendix A . Formation of task. ALPBench is designed to infer coherent combinations of product attributes that reflect users’ latent preferences. Rather than predicting each attribute independently, it requires models to jointly reason over multiple interdependent attributes to identify a consistent preference profile. Let \mathcal{A}_{C}=\{A_{1},A_{2},\dots,A_{k}\} denote the set of target attributes for a given category C . For each attribute A_{j} , a candidate value set \mathcal{V}_{j} is provided. The model is required to output a preference profile \mathbf{y}=\{v_{1},v_{2},\dots,v_{k}\} , where v_{j}\in\mathcal{V}_{j} . This objective can be formalized as selecting the optimal attribute combination \mathbf{y}^{*} from the joint combinatorial space \mathcal{V}=\mathcal{V}_{1}\times\mathcal{V}_{2}\times\dots\times\mathcal{V}_{k} : \hat{\mathbf{y}}=\text{LLM}(S_{u},C,\mathcal{A}_{C},\{\mathcal{V}_{1},\dots,\mathcal{V}_{k}\}), (1) where S_{u} denotes the user’s long-range behavioral context. This formulation requires large language models to perform reasoning over a attribute space, grounded in personal behavioral histories. 3.2 Dataset Collection Real-world e-commerce user logs are large and heterogeneous, often containing incomplete or inconsistent product metadata. These issues make it difficult to generate accurate evaluation benchmarks. To address this, we design a two-stage data curation pipeline: (1) interaction-based category selection, and (2) user filtering and context denoising. The first stage mitigates metadata inconsistencies by focusing on high-frequency categories, while the second stage removes low-intent actions and anomalous noise to refine the interaction data. The overall process is illustrated in the Figure 1 . Interaction-based Category Selection. To alleviate noise introduced by fragmented product metadata, we analyze interaction statistics from the Kuaishou e-commerce pool and select high-frequency categories as prediction targets. These categories yield more reliable behavioral signals, allowing us to suppress label noise from sparse interation actions and achieve a more stable characterization of user preferences. User Filtering and Denoising. To purify the interaction space from anomalous noise, we leverage the behavioral patterns characteristic of major shopping festivals. We posit that during such periods, purchasing decisions are more deliberate and significantly more reflective of a user’s stable, long-term preferences compared to routine browsing. Therefore, we adopt a strict temporal partitioning strategy: We chose the cut-off time which is a shopping festival. The interactions occurring before the cut-off time are treated as the historical context, while subsequent verified purchase events after the cut-off time serve as the ground-truth targets. We retain only those users who have at least one confirmed purchase record within their historical context. It filters out inactive or low-intent users whose behavioral sequences are too sparse to yield meaningful patterns. 3.3 Data cleaning Context Cleaning. To construct a robust representation of the user’s journey, we collect the titles, selling points, and price tiers for each product in the interaction sequence. Integrating these heterogeneous signals yields a holistic semantic representation of individual items. To refine the context, we apply a two-step noise reduction process: (1) filtering out purely functional or non-informative content such as URLs, and (2) removing immediate duplicates to reduce redundancy. In addition, LLM-based semantic checks are applied to identify and remove residual noisy signals. Label Cleaning. Raw attribute values often contain repetitions, inconsistencies, or ambiguous expressions. To address this, we apply an auxiliary semantic normalization process, using a LLM (e.g. Gemini-2.5-Pro) to filter and map synonymous or near-duplicate attribute values to canonical forms. This procedure improves attribute consistency and enhances the verifiability of the resulting data. Examples of attributes filtered by the large model are provided in Appendix 3 . 3.4 Data review To ensure the quality and reliability of ALPBench, we adopt a carefully structured quality assurance process that integrates human review with model-assisted support mechanisms. The review protocol is outlined below: Given that most samples in our dataset involve long sequences, the protocol is primarily designed for long-context verification. For cases where fully manual inspection is impractical, we employ a scalable, assisted review approach. An auxiliary model first generates a candidate answer along with an explicit reasoning trace, providing a structured summary of how the task can be solved based on the complete interaction history. Human reviewers then assess whether the reasoning is coherent, logically valid, and sufficiently supported by the underlying context. All final quality judgments are made by human reviewers, with model-generated outputs serving only to support efficient and consistent evaluation. For a few of short-context samples, Manual checks is used to verify the data in terms of both relevance and correctness. Table 2: Performance Comparison of Different LLMs on ALPBench with 1Y User Interaction Contexts(in %). Within each LLM family, the best result is highlighted in bold. Model Pants Shoes Apparel Snacks Phones BaiJiu Fish Rods Badm. racket F1 Attr. F1 Attr. F1 Attr. F1 Attr. F1 Attr. F1 Attr. F1 Attr. F1 Attr. Qwen3-30B-A3B 1.33 33.98 0.00 24.33 0.20 19.38 0.00 24.67 0.00 37.10 13.67 47.87 10.67 50.21 21.00 58.58 Qwen3-235B-A22B 2.40 39.84 1.17 25.32 1.53 23.98 0.00 21.29 0.00 41.86 16.90 53.54 9.33 51.90 15.80 55.90 Qwen3-Max-Preview 5.89 55.60 4.65 39.36 1.86 38.89 0.00 28.13 1.67 42.06 17.80 51.46 18.33 55.12 23.67 59.03 GLM-4.5 3.33 42.40 2.04 30.21 0.17 29.88 1.70 18.79 0.00 37.10 17.63 53.35 12.50 49.88 17.23 59.42 GLM-4.6 5.70 46.90 6.75 31.97 0.00 29.84 0.01 20.12 0.00 38.35 17.07 58.55 9.17 60.89 19.20 62.17 Gemini-2.5-Flash 4.57 49.10 3.29 33.99 0.34 34.40 0.29 30.32 0.00 42.03 17.53 59.92 16.81 65.21 21.56 63.61 Gemini-2.5-Pro 5.47 56.53 5.65 42.64 1.42 42.66 0.22 29.93 0.33 45.08 19.20 62.16 18.17 68.48 19.30 63.44 MiniMax-M2 5.26 44.40 2.23 31.73 1.52 34.50 0.00 26.90 0.00 40.71 17.02 56.33 15.17 55.32 22.07 58.53 MiniMax-M2.1 4.02 54.51 2.92 38.66 0.22 37.55 0.29 29.28 0.00 42.32 16.57 54.08 13.27 60.35 18.77 57.74 DeepSeek R1 4.00 34.88 1.07 20.89 0.00 19.61 0.00 20.75 0.00 38.58 15.83 55.27 16.33 53.87 16.67 54.03 DeepSeek V3.2 3.49 37.38 1.20 24.51 0.33 23.20 0.00 20.37 0.00 40.67 18.87 63.13 14.83 57.90 17.73 59.08 GPT-5.2-Chat 4.10 52.90 3.95 39.58 1.18 39.76 0.00 28.27 0.00 46.61 15.37 59.34 12.23 60.65 17.80 58.73 DouBao 6.54 56.56 4.07 39.81 0.50 40.42 0.00 31.10 0.00 45.78 20.08 65.12 18.33 65.21 25.50 65.92 Claude 4.5 Sonnet 5.31 46.06 4.11 32.74 1.19 29.33 0.00 17.23 0.00 43.35 18.45 63.11 13.77 59.94 19.03 59.50 Kimi 2.56 20.63 0.67 12.37 0.00 12.74 0.00 8.54 0.00 36.56 6.67 37.93 11.67 40.38 15.33 50.53 4 Experiments 4.1 Experiment on ALPBench Experiment Setup. We evaluate a diverse set of state-of-the-art large language models (LLMs) from multiple research and industrial ecosystems to comprehensively assess their personalized recommendation capabilities under long-context user behavior settings. The evaluated models include Qwen3-30B-A3B-Think-2507, Qwen3-235B-A22B-Instruct-2507 32 , and Qwen3-Max-Preview 33 ; GLM-4.5 and GLM-4.6 36 ; Gemini-2.5-Pro and Gemini-2.5-Flash; DeepSeek-R1 10 and DeepSeek-V3.2 20 ; DouBao-seed-1.8; Claude Sonnet 4.5; GPT-5.2-Chat; as well as Kimi-K2 31 . We perform zero-shot evaluations on eight tasks using the selected models, with all inputs presented in a unified format to ensure fair comparison. For completeness, all prompts used in these experiments are provided in Appendix A.2 . Evaluation Metrics. Let \hat{\mathbf{y}}_{i}=\{\hat{v}_{i,1},\dots,\hat{v}_{i,k}\} be the predicted preference attribute set for instance i , and let \mathbf{y}_{i}=\{v_{i,1},\dots,v_{i,k}\} be the corresponding ground-truth attribute set f, where k denotes the number of attributes in each attribute set. Each instance may have multiple valid attribute combinations. We define \mathcal{D} as the set of ground-truth sets and \mathcal{D}_{\text{pred}} as the set of LLM predictions. We evaluate model performance using the following metrics: • Profile-level Precision. Measures the proportion of prediction that exactly match the corresponding ground-truth: \text{Precision}=\frac{|\{i\in\mathcal{D}_{\text{pred}}:\hat{\mathbf{y}}_{i}=\mathbf{y}_{i}\}|}{|\mathcal{D}_{\text{pred}}|} (2) • Profile-level Recall. Measures the proportion of ground-truth that exactly match the corresponding predictions: \text{Recall}=\frac{|\{i\in\mathcal{D}:\hat{\mathbf{y}}_{i}=\mathbf{y}_{i}\}|}{|\mathcal{D}|} (3) • Profile-level F1. The harmonic mean of precision and recall, capturing overall joint correctness: \text{F1}_{\text{profile}}=\frac{2\cdot\text{Precision}\cdot\text{Recall}}{\text{Precision}+\text{Recall}} (4) • Attribute-level F1 (Attr-F1). Computes the F1 score for each attribute independently and averages across all k attributes to capture fine-grained correctness. \text{Precision}_{j} and \text{Recall}_{j} are computed over all instances for attribute A_{j} . This metric reflects the model’s ability to correctly predict each attribute individually.: \text{Attr-F1}=\frac{1}{k}\sum_{j=1}^{k}\frac{2\cdot\text{Precision}_{j}\cdot\text{Recall}_{j}}{\text{Precision}_{j}+\text{Recall}_{j}}, (5) Profile-level metrics evaluate a model’s ability to generate combinations of attributes, which is relatively more challenging but beneficial for precise item targeting. In contrast, attribute-level metrics assess the model’s ability to generate individual attributes, which is relatively simpler. 4.2 Main Result of ALPBench We examine the state-of-the-art LLMs on our benchmark, including Qwen 32 , GLM 36 , Gemini, MiniMax, and DeepSeek 10 ; 20 families. Table 2 presents the evaluation results of fifteen representative models across eight datasets. Overall, the results show clear differences in performance both across model families and evaluation metrics. Specifically, from the model perspective, we find consistent gaps between models of different sizes within the same family. Although a few smaller models occasionally outperform larger ones, the general trend is that larger models significantly outperform smaller ones, demonstrating a strong scaling effect and confirming that our benchmark effectively captures differences in model capability. From the metric perspective, no single model achieves top performance on all eight datasets. The best-performing model varies by dataset, indicating that different models have distinct inductive biases and are better suited to specific task types or product categories. In addition, performance on profile-level metrics remains low for all models, highlighting the challenge of multi-attribute reasoning, where multiple attributes and their interactions must be considered jointly rather than independently. 4.3 Performance with Longer Sequence Figure 2: Performance Comparison of Different LLMs Across Varying Token Lengths. We conduct experiments on the 3M, 6M, and 1Y datasets using DeepSeek-v3.2, Gemini-2.5-Pro, Kimi-K2, Claude-Sonnet-4.5, Doubao-Seed, MiniMax-M2.1, GPT-5.2-Chat, and Qwen-Max. The results are grouped according to input token length and are illustrated in Figure 2 . For different categories of tasks, the distinction between models is quite clear and consistent, with models such as DouBao-Seed and Gemini maintaining relatively high performance levels. Overall, tasks such as Apparel, Shoes, Pants, and Snacks show gradual improvements in performance with increasing context length when using models like Gemini, Qwen, and DouBao. In contrast, models such as Kimi, Claude, and GLM exhibit a rising-then-falling trend, suggesting that their performance initially benefits from longer contexts but deteriorates once the context exceeds their effective capacity. This pattern can be explained by the fact that these categories correspond to high-frequency consumption scenarios: as context length increases, the signal-to-noise ratio (SNR) improves, enabling models to better capture users’ long-term and stable preferences from extended interaction histories. Non-routine or non-daily-consumption categories, such as Fish Rods, Wine, Badminton Rackets, and Phones, exhibit a distinctly different pattern. Performance in these categories drops sharply as interaction histories grow longer, which we attribute to the Lost in the Middle phenomenon 22 . When the input exceeds a model’s effective context capacity, it struggles to maintain logical consistency over long sequences, leading to a cliff-like decline in performance. 5 Limitations ALPBench has several limitations that warrant consideration. First, the current benchmark relies exclusively on textual data; richer feature engineering, or the integration of additional modalities—such as images, user interaction signals, or product metadata—could provide higher signal-to-noise ratios and more diverse evaluation scenarios. Incorporating multimodal inputs in future iterations may allow models to better capture complex product attributes and nuanced user behaviors. Second, although ALPBench is designed to evaluate model reasoning in long-context personalization settings, its direct integration with practical recommendation systems remains preliminary. Future work could investigate how insights from benchmark evaluations can be translated into improvements in LLM-based recommendation pipelines, including personalized ranking, multi-step decision making and etc. Such efforts would increase the practical utility of ALPBench. Finally, the benchmark currently covers a limited set of e-commerce categories and user behaviors. While these categories provide a meaningful range of personalization scenarios, the findings may not fully generalize to other domains, such as finance, healthcare, or social media, or to tasks requiring different types of reasoning or interaction patterns. Expanding the benchmark to include more diverse product categories, cross-domain datasets, and longer-term user behaviors could strengthen its generalizability and applicability to a wider range of personalization challenges. Appendix A Details of Data Statics A.1 Multi-dimensional Label Space Table 3 presents the structured attribute space defined in ALPBench. For each product category, we specify a set of domain-specific attributes that form the prediction targets for corresponding sub-tasks. These fine-grained attribute tags, when considered in combination, not only enable a precise evaluation of a model’s ability to infer nuanced user preferences within combinatorial attribute spaces, but also facilitate more accurate and effective product positioning, reflecting the model’s capacity for multi-attribute reasoning and personalization. Table 3: Predictable Attributes in ALPBench. Category Target Attributes (Predictable Tags) Shoes Price Range, Category, Closure Type, Toe Style Apparel Price Range, Fit, Thickness, Category, Sleeve Length Pants Price Range, Fit, Category, Waist Type, Pant Length Snacks Price Range, Sugar Content, Flavor, Storage, Category and etc. Phone Price Range, Brand, Wireless Charging Support, Battery Capacity, Screen Size, Rear Camera Setup, NFC Support, Charging Power Wine Price Range, Brand, Alcohol Content, Packaging Fish Rods Price Range, Brand, Material, Rod Action Badminton Racket Price Range, Brand, Material, Level A.2 Example Prompt for the Data In this section, we introduce the customized prompt design employed in ALPBench. Figures 4 and illustrate the evaluation prompt templates, while Figure 4 presents examples of the model outputs. Figure 3: Evaluation prompt template. Figure 4: Example of output. Appendix B Details of Data Collection We employ Gemini-2.5-Pro to filter redundant, ambiguous, or incorrectly labeled attributes, a step that is critical for ensuring the benchmark’s reliability and the accuracy of subsequent predictions. Simultaneously, we perform attribute clustering, consolidating numerous semantically similar but non-standardized attribute values into a unified canonical space. Representative examples of this process are illustrated in the Figure 5 . Figure 5: Attribute Tag Classification Example with Gemini.