Evaluating Multi-Turn Bargain Skills in LLM-Based Seller Agents

Issue Yishu Wang 1,∗ , Kakam Chong 2,∗ , Xiaofeng Wang 3,∗ , Xu Yan 4 , Dexin Kong 4 , Chen Ju 4 , Ming Chen 4 , Shuai Xiao 4 , Shuguang Han 4 , Junfeng Chen 4 1 Johns Hopkins University 2 Tsinghua University 3 Shanghai Jiao Tong University 4 Alibaba Group [email protected], [email protected] · 2025

Read Evaluating Multi-Turn Bargain Skills in LLM-Based Seller Agents by Issue Yishu Wang 1,∗ , Kakam Chong 2,∗ , Xiaofeng Wang 3,∗ , Xu Yan 4 , Dexin Kong 4 , Chen Ju 4 , Ming Chen 4 , Shuai Xiao 4 , Shuguang Han 4 , Junfeng Chen 4 1 Johns Hopkins University 2 Tsinghua University 3 Shanghai Jiao Tong University 4 Alibaba Group [email protected], [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-06341.txt.

Description

Haggling chatbots are graded on reading a buyer's mind in a 2025 paper led by Yishu Wang with nine co-authors. In second-hand marketplaces, seller agents powered by language models negotiate over many turns under business constraints. Success depends on tracking cumulative buyer intent across long conversations, which outcome-only scores cannot judge.

The authors build a large benchmark spanning hundreds of categories, nearly ten thousand products, and three thousand bargaining tasks. Their turn-level framework, grounded in theory of mind, scores how well an agent extracts and tracks annotated buyer intents at each step. An automated pipeline mines reliable intent labels from massive dialogue data. The work moves bargaining evaluation from who won to what the agent understood.

Catalog record

CREATORIssue Yishu Wang 1,∗ , Kakam Chong 2,∗ , Xiaofeng Wang 3,∗ , Xu Yan 4 , Dexin Kong 4 , Chen Ju 4 , Ming Chen 4 , Shuai Xiao 4 , Shuguang Han 4 , Junfeng Chen 4 1 Johns Hopkins University 2 Tsinghua University 3 Shanghai Jiao Tong University 4 Alibaba Group [email protected], [email protected]
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE30 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-06341

Browse the full library · About the Tower of Babel