An Empirical Study on Zero-Data Bootstrapping for Conversational Recommender Systems
Rohan Surana, Junda Wu, Zhouhang Xie, Yu Xia, Nathan Kallus, Julian McAuley · 2025
Read An Empirical Study on Zero-Data Bootstrapping for Conversational Recommender Systems by Rohan Surana, Junda Wu, Zhouhang Xie, Yu Xia, Nathan Kallus, Julian McAuley (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-15476.txt.
Introduction
Rohan Surana and five co-authors test whether chat based shopping guides can be raised with no chat data at all, in a 2025 arXiv paper. Such guides need domain talk logs, which are dear and rare in new fields. The team asks if scraps like reviews, item facts, and buy logs can stand in.
They forged fake chats from those scraps and picked the best with two math sieves, one for spread and one for fact worth. Grounded fake data beat plain prompting and naive fakes across models and sets. Smart picking beat random picks, and item facts plus crowd buy signs each helped. Where real chats were thin, fake ones beat them, and the two mixed well. Code is shared.
Catalog record
| CREATOR | Rohan Surana, Junda Wu, Zhouhang Xie, Yu Xia, Nathan Kallus, Julian McAuley |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 49 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-15476
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
An Empirical Study on Zero-Data Bootstrapping for Conversational Recommender Systems Rohan Surana, Junda Wu, Zhouhang Xie, Yu Xia, Nathan Kallus, Julian McAuley Abstract Conversational Recommender Systems (CRS) typically require domain-specific dialogue data, which is costly, scarce, and often unavailable in new domains. We conduct a systematic empirical study of zero-data CRS bootstrapping : generating synthetic conversational supervision from non-conversational signals—item reviews, metadata, and user-item interactions—without any in-domain dialogue corpus. We compare two information-theoretic selection strategies, Jensen-Shannon diversity and Fisher information, across domain signals, model architectures, datasets, and fine-tuning paradigms. Our results show that domain-grounded synthetic data consistently outperforms zero-shot prompting and naïve synthetic baselines; active selection improves data efficiency over random sampling; metadata and collaborative filtering signals each improve selection quality; and, in low-resource settings, synthetic data can outperform scarce real dialogues while further complementing them. These findings establish non-conversational domain signals as a viable path toward building CRS without conversational training data. The code is available at https://anonymous.4open.science/r/zero_data_crs/ . 1 Introduction Figure 1: Three CRS paradigms: (a) traditional CRS requiring domain-specific conversational data, (b) direct LLM deployment with inherent limitations, and (c) the zero-data bootstrapping pipeline studied in this work, which synthesizes conversational data from non-conversational seed signals. Conversational Recommender Systems (CRS) aim to deliver personalized recommendations through dialogue ( Sun and Zhang, 2018 ; Lin et al., 2023 ; Wang et al., 2023a ; Xi et al., 2024 ; Zhang et al., 2018 ) . Building effective CRS has traditionally required large, domain-specific conversational datasets ( Wang et al., 2022 ; Chen et al., 2019 ; Zhou et al., 2020 ; Li et al., 2018 ) ( Figure 1 (a)), which are scarce due to high annotation costs ( Soudani et al., 2026 ; Chen et al., 2023 ; Aroyo et al., 2023 ) , privacy concerns ( Reddit, 2023b ; Reddit, 2023a ; Reddit, 2024 ; Chen et al., 2023 ) , and domain-specific constraints ( Chen et al., 2019 ; Zhou et al., 2020 ; Wang et al., 2022 ) . While Large Language Models (LLMs) demonstrate promising zero-shot capabilities ( He et al., 2023 ; Feng et al., 2023 ; Friedman et al., 2023 ; Wu et al., 2024 ) , direct deployment ( Figure 1 (b)) faces challenges in scalability ( Menshawy et al., 2024 ; Chen et al., 2025 ) , cost ( Samsi et al., 2023 ; Chen et al., 2024a ) , interpretability ( Singh et al., 2024 ; Kasneci et al., 2023 ; Wei Jie et al., 2024 ) , and privacy ( Yao et al., 2024 ; Neel and Chang, 2024 ; Yan et al., 2025 ; Li et al., 2024b ) , leading many practical deployments to prefer smaller, internally managed models ( Jeong, 2024 ) . Yet fine-tuning these models still requires substantial domain-specific conversational data ( Jeong, 2024 ; Sun et al., 2024 ; Nguyen et al., 2024 ) , which remains limited ( Soudani et al., 2026 ; Wang et al., 2023c ; Ruiz and Sell, 2024 ) . In parallel, LLMs have been increasingly used as data generators, synthesizing training data for downstream tasks ( Zhao et al., 2023 ; Mysore et al., 2023 ; Leszczynski et al., 2023 ) . However, existing augmentation approaches for CRS operate on top of an existing conversational corpus ( Xu et al., 2025 ; Liu et al., 2025 ; Zhao et al., 2023 ) or require external knowledge graphs ( Wang et al., 2022 ; Chen et al., 2019 ; Zhou et al., 2020 ) . Active learning offers principled sample selection to maximize the value of costly LLM queries ( Du et al., 2025 ; Liu et al., 2024 ; Zhang et al., 2024 ) , but its application to CRS data generation from non-conversational signals has not been studied. This raises a fundamental question: can LLMs bootstrap effective CRS from non-conversational domain signals alone? Non-conversational data—item reviews, metadata, and user-item collaborative interactions—is readily available in most domains, yet converting such signals into effective conversational training data involves non-trivial challenges in sample selection, domain grounding, and data efficiency. No systematic investigation exists of whether and how this bootstrapping can work. In this work, we conduct a comprehensive empirical study addressing this question. We formalize the zero-data CRS setting ( Figure 1 (c)), where no in-domain conversational data is available, and study a three-stage bootstrapping pipeline: (i) active sample selection from non-conversational seed data using information-theoretic criteria, (ii) synthetic conversational data generation via a teacher LLM, and (iii) fine-tuning a target model on the synthesized corpus. We systematically vary domain signals, selection strategies, budgets, model architectures, and fine-tuning paradigms to address four research questions. Contributions. We summarize our contributions as follows: • We formalize the zero-data CRS setting and establish a controlled experimental framework for studying synthetic data bootstrapping from non-conversational domain signals. • We provide a systematic empirical study of sample selection strategies for augmenting CRS data generation, characterizing how different selection criteria affect synthetic-data quality and downstream recommendation performance. • We conduct controlled ablations isolating the effects of domain signals (item metadata, collaborative filtering) on both selection quality and downstream CRS performance across multiple models, datasets, and fine-tuning paradigms. Scope. We focus on the strict setting where neither an in-domain conversational corpus nor an external knowledge graph is available. The only assumed resources are non-conversational domain signals such as reviews, metadata, and user-item interactions. Table 1 contrasts this scope with representative CRS and augmentation methods. Method CRS Data KG Zero-Data UniCRS ( Wang et al., 2022 ) ✓ ✓ ✗ KGSF ( Zhou et al., 2020 ) ✓ ✓ ✗ KBRD ( Chen et al., 2019 ) ✓ ✓ ✗ Xu et al. (2025) ✓ ✗ ✗ NR-CRS ( Liu et al., 2025 ) ✓ ✗ ✗ LOT-CRS ( Zhao et al., 2023 ) ✓ ✗ ✗ This Study ✗ ✗ ✓ Table 1: Comparison of CRS methods by data requirements. CRS Data: requires in-domain conversational corpus. KG: requires external knowledge graph. Zero-Data: operates without conversational training data. 2 Zero-Data CRS Bootstrapping We define the zero-data CRS setting and the bootstrapping pipeline evaluated in this study. Figure 2 provides an overview. Figure 2: Overview of zero-data CRS bootstrapping. Non-conversational seed signals are encoded, actively selected, converted into synthetic conversations by a teacher LLM, and used to fine-tune the target CRS. 2.1 Setting: Zero-Data CRS Definition 1 (Zero-Data CRS) . A CRS operates in the zero-data setting when no in-domain conversational dataset \mathcal{S}_{\mathrm{conv}} is available. The only available resources are non-conversational domain signals: item reviews \{r_{i}\} , item metadata \{m_{i}\} , and user-item collaborative interactions \{u_{i}\} . This setting captures the practical reality of deploying CRS in new or specialized domains where conversational data has never been collected, requiring conversational supervision to be derived from non-conversational signals alone. 2.2 Pipeline: Select, Generate, Fine-Tune To study how non-conversational signals can be converted into effective CRS training data, we instantiate a three-stage bootstrapping pipeline ( Algorithm 1 ). Given seed data \mathcal{D} , target model \pi_{\theta} , teacher LLM \mathcal{M} , and budget B , the pipeline selects informative samples \mathcal{R}\subset\mathcal{D} , generates synthetic conversations \mathcal{S} from \mathcal{R} , and fine-tunes \pi_{\theta} on \mathcal{S} to obtain \pi_{\theta}^{*} .