CIRCLED: A Multi-turn CIR Dataset with Consistent Dialogues across Domains
\name Tomohisa Takeda \email [email protected], \name Yu-Chieh Lin \email [email protected], \name Yuji Nozawa \email [email protected], \name Youyang Ng \email [email protected], \name Osamu Torii \email [email protected], \name Yusuke Matsui \email [email protected] · 2026
Read CIRCLED: A Multi-turn CIR Dataset with Consistent Dialogues across Domains by \name Tomohisa Takeda \email [email protected], \name Yu-Chieh Lin \email [email protected], \name Yuji Nozawa \email [email protected], \name Youyang Ng \email [email protected], \name Osamu Torii \email [email protected], \name Yusuke Matsui \email [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-26734.txt.
Introduction
Takeda and five colleagues build CIRCLED, a dataset for multi-turn composed image retrieval, where each query step narrows toward a target picture. Older datasets of this kind lack steady dialogue history and stick to fashion images. CIRCLED extends three existing sets, holds 22,608 sessions across nine subsets, and gives researchers a broader public benchmark for testing retrieval over several turns.
Catalog record
| CREATOR | \name Tomohisa Takeda \email [email protected], \name Yu-Chieh Lin \email [email protected], \name Yuji Nozawa \email [email protected], \name Youyang Ng \email [email protected], \name Osamu Torii \email [email protected], \name Yusuke Matsui \email [email protected] |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 54619 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.26734
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
CIRCLED: A Multi-turn CIR Dataset with Consistent Dialogues across Domains \name Tomohisa Takeda \email [email protected], \name Yu-Chieh Lin \email [email protected], \name Yuji Nozawa \email [email protected], \name Youyang Ng \email [email protected], \name Osamu Torii \email [email protected], \name Yusuke Matsui \email [email protected] Abstract Existing Multi-Turn Composed Image Retrieval (MTCIR) datasets lack dialogue-history consistency and are restricted to the fashion domain. To address these limitations, we construct CIRCLED by extending FashionIQ, CIRR, and CIRCO. In CIRCLED, the query at each turn progressively approaches the target image. Data are generated via a CIReVL-based retrieval pipeline and curated with multiple filters on retrieval success, turn length, consistency, and information redundancy to ensure quality. In total, we collect 22,608 multi-turn sessions across nine subsets, substantially exceeding Multi-turn FashionIQ (11,505 sessions) in both scale and generality. We further apply multiple baseline methods and quantitatively assess retrieval accuracy on CIRCLED. Our work provides a practical, high-quality benchmark to facilitate future research on multi-turn CIR. The dataset and code are publicly available at https://huggingface.co/datasets/tk1441/CIRCLED and https://github.com/mti-lab/circled . Keywords: Composed Image Retrieval, Multi-turn Retrieval, Dataset, Vision-Language Models 1 Introduction Figure 1 : Example of multi-turn CIR search. When users cannot find the image they want, they can search again in the next turn based on the existing search results to find the image they want. The input for each turn is the same as the conventional CIR query, which is an image and text. Image retrieval aims to find images that match a user’s intent in large corpora. Traditional text-to-image ( 16 ; 11 ) and content-based ( 15 ; 4 ) methods search with either a text query or an image, but they struggle when intent is ambiguous or nuanced. Multimodal retrieval addresses this by combining text and images in a shared embedding space with pretrained vision-language models such as CLIP ( 19 ) and BLIP ( 12 ) . Composed Image Retrieval (CIR) further refines user’s intent by conditioning on a reference image plus a text modification, preserving visual structure while flexibly steering the search ( 23 ; 27 ; 9 ; 14 ) . Nevertheless, most CIR systems use a single-turn setting and give limited consideration to multi-turn usage, i.e., interaction that progressively clarifies the user’s intent. This single-turn setup forces users to state their intent in one shot. It performs poorly when user’s intent is vague or when users refine requirements while inspecting results. Against this background, multi-turn CIR ( 26 ; 18 ; 5 ) , which follows the flow illustrated in Fig. 1 , has recently attracted attention. In multi-turn CIR, retrieval is performed based on the history of L image-text pairs \{(I_{1},T_{1}),\ldots,(I_{L},T_{L})\} used in previous turns, thereby more faithfully capturing the user’s evolving intent. A key issue in existing multi-turn CIR is inconsistent dialogue history. At present, the only publicly available dataset is Multi-turn FashionIQ ( 26 ) . It is built by simply concatenating single-turn queries. As shown in Fig. 2(b) , it does not provide a structure in which each turn progressively approaches the ground truth (GT). For example, even when the GT is a black dress, the dataset may include unrelated text such as “has a strap” or “has a multi color,” and assign later-turn reference images that are colorful dresses far from the intended black dress. These intermediate-turn mismatches undermine realistic iterative search because later images and captions diverge from the target. Moreover, prior work has focused on fashion, leaving multi-turn CIR in general domains largely unexplored. (a) An example from our multi-turn CIR dataset CIRCLED (b) An example from an existing multi-turn CIR dataset Figure 2 : Comparison of multi-turn CIR datasets. Solid arrows indicate the progression of a session; dotted arrows indicate which previous inputs a given turn refers to. ( 2(a) ) In our dataset, the query at each turn consistently points toward the ground truth, yielding a structure that progressively approaches it. ( 2(b) ) In the existing Multi-turn FashionIQ, feedback is primarily oriented toward the next turn’s image and does not necessarily yield a consistent progression toward the ground truth 2 2 footnotemark: 2 . We introduce CIRCLED, a multi-turn dataset with consistent, unidirectional progress toward the GT ( Fig. 2(a) ). We design the query sequence \{(I_{1},T_{1}),\ldots,(I_{L},T_{L})\} so each turn steadily approaches the GT, mirroring real search behavior. Each turn (I_{i},T_{i}) remains aligned with the GT, preserving coherence at both turn and session levels. We construct CIRCLED by extending FashionIQ ( 25 ) , CIRR ( 13 ) , and CIRCO ( 2 ) , broadening coverage beyond fashion to general domains. CIRCLED contains 22,608 sessions spanning 2–6 turns and 202,845 images ( Table 1 ), roughly twice that of Multi-turn FashionIQ, and includes 1,078 sessions with 5–6 turns, providing longer interactions. We conduct several baseline experiments on CIRCLED to analyze its characteristics. Furthermore, we assess performance using three metrics to complement aspects that previous multi-turn CIR settings could not evaluate. The main contributions of this work are as follows: • CIRCLED: a multi-turn CIR dataset with consistency and progressive information gain, missing in prior work. • Broader coverage beyond fashion by extending FashionIQ, CIRR, and CIRCO. • Three metrics (Hits@10, Final Recall@10, AUC) enabling analysis of turn-wise success and early reachability, as well as final accuracy. 2 Related Work #Sessions by Turn Length Dataset 2 3 4 5 6 Total #Images Categories Multi-turn FashionIQ ( 26 ) 8,649 2,216 640 – – 11,505 16,712 Dress, Shirt, Toptee CIRCLED (Ours) 14,216 5,424 1,890 772 306 22,608 202,845 Dress, Shirt, Toptee, General Table 1 : Comparison of the number of sessions (=queries) by dialogue length L and covered categories in CIRCLED and Multi-turn FashionIQ. L denotes the number of turns per session; larger L generally indicates higher difficulty. CIRCLED covers 2\leq L\leq 6 and includes long sessions with 5–6 turns, whereas Multi-turn FashionIQ is mostly L\leq 3 (maximum L=4 ) and contains no 5–6 turn sessions. Total is the total number of sessions, #Images is the number of database images, and Categories lists the covered categories. 2.1 Composed Image Retrieval Composed Image Retrieval (CIR) ( 21 ; 27 ; 7 ; 14 ) retrieves a ground-truth image using a reference image together with a text modification. By integrating visual and textual information, CIR enables flexible retrieval refinement in line with the user’s intent. Traditional CIR methods train on triplets (reference image, text, GT image), which demands large-scale datasets and costly training ( 3 ; 27 ) . To reduce dependence on labeled data, recent works leverage Vision-Language Models (VLMs) and Large Language Models (LLMs) for zero-shot CIR ( 21 ; 2 ; 9 ) . Most existing CIR methods use a single turn with one reference image and one text. Iterative search is simulated by repeatedly issuing single-turn queries. However, an explicit multi-turn framework that references past retrieval history and continuously tracks user intent has received relatively little attention. 2.2 Multi-turn Composed Image Retrieval Multi-turn CIR is the task of retrieving the final target (ground truth) using the history of image-text pairs \{(I_{1},T_{1}),\ldots,(I_{L},T_{L})\} as the query. 26 pioneered multi-turn CIR by extending FashionIQ ( 25 ) and releasing Multi-turn FashionIQ (11,505 sessions, 3 categories), the first dataset for this setting. It is built by