Structures Facilitate Retrieve, Rerank, and Generate
Yeqin Zhang, Haomin Fu, Xujie Zhang, Cam-Tu Nguyen · 2026
Read Structures Facilitate Retrieve, Rerank, and Generate by Yeqin Zhang, Haomin Fu, Xujie Zhang, Cam-Tu Nguyen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-03247.txt.
Introduction
Zhang, Fu, Zhang, and Nguyen ground dialogue answers in documents with the help of document structure. Such systems answer domain questions from outside texts. Past work cuts documents into lone passages for retrieval and generation. That wastes the structure inside documents, and starves both picking and writing of context. Their method, SF-Re2G, uses structure at all three stages.
First, a passage is represented by contrast with others in its section, which sharpens retrieval. Second, a reranker groups candidates into subgraphs by document layout. Grounding passages for one turn tend to sit near each other, and the reranker scores each candidate with its group in mind. Third, generation uses the chosen passages with their subgraph context. Tests on two dialogue datasets, in Chinese and English, back the design. The work shows that the shape of a document is itself useful data. Retrieval, ranking, and writing all gain from it.
Catalog record
| CREATOR | Yeqin Zhang, Haomin Fu, Xujie Zhang, Cam-Tu Nguyen |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 26 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.03247
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Structures Facilitate Retrieve, Rerank, and Generate Yeqin Zhang, Haomin Fu, Xujie Zhang, Cam-Tu Nguyen Abstract Document-grounded dialogue systems (DGDS) utilize knowledge from external documents to answer domain-specific user questions. Existing solutions typically divide documents into independent passages for retrieval and response generation. This approach, however, neither makes good use of structural information within documents nor provides enough (document) context for knowledge selection and responses. This paper proposes SF-Re2G to address such issues systematically. Firstly, we seek to improve a passage representation by contrasting it with others of the same section, thus improving the retrieval performance. Secondly, a structure-enhanced reranker is built, leveraging the fact that multiple grounding passages of one dialog turn tend to be in the same neighborhood. Specifically, candidates from the retrieval are grouped into subgraphs according to the document structure. The reranker will rescore the candidate integrating its group information. Finally, the chosen passages are used for responses, taking into account the subgraph context for better generation. Experimental results on two DGDS datasets validate our method for both Chinese and English. 1 Introduction Figure 1: An example from Doc2Bot dataset. The left is a dialogue, and the right is a grounding document. The document is divided into several passages. Each step in the document and each cell in the table is treated as a passage. Document-grounded dialogue systems (DGDS) [ 3 , 19 , 2 ] is a hot topic in natural language processing (NLP) research, in which a set of external documents the agent should base on to generate the response. By doing this, more meaningful and accurate responses can be generated by the dialog system. DGDS differs from traditional QA tasks in three aspects: multi-turn, close-domain, and document structure. Multi-turn results in the fact that context is longer, and the interaction between context and candidate response must be considered. Close-domain makes the passages in the documents semantically related. This requires the knowledge selection module to focus on similar passages for response generation. Unlike the structured knowledge base and the knowledge graph, document structure is usually a tree structure formed by organizing the document and the knowledge in the document according to certain semantics or logic. The more semantically similar the two knowledge, the closer they are in the hyperbolic space [ 13 ] formed by this document structure tree. When multiple pieces of knowledge are needed to answer the user’s query, the distance between these pieces of knowledge is usually small in this space. Existing solutions [ 6 , 4 ] exploit the commonly used methods for open QA, ignoring the distinct characteristics of DGDS. Specifically, RAG [ 15 ] and Re2G [ 9 ] are utilized for knowledge retrieval and dialog generation. These methods, however, treat documents as textual sequences, which are then divided into independent passages for knowledge retrieval and response generation. Consequently, this gives raise to two main issues when applying to DGDS. First, it is nontrivial to have the right choice of granularity for passages. Long passages may contain more noise, whereas finer passages do not provide enough context for matching and generation. Second, the inherent structures within the grounding documents are ignored, which might result in suboptimal retrieval and generation. Figure 1 illustrates the aforementioned issues with an example dialog from Doc2Bot [ 5 ] dataset. First, it is not easy to have the right choice of passage length. For question U1 , the system needs to have an overview of the whole handling process, which requires the knowledge from a large span of texts. On the other hand, for question U2 , we can just focus on the finer knowledge of Step 3 on the document. Having a long context may produce too much noise for the question U2 , but is better for question U1 . Second, the structure information is essential for some complex structure. As you can see from Figure 1 , questions from U3 to U4 are grounded on knowledge from a table. Although we can sequentialize the whole table for dense passage retrieval as in RAG and Re2G, we then lose the semantic connections between such as “Materials”-“Application Form”. To address these issues, we do not fix a passage length but exploit nodes in the document graph as passages retrieval. Note that, doing so results in passages of different length. For example, those that are in tables might be very short, and those corresponding to paragraphs are relatively longer. We then try to better integrate the context by exploiting document structures. Specifically, we propose a novel approach SF-Re2G that leverages structural information to facilitate the full DGDS process, including passage retrieval, reranking, and response generation. To the best of our knowledge, this is the first work to systematically study the impact of structure on the commonly used DGDS pipeline. In terms of retrieval, we make two improvements to the deep neural passage retrieval model DPR [ 11 ] . Inspired by TreeJC [ 25 ] , we design a top-down aggregation to enhance the representation of passages using upper-level information such as paragraph headings and document names. Additionally, we recognize that passages under the same section in the document graph tend to have similar content, which makes them more difficult to be distinguished by the model. Therefore, we introduce a structural contrastive approach, which encourages the model to focus more on neighboring passages. For reranking, we dynamically construct some groups based on retrieved passages according to the document structure. Then we model the probability of candidate passages given the user’s query and the same group passages, producing a structurally enhanced reranking score. And during the generation process, we integrate this enhanced score into the generator using a weighting method similar to RAG [ 15 ] and Re2G [ 9 ] . We conduct experiments on the MultiDoc2Dial dataset [ 2 ] and Doc2Bot dataset [ 5 ] , which have been recently introduced to build document grounded dialogue systems. We re-construct the document graphs for each knowledge document based on the original data. The experimental results prove the superiority of our method. The main contributions of this work are: • We reveal that structural information is very valuable and not negligible for DGDS. Current methods that ignore these structural elements can result in suboptimal performance. • We introduce a novel method SF-Re2G, which integrates the structural information for all stages of DGDS. • Our method has a superior performance compared to other state-of-the-art approaches in recent years. 2 Related Works The primary DGDS pipeline can be simply divided into knowledge selection and response generation. Existing studies optimize one of these modules individually or optimize all of them as a whole. 2.1 Knowledge Selection Extensive studies have proposed methods to improve knowledge selection from different aspects. BM25 [ 23 ] uses traditional match-based methods to retrieve passages. DPR [ 11 ] is an early attempt for dense passage retrieval by deep neural networks. For a detailed discussion of other knowledge selection methods, please refer to S1.1 of the supplementary materials. 2.2 Multi-turn Dialog Representation Some studies focus on multi-turn dialog matching. DAM [ 29 ] matches a candidate response to different granularities of the context (words, phrases, sentences). [ 24 ] performs deep interactions between