Dynamic and Parametric Retrieval-Augmented Generation Conference: Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval; July 13–18, 2025; Padua, Italy Proceedings of the 48th International ACM SIGIR Conference on Research and Development in
Weihang Su, Qingyao Ai, Jingtao Zhan, Qian Dong, Yiqun Liu · 2025
Read Dynamic and Parametric Retrieval-Augmented Generation Conference: Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval; July 13–18, 2025; Padua, Italy Proceedings of the 48th International ACM SIGIR Conference on Research and Development in by Weihang Su, Qingyao Ai, Jingtao Zhan, Qian Dong, Yiqun Liu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-06704.txt.
Introduction
Weihang Su, Qingyao Ai, Jingtao Zhan, Qian Dong, and Yiqun Liu give a tutorial on new ways to feed facts to language models, in a 2025 paper. The standard method looks up facts once, then writes an answer with them in view. That fixed order works poorly on hard questions that need several steps of searching. Two newer styles aim to fix those weak spots.
One style decides during writing when and what to look up next, so the search adapts as the answer grows. The other style bakes found facts into the model's own settings rather than pasting them into the prompt. The tutorial lays out both styles, their roots, and hands-on advice. It is written to guide researchers who want to build on these ideas.
Catalog record
| CREATOR | Weihang Su, Qingyao Ai, Jingtao Zhan, Qian Dong, Yiqun Liu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 21 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-06704
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Dynamic and Parametric Retrieval-Augmented Generation Conference: Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval; July 13–18, 2025; Padua, Italy Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’25), July 13–18, 2025, Padua, Italy DOI: 10.1145/3726302.3731692 ISBN: 979-8-4007-1592-1/2025/07 Weihang Su, Qingyao Ai, Jingtao Zhan, Qian Dong, Yiqun Liu Abstract . Retrieval-Augmented Generation (RAG) has become a foundational paradigm for equipping large language models (LLMs) with external knowledge, playing a critical role in information retrieval and knowledge-intensive applications. However, conventional RAG systems typically adopt a static retrieve-then-generate pipeline and rely on in-context knowledge injection, which can be suboptimal for complex tasks that require multihop reasoning, adaptive information access, and deeper integration of external knowledge. Motivated by these limitations, the research community has moved beyond static retrieval and in-context knowledge injection. Among the emerging directions, this tutorial delves into two rapidly growing and complementary research areas on RAG: Dynamic RAG and Parametric RAG. Dynamic RAG adaptively determines when and what to retrieve during the LLM’s generation process, enabling real-time adaptation to the LLM’s evolving information needs. Parametric RAG rethinks how retrieved knowledge should be injected into LLMs, transitioning from input-level to parameter-level knowledge injection for enhanced efficiency and effectiveness. This tutorial offers a comprehensive overview of recent advances in these emerging research areas. It also shares theoretical foundations and practical insights to support and inspire further research in RAG. † † cc-license: by-sa Cover Sheet Information Title: Dynamic and Parametric Retrieval-Augmented Generation Length: Half-day (3 hours) Format: This is a half-day (3-hour) lecture-style tutorial, including scheduled breaks. It will be conducted on-site, with at least two presenters planning to attend the conference in person. Intended Audience: Intermediate. This tutorial is intended for researchers, practitioners, and students who have prior experience with information retrieval or natural language processing and are interested in the intersection of IR techniques and large language models. It is particularly suitable for those seeking to understand recent advances in retrieval-augmented generation (RAG) and knowledge injection within large language models (LLMs). Prerequisite Knowledge: Attendees are expected to have a basic understanding of the Transformer-based large language models ( Brown et al. 2020 ; Fang et al. 2024b ; Touvron et al. 2023 ; Yang et al. 2024 ; Liu et al. 2024a ) , including concepts such as attention mechanisms. In addition, familiarity with the fundamentals of both sparse ( Zhai 2008 ; Robertson et al. 2009 ) and dense retrieval ( Karpukhin et al. 2020 ; Zhan et al. 2021 ; Su et al. 2024a ; Gao and Callan 2021 ) will be helpful. Previous Talks: This tutorial has not been presented before. Presenters: Weihang Su 1 1 1 Main Contact Person: [email protected] ( Su 2025 ) is a Ph.D. student at the Department of Computer Science and Technology, Tsinghua University, supervised by Prof. Yiqun Liu. His research focuses on Retrieval-Augmented Generation (RAG) and knowledge injection for LLMs. He has published papers at top-tier conferences and journals, including AAAI, ACL, EMNLP, WebConf, SIGIR, and TOIS. He serves as a reviewer or PC member for major conferences such as SIGIR, WebConf, EMNLP, NeurIPS, ICLR, ICML, ACL, and CIKM. Qingyao Ai 2 2 2 Email: [email protected] ( Ai 2025 ) is an Associate Professor at the Department of Computer Science and Technology, Tsinghua University. His research lies at the intersection of information retrieval and generative AI, with a focus on retrieval/ranking optimization and retrieval-augmented generation. He received his Ph.D. from the University of Massachusetts Amherst under the supervision of Prof. W. Bruce Croft. He has served in various academic roles, including General Co-Chair of SIGIR-AP 2023, Program Co-Chair of NTCIR-18, and is currently an Associate Editor of ACM TOIS. Jingtao Zhan 3 3 3 Email: [email protected] ( Zhan 2025 ) is a Ph.D. student at Tsinghua University, advised by Prof. Shaoping Ma and Prof. Yiqun Liu. His research focuses on efficient information retrieval and improving AIGC systems using user interaction logs. He has published papers at top-tier conferences and received multiple honors, including the Best Paper Awards at WSDM 2022 and SIGIR 2024. He also serves as a reviewer for leading venues such as SIGIR, ACL, and The Web Conference. 1. Motivation and Overview Large Language Models (LLMs) have demonstrated remarkable progress across a wide range of natural language processing (NLP) and information retrieval (IR) tasks ( Brown et al. 2020 ; Fang et al. 2024b ; Touvron et al. 2023 ; Yang et al. 2024 ; Liu et al. 2024a ) . Despite these advancements, they face challenges such as hallucinations ( Ji et al. 2023 ; Su et al. 2024e ; Rawte et al. 2023 ; Wang et al. 2025b ) , outdated knowledge ( Wang et al. 2024c ; Wang et al. 2025a ; Wang et al. 2024b ; Fang et al. 2024a ; Wang et al. 2024a ) , and domain adaptation ( Gururangan et al. 2020 ; Su et al. 2025b ; Su et al. 2023a ; Su et al. 2024f ; Su et al. 2024b ) . To address these challenges, Retrieval-Augmented Generation (RAG) ( Borgeaud et al. 2022 ; Lewis et al. 2020 ; Su et al. 2024c ; Guu et al. 2020 ; Izacard and Grave 2020 ; Jiang et al. 2022 ; Tu et al. 2025 ; Dong et al. 2025 ) has emerged as a promising solution that supplements LLMs with access to external knowledge. The conventional RAG paradigm adopts a straightforward retrieve-then-generate approach: an external retriever ( Zhai 2008 ; Gao and Callan 2021 ; Su et al. 2023b ; Ma et al. 2023 ) or a more complex retrieval system ( Salemi and Zamani 2024 ; Li et al. 2023 ; Ye et al. 2024 ; Chen et al. 2022 ) retrieves relevant documents based on the user’s query, then these documents are appended into the contextual input of the LLM, which subsequently generates a response grounded in the retrieved evidence. This paradigm has proven effective across a variety of knowledge-intensive applications and has been widely adopted in practice. 1.1. Limitations of Standard RAG In standard RAG, retrieval is performed before the generation process, based on the initial user query. This one-time retrieval strategy assumes that all relevant information can be collected in advance. However, for tasks that involve multi-hop reasoning or long-form generation, the model’s information needs may evolve during the generation process. For example, intermediate reasoning steps may introduce new sub-questions or require clarification of previously unseen concepts. To support such scenarios, retrieval must be dynamically integrated with generation, allowing the model to access information during the generation process. Since standard RAG performs retrieval before generation, it often fails to provide all the knowledge required by the LLM during the generation process. Another fundamental limitation of standard RAG lies in how the retrieved knowledge is integrated into the model. Specifically, standard RAG adopts the in-context knowledge injection approach, where the retrieved documents are appended to the input prompt and jointly processed with the query. While this approach is straightforward to implement, it introduces several critical challenges. First, when the amount of relevant knowledge is substantial, appending it directly to the input significantly increases