DRPG (Decompose, Retrieve, Plan, Generate): An Agentic Framework for Academic Rebuttal
Peixuan Han, Yingjie Yu, Jingjun Xu, Jiaxuan You · 2026
Read DRPG (Decompose, Retrieve, Plan, Generate): An Agentic Framework for Academic Rebuttal by Peixuan Han, Yingjie Yu, Jingjun Xu, Jiaxuan You (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-18081.txt.
Introduction
Peixuan Han, Yingjie Yu, Jingjun Xu, and Jiaxuan You build an agent system that writes academic rebuttals. Their 2026 preprint presents DRPG, short for decompose, retrieve, plan, generate. A rebuttal answers reviewers and can decide a paper's fate. Support for this step is rare, even as language models spread through research work. Off-the-shelf models and simple pipelines struggle with long contexts and often miss the point of a critique.
DRPG splits the task into stages that match its name. Breaking a review into parts, fetching the right paper text, and planning replies should yield sharper answers. The aim is targeted, persuasive rebuttals that respect the record. Authors under deadline could gain real help.
Catalog record
| CREATOR | Peixuan Han, Yingjie Yu, Jingjun Xu, Jiaxuan You |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 55 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-18081
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
DRPG (Decompose, Retrieve, Plan, Generate): An Agentic Framework for Academic Rebuttal Peixuan Han, Yingjie Yu, Jingjun Xu, Jiaxuan You Abstract Despite the growing adoption of large language models (LLMs) in scientific research workflows, automated support for academic rebuttal, a crucial step in academic communication and peer review, remains largely underexplored. Existing approaches typically rely on off-the-shelf LLMs or simple pipelines, which struggle with long-context understanding and often fail to produce targeted and persuasive responses. In this paper, we propose DRPG , an agentic framework for automatic academic rebuttal generation that operates through four steps: D ecompose reviews into atomic concerns, R etrieve relevant evidence from the paper, P lan rebuttal strategies, and G enerate responses accordingly. Notably, the Planner in DRPG reaches over 98% accuracy in identifying the most feasible rebuttal direction. Experiments on data from top-tier conferences demonstrate that DRPG significantly outperforms existing rebuttal pipelines and achieves performance beyond the average human level using only an 8B model. Our analysis further demonstrates the effectiveness of the planner design and its value in providing multi-perspective and explainable suggestions. We also showed that DRPG works well in a more complex multi-round setting. These results highlight the effectiveness of DRPG and its potential to provide high-quality rebuttal content and support the scaling of academic discussions. Codes for this work are available at https://github.com/ulab-uiuc/DRPG-RebuttalAgent . 1 Introduction With the rapid advancement of large language models (LLMs), AI agents have become increasingly integrated into the human research workflow. In particular, they have begun to assist researchers across multiple stages of scientific discovery, including idea generation ( 25 ) , paper writing ( 2 ) , and peer review ( 5 ; 47 ) . Despite these advances, AI for academic rebuttal —the process in which authors and reviewers exchange feedback on a paper—remains largely underexplored. As a critical stage of the research lifecycle, rebuttal plays an essential role in ensuring fair and objective evaluation of submissions. Moreover, as the research community continues to expand, particularly in fast-growing fields such as computer science, preparing thoughtful rebuttals has become increasingly time-consuming for conscientious authors. For instance, major conferences such as NeurIPS and ICLR received over 25,000 submissions in 2025, creating an urgent need for more efficient mechanisms to facilitate communication between authors and reviewers. Consequently, automated or assistive rebuttal agents can potentially reduce researchers’ workload substantially, allowing them to focus more on innovative research. Despite its potential benefits, automating academic rebuttal with LLMs is a challenging task. Rebuttal represents a unique adversarial, multi-agent scenario that requires diverse skills, including precise comprehension, persuasive argumentation, and domain-specific expertise. Prior work typically relies on off-the-shelf LLMs or ad-hoc pipelines to generate responses ( 20 ; 18 ) ; however, such approaches often yield suboptimal results for two main reasons. Firstly, academic papers are usually lengthy and information-dense. As revealed by the “Lost in the Middle” phenomenon ( 24 ) , LLMs struggle to identify and extract the most relevant evidence from long contexts when responding to specific reviewer concerns. Secondly, effective rebuttals require well-structured and convincing arguments tailored to reviewers’ critiques. Since LLMs are not explicitly trained for persuasion, they tend to produce responses that are overly generic, excessively conciliatory or defensive, failing to directly and convincingly address reviewers’ key concerns. To overcome these limitations, we propose DRPG (Decompose, Retrieve, Plan, Generate), a four-stage agentic framework designed to automatically generate high-quality academic rebuttals . To mitigate long-context challenges, DRPG first employs a Decomposer to break a review into several “points” where each point is an atomic concern or confusion that needs to be addressed. For each point, a Retriever then selects the most relevant paragraphs from the paper, reducing the input length by over 75% while preserving critical evidence needed for rebuttal. To further enhance argument quality, we introduce a Planner that explicitly formulates rebuttal strategies before response generation. Inspired by planning techniques in structured debates ( 38 ; 13 ) , the Planner proposes multiple rebuttal perspectives and identifies the most promising one that is best supported by the paper content. Trained with compelling human rebuttal data, the planner can effectively identify the most supported perspective with an accuracy of over 98%. Experiments conducted on data from top-tier conferences demonstrate that DRPG can effectively address reviewers’ questions, outperforming existing rebuttal pipelines with around 40 points higher Elo score, which implies consistently higher win rates. In addition, DRPG surpasses average human performance using only an 8B model. Further analyses highlight the successful design of the Planner module, and show that it provides a multi-perspective and explainable signal that substantially improves rebuttal quality. Finally, we showed the impressive performance of DRPG on multi-round discussions and conducted a human study to validate our evaluation metrics. Overall, DRPG represents a promising exploration of integrating LLM agents into the peer-review process, with the potential to reshape how authors and reviewers communicate at scale. 2 Related Work LLM for academic rebuttal. Recent advancements in AI have significantly impacted various stages of scientific discovery, including idea generation, experimentation, and paper writing 27 ; 25 ; 31 ; 48 . Among these stages, peer review plays a key role in ensuring the quality and credibility of research papers, and has been receiving increasing attention within the AI research community ( 51 ; 23 ; 41 ) . Existing work in this domain has focused primarily on simulating the review process 47 ; 4 and training more effective reviewers 5 ; 20 ; 18 . However, the rebuttal phase, which is vital for facilitating communication between authors and reviewers, has received relatively little attention. A few recent studies explore this area by collecting real-world rebuttal datasets ( 49 ; 19 ) , using zero-shot LLMs to generate preliminary rebuttals ( 20 ; 18 ) , and training rebuttal agents by designing pre-defined templates to address different questions ( 29 ; 28 ) . Based on these studies, we propose a more systematic and effective rebuttal agent in this work. Figure 1: Overview of DRPG . LLM for debate and persuasion. Similar to debate and persuasion ( 30 ) , the objective of the rebuttal is to convince the reviewer to change their opinion. Researchers have utilized human strategies ( 40 ; 46 ) and high-quality dialogues ( 36 ; 37 ; 17 ; 12 ) to equip LLMs with strong persuasion capabilities. Recently, advanced agentic pipelines ( 38 ; 15 ; 44 ) and Reinforcement learning algorithms 8 ; 13 on debate has also been proposed. In the long term, we believe academic rebuttal is a promising domain in debate research, since rebuttal is fact-oriented, grounded in high-quality papers, and has substantial public data available. Planning in high-stakes decision making. In academic rebuttal, the author must form responses thoughtfully, as the rebuttal quality may affect the result of the submission, with few opportunities to make changes. Planning and selecting argument directions are crucial in such high-stakes settings. There are two prevalent ways of pruning ideas. Firstly, researchers simulate the consequences of adopting each idea, a method originating from Monte Carlo search trees ( 10 ; 34 ) . This method is most commonly used in scenarios involving multi-agent interactions or external environments ( 26 ; 33 ;