Read the Docs Before Rewriting: Equip Rewriter with Domain Knowledge via Continual Pre-training
Qi Wang, Yixuan Cao, Yifan Liu, Jiangtao Zhao, Ping Luo · 2025
Read Read the Docs Before Rewriting: Equip Rewriter with Domain Knowledge via Continual Pre-training by Qi Wang, Yixuan Cao, Yifan Liu, Jiangtao Zhao, Ping Luo (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-00477.txt.
Description
Qi Wang and four co-authors improve query rewriting for retrieval based question answering in a 2025 paper. Such systems fetch documents to ground a model's answers, but users phrase questions differently from documents, so queries get rewritten first. In specialist fields the rewriter often lacks the domain's terms and facts.
Their method, nicknamed read before rewriting, continues pretraining the rewriter on the field's own documents, like a student reading the textbook before an open book exam. It can also be paired with supervised fine tuning for extra gains. Tests across several professional domains show stronger question answering than standard rewriters. General performance stayed intact, the authors report. They aim to make retrieval systems usable in expert settings.
Catalog record
| CREATOR | Qi Wang, Yixuan Cao, Yifan Liu, Jiangtao Zhao, Ping Luo |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 42 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-00477