PaperSearchQA: Learning to Search and Reason over Scientific Papers with RLVR
James Burgess, Jan N. Hansen, Duo Peng, Yuhui Zhang, Alejandro Lozano, Min Woo Sun, Emma Lundberg, Serena Yeung-Levy · 2026
Read PaperSearchQA: Learning to Search and Reason over Scientific Papers with RLVR by James Burgess, Jan N. Hansen, Duo Peng, Yuhui Zhang, Alejandro Lozano, Min Woo Sun, Emma Lundberg, Serena Yeung-Levy (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-18207.txt.
Description
James Burgess and co-authors train search agents that read scientific papers to answer questions. Their 2026 preprint presents PaperSearchQA. Search agents are language models that reason and query sources before they answer. Recent training rewards only the final answer, through reinforcement learning with verifiable rewards. Most such agents practice on general questions. That leaves them weak for the technical search that science, engineering, and medicine demand.
The authors build a setting where agents search over scientific papers themselves. Training there should sharpen both the search steps and the reasoning. Reliable paper search could save experts hours of digging. The work extends a hot training method into the domain that needs it most.
Catalog record
| CREATOR | James Burgess, Jan N. Hansen, Duo Peng, Yuhui Zhang, Alejandro Lozano, Min Woo Sun, Emma Lundberg, Serena Yeung-Levy |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 52 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-18207