Post-training an LLM for RAG? Train on Self-Generated Demonstrations
Matthew Finlayson, Ilia Kulikov, Daniel M. Bikel, Barlas Oguz, Xilun Chen, Aasish Pappu, Meta, Inc, [email protected] · 2025
Read Post-training an LLM for RAG? Train on Self-Generated Demonstrations by Matthew Finlayson, Ilia Kulikov, Daniel M. Bikel, Barlas Oguz, Xilun Chen, Aasish Pappu, Meta, Inc, [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-10596.txt.
Description
Matthew Finlayson and co-authors proposed in 2025 training language models for retrieval-based answering on examples the model writes itself. Models often lack fresh facts, so they answer with documents pulled in at run time. Tuning on outside examples can backfire, teaching false claims, because those examples may not fit the model.
Self-made examples avoid that mismatch and weave the pulled documents into the reply. Tests on fact-heavy questions showed the method taught models to use in-context documents well. It also taught them to pass on questions they would likely get wrong. Standard tuning hurt plain performance, while this method kept it and raised question scores.
Catalog record
| CREATOR | Matthew Finlayson, Ilia Kulikov, Daniel M. Bikel, Barlas Oguz, Xilun Chen, Aasish Pappu, Meta, Inc, [email protected] |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 40 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-10596