Post-training an LLM for RAG? Train on Self-Generated Demonstrations

Matthew Finlayson, Ilia Kulikov, Daniel M. Bikel, Barlas Oguz, Xilun Chen, Aasish Pappu, Meta, Inc, [email protected] · 2025

Read Post-training an LLM for RAG? Train on Self-Generated Demonstrations by Matthew Finlayson, Ilia Kulikov, Daniel M. Bikel, Barlas Oguz, Xilun Chen, Aasish Pappu, Meta, Inc, [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-10596.txt.

Description

Matthew Finlayson and co-authors proposed in 2025 training language models for retrieval-based answering on examples the model writes itself. Models often lack fresh facts, so they answer with documents pulled in at run time. Tuning on outside examples can backfire, teaching false claims, because those examples may not fit the model.

Self-made examples avoid that mismatch and weave the pulled documents into the reply. Tests on fact-heavy questions showed the method taught models to use in-context documents well. It also taught them to pass on questions they would likely get wrong. Standard tuning hurt plain performance, while this method kept it and raised question scores.

Catalog record

CREATORMatthew Finlayson, Ilia Kulikov, Daniel M. Bikel, Barlas Oguz, Xilun Chen, Aasish Pappu, Meta, Inc, [email protected]
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE40 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-10596

Browse the full library · About the Tower of Babel