Syntriever: How to Train Your Retriever with Synthetic Data from LLMs
Minsang Kim, Seungjun Baek · 2025
Read Syntriever: How to Train Your Retriever with Synthetic Data from LLMs by Minsang Kim, Seungjun Baek (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-03824.txt.
Description
Search engines need training data that says which passages answer which questions, and human labeling is slow. Minsang Kim and Seungjun Baek build that data synthetically with a large language model. They use only its text replies rather than its internal scores, which the newest models do not expose. In the first stage, the model writes relevant passages, near-miss passages, and extra questions, then checks its own output for invented facts.
A retriever is trained on that data with a loss that pulls good passages together. In a second stage, the retriever is aligned to the language model's own ranking tastes. The alignment uses a partial ranking method, with a guard that keeps it from straying too far from the first stage. Across benchmarks from several domains, the approach the authors call Syntriever reached the best reported scores, showing synthetic data can carry a retriever far.
Catalog record
| CREATOR | Minsang Kim, Seungjun Baek |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 44 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-03824