Emulating Retrieval Augmented Generation via Prompt Engineering for Enhanced Long Context Comprehension in LLMs
Joon Park, Kyohei Atarashi, Koh Takeuchi, Hisashi Kashima · 2025
Read Emulating Retrieval Augmented Generation via Prompt Engineering for Enhanced Long Context Comprehension in LLMs by Joon Park, Kyohei Atarashi, Koh Takeuchi, Hisashi Kashima (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-12462.txt.
Description
Joon Park, Kyohei Atarashi, Koh Takeuchi, and Hisashi Kashima show how careful prompting can make a language model act as its own search engine, in a 2025 paper. Models can now swallow very long texts, yet they still miss facts scattered across them when a question needs several hops. The usual fix is a separate retrieval system that fetches key passages first.
Their method has the model tag the useful parts of a long passage, then reason step by step over those parts, all in one pass. On a test that buries small problems inside masses of filler text, it beat both no-help and standard retrieval setups, notably on counting and location questions. The order of parts inside the prompt also mattered a great deal. The work offers a light alternative to full retrieval pipelines.
Catalog record
| CREATOR | Joon Park, Kyohei Atarashi, Koh Takeuchi, Hisashi Kashima |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 29 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-12462