Emulating Retrieval Augmented Generation via Prompt Engineering for Enhanced Long Context Comprehension in LLMs

Joon Park, Kyohei Atarashi, Koh Takeuchi, Hisashi Kashima · 2025

Read Emulating Retrieval Augmented Generation via Prompt Engineering for Enhanced Long Context Comprehension in LLMs by Joon Park, Kyohei Atarashi, Koh Takeuchi, Hisashi Kashima (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-12462.txt.

Description

Joon Park, Kyohei Atarashi, Koh Takeuchi, and Hisashi Kashima show how careful prompting can make a language model act as its own search engine, in a 2025 paper. Models can now swallow very long texts, yet they still miss facts scattered across them when a question needs several hops. The usual fix is a separate retrieval system that fetches key passages first.

Their method has the model tag the useful parts of a long passage, then reason step by step over those parts, all in one pass. On a test that buries small problems inside masses of filler text, it beat both no-help and standard retrieval setups, notably on counting and location questions. The order of parts inside the prompt also mattered a great deal. The work offers a light alternative to full retrieval pipelines.

Catalog record

CREATORJoon Park, Kyohei Atarashi, Koh Takeuchi, Hisashi Kashima
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE29 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-12462

Browse the full library · About the Tower of Babel