Beyond the Parameters: A Technical Survey of Contextual Enrichment in Large Language Models From In-Context Prompting to Causal Retrieval-Augmented Generation
Prakhar Bansal, Shivangi Agarwal · 2026
Read Beyond the Parameters: A Technical Survey of Contextual Enrichment in Large Language Models From In-Context Prompting to Causal Retrieval-Augmented Generation by Prakhar Bansal, Shivangi Agarwal (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-03174.txt.
Introduction
Bansal and Agarwal survey how language models gain from added context at run time, from plain prompting through retrieval and graph methods to causal retrieval. They organize the methods by structured context supplied, adding a screening protocol, a claim-checking framework, and a synthesis separating firm findings from early ones. The survey closes with a deployment guide and research priorities for trustworthy retrieval.
Catalog record
| CREATOR | Prakhar Bansal, Shivangi Agarwal |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 15111 |
| LICENSE | http://creativecommons.org/licenses/by-sa/4.0/ |
| RIGHTS | CC BY SA |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.03174
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Beyond the Parameters: A Technical Survey of Contextual Enrichment in Large Language Models From In-Context Prompting to Causal Retrieval-Augmented Generation Prakhar Bansal, Shivangi Agarwal Abstract Large language models (LLMs) encode vast world knowledge in their parameters, yet they remain fundamentally limited by static knowledge, finite context windows, and weakly structured causal reasoning. This survey provides a unified account of augmentation strategies along a single axis: the degree of structured context supplied at inference time. We cover in-context learning and prompt engineering, Retrieval-Augmented Generation (RAG), GraphRAG, and CausalRAG. Beyond conceptual comparison, we provide a transparent literature-screening protocol, a claim-audit framework, and a structured cross-paper evidence synthesis that distinguishes higher-confidence findings from emerging results. The paper concludes with a deployment-oriented decision framework and concrete research priorities for trustworthy retrieval-augmented NLP. Keywords: retrieval-augmented generation, causal reasoning, knowledge graphs, in-context learning, LLM augmentation, faithfulness, TrustNLP 1 Introduction Transformer-based language models have shown strong generality across language understanding and generation tasks. However, reliability in knowledge-intensive settings remains constrained by three recurring gaps: a knowledge gap (facts not encoded in model parameters), a retrieval gap (relevant evidence not surfaced), and a reasoning gap (causally incoherent outputs despite relevant evidence). We frame the progression from prompting to RAG, GraphRAG, and CausalRAG as a systematic response to these gaps. Each step introduces richer contextual structure and typically trades higher indexing complexity for better faithfulness and reasoning quality ( 11 ; 4 ; 22 ) . Contributions. This survey makes four contributions: (i) a unified contextual-enrichment taxonomy connecting prompting, RAG, GraphRAG, and CausalRAG; (ii) a methodological protocol for literature selection and evidence grading; (iii) a claim-audit table that links high-impact statements to primary sources and confidence levels; and (iv) a practitioner-focused decision framework for trustworthy deployment in high-stakes settings. Table 1: Three failure gaps in knowledge-intensive question answering and paradigm-level coverage (authors’ synthesis based on cited literature). Gap Prompting RAG GraphRAG CausalRAG Knowledge gap \circ Yes Yes Yes Retrieval gap No \circ Yes Yes Reasoning gap No No \circ Yes Scope and Organization. This survey targets ML practitioners and researchers seeking a coherent comparison of retrieval augmentation paradigms. We do not propose a new algorithm. Instead, we formalize and compare established methods using common notation and evaluation criteria. 2 Survey Methodology 2.1 Literature Collection Protocol We conducted a structured literature collection across peer-reviewed venues and major preprint repositories for retrieval-augmented generation and causal reasoning in LLM systems. The search window for this draft ends in March 2026. Candidate papers were screened by title and abstract, then full-text reviewed for methodological relevance. Inclusion Criteria. Papers were included if they: (i) propose, evaluate, or systematically analyze prompting, RAG, GraphRAG, or CausalRAG pipelines; (ii) report concrete retrieval or generation behavior rather than purely conceptual commentary; and (iii) provide enough methodological detail to support comparative interpretation. Exclusion Criteria. We excluded works lacking technical detail, duplicate versions without substantive updates, and papers that do not expose evidence supporting claims about faithfulness, retrieval quality, or causal reasoning. 2.2 Evidence Grading We use three evidence grades in this survey. High confidence indicates repeated support across multiple studies and settings. Medium confidence indicates strong but still limited or heterogeneous evidence. Emerging evidence indicates promising results with narrow benchmark or dataset coverage. These grades guide wording throughout the manuscript. 3 Context in Large Language Models 3.1 What is Context? In transformer architectures, context is the visible token sequence x=(x_{1},\dots,x_{n}) during generation. We distinguish three context types: parametric context (stored in model weights), in-context knowledge (prompt-provided information), and retrieved context (externally retrieved evidence inserted at inference time). In-Context Learning and Prompt Engineering. Few-shot prompting demonstrates that large models can adapt to novel tasks from examples without gradient updates ( 2 ) . Prompt engineering broadens this paradigm with zero-shot prompting, chain-of-thought prompting, and retrieval-augmented prompting ( 13 ; 23 ) . Context-Window Limitations. Even with long-context models, lost-in-the-middle degradation and noise from irrelevant inserted text remain practical failure modes ( 12 ) . Separately, purely parametric knowledge can become stale as world facts change, which motivates retrieval-grounded generation ( 16 ; 11 ) . 4 Retrieval-Augmented Generation (RAG) 4.1 Background and Definition RAG grounds generation in non-parametric external knowledge. Let D=\{d_{1},\dots,d_{m}\} be a corpus indexed into chunk embeddings. For query q , the retriever selects top- k chunks; the generator conditions on q plus retrieved chunks ( 11 ) . Retrieval Architectures. Sparse retrieval (e.g., BM25) is interpretable and efficient but can miss semantic matches ( 17 ) . Dense retrieval captures semantic similarity but is costlier and domain-sensitive ( 10 ) . Hybrid pipelines often improve robustness by combining both ( 3 ) . Advanced Variants. Recent variants include iterative or multi-hop RAG, Self-RAG (adaptive retrieval and reflection), and modular RAG pipelines with query rewriting, reranking, and post-filtering ( 20 ; 1 ; 6 ) . 4.2 Limitations Vanilla RAG is limited by contextual fragmentation, semantic-similarity bias, and limited global summarization for corpus-level questions. 5 Graph Retrieval-Augmented Generation (GraphRAG) 5.1 Motivation and Formulation GraphRAG replaces flat chunk retrieval with knowledge-graph indexing. During indexing, systems extract triples (head,relation,tail) and often produce community summaries via graph clustering. At query time, local or global graph retrieval provides structured evidence to generation ( 4 ; 15 ; 8 ) . Advantages. GraphRAG improves multi-hop relational reasoning, supports global thematic synthesis, and improves traceability of generated claims. Limitations. Key bottlenecks include expensive graph construction, entity resolution noise, temporal rigidity, and associative (rather than explicitly causal) edges. 6 Causal Retrieval-Augmented Generation (CausalRAG) 6.1 Motivation Causal questions (“Why did X happen?”, “What if Y changed?”) require more than topical retrieval. CausalRAG introduces directed causal structure into retrieval to support faithful, interpretable causal explanations ( 14 ; 18 ; 22 ) . Causal Graph Foundation. Using structural causal modeling intuition, causal graphs encode directed relations and support observational, interventional, and counterfactual reasoning modes. Pipeline. CausalRAG extracts directed causal triples from source text, indexes them, and retrieves causally connected subgraphs via graph walks from query-linked seed nodes. Generation is then conditioned on a causally grounded evidence narrative. Empirical Pattern. Reported evidence from currently available benchmarks suggests improved answer faithfulness and retrieval precision over vanilla RAG, with stronger causal coherence than purely associative graph retrieval ( 22 ) . Because benchmark settings vary across papers, these results should be interpreted as indicative rather than directly comparable. 7 Unified Comparative Framework 7.1 Contextual Enrichment Axis Prompting, RAG, GraphRAG, and CausalRAG can be viewed as a monotonic increase in context structure. This yields a practical trade-off: higher indexing complexity in exchange for higher reasoning faithfulness. 7.2 Quantitative Evidence Across Four Paradigms Table 2 summarizes representative quantitative results from primary papers across the four paradigms. Each row states the exact systems being compared, the metric and unit, and reported values with deltas. Cross-row comparisons across different papers should not be treated as head-to-head performance rankings. Table 2: Quantitative evidence matrix with explicit metric definitions and scope constraints. All values are reported in the cited source studies. Paradigm Source Dataset Systems compared Metric (unit) Reported values Delta Prompting (CoT) 23 GSM8K PaLM 540B: CoT vs standard prompting Solve rate (%) 57.0 vs 18.0 +39.0 pts RAG 11 Natural Questions (Open-domain QA) RAG vs T5-11B (closed-book) Exact Match (EM, %) 44.5 vs 34.5