K-comp : Retrieval-Augmented Medical Domain Question Answering With Knowledge-Injected Compressor
Jeonghun Cho, Gary Geunbae Lee · 2025
Read K-comp : Retrieval-Augmented Medical Domain Question Answering With Knowledge-Injected Compressor by Jeonghun Cho, Gary Geunbae Lee (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-13567.txt.
Introduction
Jeonghun Cho and Gary Geunbae Lee improve medical question answering by teaching the system what background it needs first, in a 2025 paper. Retrieval-based answering fetches outside documents, but medical texts are dense and long, and readers may mistrust or misread them. Their compressor, K-comp, first writes down the prior knowledge a question requires. It then squeezes the fetched passages while weaving that knowledge in.
The result is a short context aligned with the question's intent. Reader models guided by that context answer more accurately and lean on the passages instead of guessing. The authors frame knowledge injection as the fix for two failures at once: overload from thousand-token documents and hallucination from stray, off-topic content. The method targets closed expert domains where readers lack background.
Catalog record
| CREATOR | Jeonghun Cho, Gary Geunbae Lee |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 66 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-13567
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
K-comp : Retrieval-Augmented Medical Domain Question Answering With Knowledge-Injected Compressor Jeonghun Cho, Gary Geunbae Lee Abstract Retrieval-augmented question answering (QA) integrates external information and thereby increases the QA accuracy of reader models that lack domain knowledge. However, documents retrieved for closed domains require high expertise, so the reader model may have difficulty fully comprehending the text. Moreover, the retrieved documents contain thousands of tokens, some unrelated to the question. As a result, the documents include some inaccurate information, which could lead the reader model to mistrust the passages and could result in hallucinations. To solve these problems, we propose K-comp ( K nowledge-injected comp ressor) which provides the knowledge required to answer correctly. The compressor automatically generates the prior knowledge necessary to facilitate the answer process prior to compression of the retrieved passages. Subsequently, the passages are compressed autoregressively, with the generated knowledge being integrated into the compression process. This process ensures alignment between the question intent and the compressed context. By augmenting this prior knowledge and concise context, the reader models are guided toward relevant answers and trust the context. 1 1 1 Our implementation can be accessed at https://github.com/jeonghun3572/K-COMP . 1 Introduction Retrieval-augmented question answering (QA) is a task where passages related to a question are appended to the prompt such that a reader model can reference them and infer the correct answer ( Ahmad et al., 2019 ; Guo et al., 2021 ) . Figure 1: K-comp helps the reader model infer accurate responses by using domain knowledge and compressed context aligned with the question. However, several limitations impede retrieval-augmented approaches in closed domains with large language models (LLMs) as readers. First, the documents retrieved for closed domains require domain expertise, so the reader may not trust the whole text. When faced with unfamiliar input, the model exhibits an availability bias toward commonly known knowledge, making it more willing to believe in information it can easily recall ( Jin et al., 2024 ) . Also, retrieved passages contain thousands of tokens and are sometimes unrelated to the question. This can cause the language model to distrust the passages, perceive them as irrelevant noise, and generate answers that do not consider them. These problems lead to hallucinations ( Ji et al., 2023a ) , which result in the model generating inaccurate answers or inferring plausible but false responses. Lastly, LLMs are sensitive to the order of retrieved documents and the prompting method. Specifically, LLMs can have difficulty finding the necessary information within lengthy input prompts, especially when key information or correct answer clues are located in the middle of the prompt ( Liu et al., 2024 ; Xu et al., 2024b ) . To address these issues, we propose K-comp (knowledge-injected compressor). We aim to use an autoregressive LLM as a compressor with the domain knowledge needed to answer the question and increase the alignment of the retrieved passages with the question intent. Additionally, when the compressor is trained in domain-related terms and information, it becomes able to recognize the entities that occur in the question and provide descriptions for them. This process is significant for closed domains that require substantial prior knowledge. For retrieval augmentation, we use a large amount of text from domain-specific sources, including Wikipedia. We exploit the advantages of domain relevance by efficiently reusing it when annotating prior knowledge, not just for retrieval. Furthermore, we use a causal masking objective ( Aghajanyan et al., 2022 ) during the training phase to inject domain knowledge into the compressor. In summary, our contributions are as follows: • We propose a novel approach to generate knowledge-injected summaries adapted for the medical domain. We incorporate causal masking to inject knowledge into the compressor without modifying its structure. This approach ensures that the summary is aligned with the question. • Even without domain knowledge in the reader model, K-comp provides the description of the medical jargon to answer the question, thereby enabling LLMs with diverse backgrounds to handle medical questions more accurately. • Experiments on three medical datasets show that K-comp improves performance over other query-based prompt compression methodologies and standard retrieval-augmented generation (RAG) without compression. • K-comp has been shown to be effective when applied to previously unseen data, thereby presenting evidence that our method provides additional novel contributions in data-scarce closed domain environments. 2 Related Work Text Infilling Models such as BERT ( Devlin et al., 2019 ) , SpanBERT ( Joshi et al., 2020 ) , T5 ( Raffel et al., 2020 ) , and BART ( Lewis et al., 2020 ) , are pre-trained using masked language modeling within a bidirectional encoder architecture. They have shown strong performance in infilling short and contiguous masked token spans. However, the bidirectional attention mechanism typically restricts the fillable span length to dimensions significantly shorter than a sentence. In contrast, decoder-only models such as GLM ( Du et al., 2022 ) , CM3 ( Aghajanyan et al., 2022 ) , and InCoder ( Fried et al., 2023 ) operate by left-to-right generation. They can accommodate variable infill span lengths. Causal masking ( Aghajanyan et al., 2022 ) or fill-in-the-middle ( Bavarian et al., 2022 ) methods predict masked spans from the posterior context. These methods have their generative capabilities, which increase the length of infill spans. They can also exploit the advantages of considering contextual relationships that surround the masked span. The proposed method has the capability to fill the span by considering bidirectional context, as well as align the generated summary with the question by regressively encoding the infilled span. Prompt Compression Several studies have demonstrated that prompt augmentations effectively enhance the performance of LLMs across various tasks ( Liu et al., 2023a ; Ram et al., 2023 ; Ryu et al., 2023 ; Wang et al., 2024c ; Long et al., 2023 ; Yagnik et al., 2024 ) . Yet, the relevance and reliability of the augmented passages are significant challenges in prompt augmentations. In order to address this issue, recent studies have attempted to extract content from ambiguous and lengthy passages directly. Kim et al. (2024) eliminates irrelevant information while maximizing the extraction of accurate information, whereas Yang et al. (2023) leverages the black-box LLMs by applying a reward-based method during compressor training to generate summaries. RECOMP ( Xu et al., 2024a ) selects and augments the summary with the highest end-task performance by using prompts in which non-essential summaries are set to empty strings if necessary. LLMLingua ( Jiang et al., 2023a ) dynamically assigns different compression rates to various components within the prompt. In contrast, K-comp focuses on the keywords needed to answer the question, emphasizing the alignment between the compressed context and the question. 3 Causal Knowledge Injection Causal models trained using autoregressive language modeling rely exclusively on the context to the left of generated tokens to predict subsequent tokens ( Brown et al., 2020 ) . This attribute confers an advantage in causally generating entire documents , such as text generation. However, these models show limited proficiency in tasks that require an understanding of post-positional relationships for span infilling. Conversely, masked language models excel at predicting masked spans by referencing attention scores from tokens located both anteriorly and posteriorly . Nonetheless, their