RAGRank: Using PageRank to Counter Poisoning in CTI LLM Pipelines 1 Equal Contribution
Austin Jia 1 , Avaneesh Ramesh 1 , Zain Shamsi, Daniel Zhang, and Alex Liu · 2025
Read RAGRank: Using PageRank to Counter Poisoning in CTI LLM Pipelines 1 Equal Contribution by Austin Jia 1 , Avaneesh Ramesh 1 , Zain Shamsi, Daniel Zhang, and Alex Liu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-20768.txt.
Introduction
Austin Jia, Avaneesh Ramesh, Zain Shamsi, Daniel Zhang, and Alex Liu defend language model pipelines for cyber threat work against poisoned source documents. Retrieval systems pull in outside reports before answering, so a planted false report can steer answers if the system trusts it blindly.
Threat news is often brand new and skilled attackers copy trusted formats well, which breaks many standard defenses. The team ranks sources by a PageRank style authority score so trusted documents rise and hostile ones sink before retrieval. Tests on a standard search data set plus a proof of concept on threat feeds show clear separation of scores. The plan adds a credibility layer without changing the core model.
Catalog record
| CREATOR | Austin Jia 1 , Avaneesh Ramesh 1 , Zain Shamsi, Daniel Zhang, and Alex Liu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 36 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-20768
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
RAGRank: Using PageRank to Counter Poisoning in CTI LLM Pipelines 1 Equal Contribution Austin Jia 1 , Avaneesh Ramesh 1 , Zain Shamsi, Daniel Zhang, and Alex Liu Abstract Retrieval-Augmented Generation (RAG) has emerged as the dominant architectural pattern to operationalize Large Language Model (LLM) usage in Cyber Threat Intelligence (CTI) systems. However, this design is susceptible to poisoning attacks, and previously proposed defenses can fail for CTI contexts as cyber threat information is often completely new for emerging attacks and sophisticated threat actors can mimic legitimate formats, terminology, and stylistic conventions. To address this issue, we propose that the robustness of modern RAG defenses can be accelerated by applying source credibility algorithms on corpora, using PageRank as an example. In our experiments, we demonstrate quantitatively that our algorithm applies a lower authority score to malicious documents while promoting trusted content, using the standardized MS MARCO dataset. We also demonstrate proof-of-concept performance of our algorithm on CTI documents and feeds. I Introduction Large Language Models (LLMs) have grown in use immensely due to their extraordinary generative capabilities and diverse applications. The integration of LLMs into cybersecurity operations [ 6 , 10 , 1 , 18 , 20 , 4 ] marks a paradigm shift, where unstructured Cyber Threat Intelligence (CTI) reports can be ingested and analyzed, and actionable Indicators of Compromise (IoCs) can be extracted and fed into downstream systems. However, the ever-evolving nature of cybersecurity and the huge volumes of data available from multiple threat feeds [ 2 , 15 , 13 , 7 ] means that a large amount of contextual information relevant to this processing is constantly being generated. This highlights the inherent limitation of LLMs: their lack of direct access to current domain-specific knowledge, as well as their propensity to hallucinate in contexts where actual data is not available as a point of reference. To address this issue, Retrieval-Augmented Generation (RAG) [ 12 ] has emerged as the dominant architectural pattern to operationalize LLM usage in CTI systems [ 4 , 9 , 22 ] . RAG pipelines dynamically retrieve relevant, up-to-date information from curated knowledge bases or external sources, grounding the LLM’s reasoning and response generation in verifiable evidence. This allows LLMs to access an up-to-date knowledge base in real-time, providing the necessary context to formulate an answer. A RAG-enabled LLM is then able to effectively complete tasks such as summarizing threat actor profiles, linking IoCs, or explaining complex attack techniques. However, this dependence introduces a new attack vector for infusing misinformation into CTI pipelines. RAG has been known to be susceptible to poisoning attacks, and previous work [ 5 , 27 , 17 ] has shown that attackers can craft malicious injections that can be optimized to be included in the retrieval with high probability, especially when access to the data source is available. With complete access to open source CTI feeds, adversaries are easily able to inject deceptive elements such as falsified threat reports, manipulated IoCs, misleading vulnerability data, or poisoned mitigation advice into the retrieval system. Since CTI is a shared resource between many organizations, this corrupts the entire security pipeline by amplifying this misinformation. The consequences range from wasted resources by security analysts who may chase phantom threats and deploy ineffective mitigations, to catastrophic misconfigurations and the obscuring of genuine, ongoing attacks [ 19 ] . Indeed, if the attacker’s goal is to disrupt operations and cause havoc by misconfiguration of key services, carefully crafted fake CTI could well accomplish that goal by itself. Therefore, ensuring the authenticity of CTI within the RAG pipeline is not merely an academic concern, but a fundamental operational security requirement. I-A Motivation Prior defenses to RAG poisoning have put forward various techniques, such as using modified majority voting schemes, having multiple LLMs verify relevance, adding redundant safe data to the retrieval, clustering retrieved texts in embedding space, and involving humans in the loop [ 23 ] . These techniques mainly focus on analyzing the retrieved subject matter. However, these defenses can fail for CTI contexts as cyber threat information is often completely new for emerging attacks, and sophisticated threat actors can mimic legitimate CTI formats, terminology and stylistic conventions. Thus, we propose that instead of interrogating what the information says , we focus on where it originates and how it propagates. This approach largely mirrors tactics used in search engine ranking. Given that RAG is largely a search problem, we believe that leveraging the decades of literature on search engine ranking to guard against irrelevant or misleading information is a natural fit. We turn to one of the most well-known ranking algorithms in PageRank [ 14 ] , which was used by Google for ranking webpages based on inbound hyperlinks. In essence, PageRank measures the prestige and amount of contextual support for each page from other sources. Documents in a corpus contain content-based links that are analogous to links between webpages. Therefore, we propose that the robustness of modern RAG defenses can be accelerated by applying source credibility algorithms on corpora, using PageRank as an example. I-B Contributions In our work, we introduce a PageRank-derived authority score that we call RAGRank as a novel defense against corpus poisoning attacks. We first build a citation network from a document corpus using explicit citations, LLM-inferred citations, and claim-level entailment. We then incorporate refinements such as time decay to counter bias against recent documents, and author credibility to leverage author reputation. In our experiments, we demonstrate that our algorithm improves accuracy of answers on a standardized dataset, and also show its performance on two CTI misinformation case examples. II Related Work Prior Defenses. Prior works have used various approaches to defend against corpus poisoning attacks and ensuring retrieved content is relevant to the query. In [ 25 ] , the authors used Natural Language Inference (NLI) techniques to make retrieval more robust, and show that training the model for the task can further improve performance. RobustRAG [ 24 ] employs an isolate-then-aggregate strategy that separates each retrieved document and generates an LLM response from each before aggregating them for a final robust response. Similarly, other works have explored Knowledge Expansion [ 21 , 27 ] , which expands the retrieval context in order to drown out the malicious injection. TrustRAG [ 26 ] takes this a step further to identify malicious documents before the retrieval by clustering them in embedding space, in order to defeat attacks which generate a large amount of poisoned injections that might overcome the earlier strategies. The closest related work to our effort is ClaimTrust [ 16 ] , which uses a modified PageRank-inspired algorithm to propogate trust scores across documents. However, ClaimTrust allows multiple edges between nodes as well as negative weight edges. We found this would give false claims high authority if they are mixed in with many true claims, and negative weight edges could be abused to downrank legitimate documents. RAG and Misinformation in CTI Pipelines. Fayyazi et. al. [ 9 ] showed that RAG performs better for CTI use cases than other methods, and Tellache et. al. [ 22 ] presented the performance of a CTI RAG pipeline by retrieving relevant documents via CTI APIs from VirusTotal and CrowdStrike to