Leveraging Graph-RAG and Prompt Engineering to Enhance LLM-Based Automated Requirement Traceability and Compliance Checks
Arsalan Masoudifard, Mohammad Mowlavi Sorond, Moein Madadi, Mohammad Sabokrou, Elahe Habibi · 2024
Read Leveraging Graph-RAG and Prompt Engineering to Enhance LLM-Based Automated Requirement Traceability and Compliance Checks by Arsalan Masoudifard, Mohammad Mowlavi Sorond, Moein Madadi, Mohammad Sabokrou, Elahe Habibi (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-08593.txt.
Description
In fields like finance and aerospace, every feature of a software system must trace back to a written requirement, and someone must check the match. Arsalan Masoudifard and co-authors automate that checking with language models fed by graph-based retrieval. Their Graph-RAG setup stores requirements as a connected web, so the model can pull in the clauses that truly relate to a given check.
Careful prompting styles, including step-by-step and branching reasoning, sharpen the model's judgment further. Against plain retrieval and simple prompts, the combined method gave more accurate, context-aware compliance verdicts. The authors are candid about the price: the setup costs more, needs careful tuning for each setting, and leans hard on complete, correct input documents. The gains, they argue, justify the effort in regulated work.
Catalog record
| CREATOR | Arsalan Masoudifard, Mohammad Mowlavi Sorond, Moein Madadi, Mohammad Sabokrou, Elahe Habibi |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 63 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-08593