Leveraging Graph-RAG and Prompt Engineering to Enhance LLM-Based Automated Requirement Traceability and Compliance Checks

Arsalan Masoudifard, Mohammad Mowlavi Sorond, Moein Madadi, Mohammad Sabokrou, Elahe Habibi · 2024

Read Leveraging Graph-RAG and Prompt Engineering to Enhance LLM-Based Automated Requirement Traceability and Compliance Checks by Arsalan Masoudifard, Mohammad Mowlavi Sorond, Moein Madadi, Mohammad Sabokrou, Elahe Habibi (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-08593.txt.

Description

In fields like finance and aerospace, every feature of a software system must trace back to a written requirement, and someone must check the match. Arsalan Masoudifard and co-authors automate that checking with language models fed by graph-based retrieval. Their Graph-RAG setup stores requirements as a connected web, so the model can pull in the clauses that truly relate to a given check.

Careful prompting styles, including step-by-step and branching reasoning, sharpen the model's judgment further. Against plain retrieval and simple prompts, the combined method gave more accurate, context-aware compliance verdicts. The authors are candid about the price: the setup costs more, needs careful tuning for each setting, and leans hard on complete, correct input documents. The gains, they argue, justify the effort in regulated work.

Catalog record

CREATORArsalan Masoudifard, Mohammad Mowlavi Sorond, Moein Madadi, Mohammad Sabokrou, Elahe Habibi
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE63 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-08593

Browse the full library · About the Tower of Babel