Inference-Time Intervention in Large Language Models for Reliable Requirement Verification
Paul Darm, James Xie, Annalisa Riccardi · 2025
Read Inference-Time Intervention in Large Language Models for Reliable Requirement Verification by Paul Darm, James Xie, Annalisa Riccardi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-14130.txt.
Description
Paul Darm, James Xie, and Annalisa Riccardi steer language models during use in a 2025 paper. Checking whether an engineering design meets its requirements is slow manual work. Instead of retraining, the team nudges the model's inner attention heads at run time, sometimes changing as few as one to three heads.
Applied to two early space mission models drawn as graphs, the steered model judged requirement fulfillment with strong reliability. It beat both the plain model and a fine-tuned one, reaching perfect precision on held-out tests when paired with self-consistency voting. Readers get fine control without retraining.
Catalog record
| CREATOR | Paul Darm, James Xie, Annalisa Riccardi |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 57 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-14130