APRIL: Annotations for Policy evaluation with Reliable Inference from LLMs
Aishwarya Mandyam, Kalyani Limaye, Barbara E. Engelhardt*, Emily Alsentzer* · 2025
Read APRIL: Annotations for Policy evaluation with Reliable Inference from LLMs by Aishwarya Mandyam, Kalyani Limaye, Barbara E. Engelhardt*, Emily Alsentzer* (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-17818.txt.
Description
Aishwarya Mandyam, Kalyani Limaye, Barbara E Engelhardt, and Emily Alsentzer propose using language models to strengthen off-policy evaluation. The practice of grading a treatment policy from past records before it is ever used. In high-stakes fields like medicine, such grading is a safety gate, but it is limited by how much of the space of past decisions the records cover. Expert labels for what might have happened under other treatments could widen that cover, yet they cost too much to gather at scale.
Their method, APRIL, guides a language model with domain knowledge to predict how key clinical features would evolve under alternate treatments. Known reward rules then turn those predicted features into counterfactual notes. The team first tests how well several models predict clinical features in two patient groups.
Catalog record
| CREATOR | Aishwarya Mandyam, Kalyani Limaye, Barbara E. Engelhardt*, Emily Alsentzer* |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 34 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-17818