APRIL: Annotations for Policy evaluation with Reliable Inference from LLMs

Aishwarya Mandyam, Kalyani Limaye, Barbara E. Engelhardt*, Emily Alsentzer* · 2025

Read APRIL: Annotations for Policy evaluation with Reliable Inference from LLMs by Aishwarya Mandyam, Kalyani Limaye, Barbara E. Engelhardt*, Emily Alsentzer* (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-17818.txt.

Description

Aishwarya Mandyam, Kalyani Limaye, Barbara E Engelhardt, and Emily Alsentzer propose using language models to strengthen off-policy evaluation. The practice of grading a treatment policy from past records before it is ever used. In high-stakes fields like medicine, such grading is a safety gate, but it is limited by how much of the space of past decisions the records cover. Expert labels for what might have happened under other treatments could widen that cover, yet they cost too much to gather at scale.

Their method, APRIL, guides a language model with domain knowledge to predict how key clinical features would evolve under alternate treatments. Known reward rules then turn those predicted features into counterfactual notes. The team first tests how well several models predict clinical features in two patient groups.

Catalog record

CREATORAishwarya Mandyam, Kalyani Limaye, Barbara E. Engelhardt*, Emily Alsentzer*
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-17818

Browse the full library · About the Tower of Babel