Two-Stage Prompt Optimization for Few-Shot Relation Extraction: From Reasoning-Guided Search to Gradient-Guided Refinement

Aunabil Chakma, Mihai Surdeanu, Eduardo Blanco · 2026

Read Two-Stage Prompt Optimization for Few-Shot Relation Extraction: From Reasoning-Guided Search to Gradient-Guided Refinement by Aunabil Chakma, Mihai Surdeanu, Eduardo Blanco (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-29639.txt.

Description

Chakma, Surdeanu, and Blanco propose a two-stage method for optimizing prompts for few-shot relation extraction with smaller language models. Relation extraction finds structured links, such as who founded a company, in text. Few-shot means the model sees only a handful of examples. Automatic prompt optimization for this episodic setting remains underexplored.

Stage one lets any reasoning-based optimizer improve the prompt broadly, in natural language. Stage two applies their method GradPO, which draws on loss and gradient signals to locate high-impact prompt spans, the word ranges that matter most. Local edits then refine those spans. On FS-TACRED and FS-FewRel, experiments show local refinement usually improves the prompts found by stage one. GradPO is the most consistent refiner among those tested. Their framework reaches state-of-the-art performance on FS-TACRED with a compact model and remains competitive on FS-FewRel.

Catalog record

CREATORAunabil Chakma, Mihai Surdeanu, Eduardo Blanco
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE145 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.29639

Browse the full library · About the Tower of Babel