Mapping the Course for Prompt-based Structured Prediction
Matt Pauk, Maria Leonor Pacheco · 2025
Read Mapping the Course for Prompt-based Structured Prediction by Matt Pauk, Maria Leonor Pacheco (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-15090.txt.
Introduction
Matt Pauk and Maria Leonor Pacheco study prompt-based structured prediction in a 2025 paper. Large language models can do many language tasks from prompts alone, but they can also invent facts and give uneven answers. Tasks with a fixed output structure, such as labeling each word in a sentence, expose those flaws.
The authors pair the models with combinatorial inference, a method that enforces valid output structure. They test many prompting styles to see which ones give confidence scores that the inference step can use well. In every style, adding inference gave more consistent and more accurate results than prompting alone. Extra gains came from calibration and from training with structured goals. The work argues structured learning still matters.
Catalog record
| CREATOR | Matt Pauk, Maria Leonor Pacheco |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 62 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-15090
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Mapping the Course for Prompt-based Structured Prediction Matt Pauk, Maria Leonor Pacheco Abstract LLMs have been shown to be useful for a variety of language tasks, without requiring task-specific fine-tuning. However, these models often struggle with hallucinations and complex reasoning problems due to their autoregressive nature. We propose to address some of these issues, specifically in the area of structured prediction, by combining LLMs with combinatorial inference in an attempt to marry the predictive power of LLMs with the structural consistency provided by inference methods. We perform exhaustive experiments in an effort to understand which prompting strategies can effectively estimate LLM confidence values for use with symbolic inference, and show that, regardless of the prompting strategy, the addition of symbolic inference on top of prompting alone leads to more consistent and accurate predictions. Additionally, we show that calibration and fine-tuning using structured prediction objectives leads to increased performance for challenging tasks, showing that structured learning is still valuable in the era of LLMs. 1 Introduction Prompting large language models (LLMs) has been shown to be an effective methodology for a variety of NLP tasks ( Lou et al. 2024 ) . Pre-training general-purpose LLMs on a large amount of data has given them an impressive amount of world knowledge that they can apply to a variety of tasks without requiring specialized training ( Brown et al. 2020 ; Wei et al. 2022b ) , allowing us to generate answers to any question or instruction in text form by conditioning it on textual input. The input can be formatted in numerous ways in an attempt to bias the model output towards the right answers, including hand-crafted templates Raffel et al. 2020 , free-form instructions Chung et al. 2024 and questions Gardner et al. 2019 . This provides us with a flexible and adaptable framework in which we can easily adapt to new problems by simply designing appropriate prompts and passing a handful of input-output demonstrations. However, regardless of the prompting strategy used, these models are still limited based on their training objectives Radford and Narasimhan 2018 ; Wei et al. 2022a ; Ouyang et al. 2022 , which often leads to hallucinations and struggles with more complex reasoning tasks ( McCoy et al. 2023 ; Ji et al. 2023 ) . One such area where these limitations become apparent is that of structured prediction tasks. We use the term structured prediction to describe any machine learning task that consists of predicting several individual but related components as part of some structured object ( BakIr and Foundation 2007 ) . These tasks are widely common in NLP, where we are often interested in parsing text into complex linguistic structures ( Mann and Thompson 1988 ; Lascarides and Asher 2008 ; Palmer et al. 2010 ; Kamath and Das 2019 ) or aligning language with structured knowledge ( Mao et al. 2019 ; Pacheco and Goldwasser 2021 ) . Most previous work applying LLMs to structured prediction tasks treats each component task as an unrelated prompting task ( Roy et al. 2022 ) or prompts the model to produce the entire structure all at once as a sequence of tokens ( Ettinger et al. 2023 ) . However, because these strategies are solely relying on auto-regressive generation for predicting structures, they do not have a way to strictly enforce that the predicted structure is a valid one. Recently, Mehta et al. 2024 proposed a framework for explicitly modeling dependencies by combining traditional inference algorithms with prompt-based predictions. Their approach first scores local candidate substructures by prompting LLMs, and then finds the best global output via constrained optimization. They tested their framework on semantic role labeling and co-reference resolution and showed that enforcing consistency improves performance over unconstrained prediction while guaranteeing structurally valid outputs. While these results show the relevance and potential of constrained inference for prompt-based structured prediction, it is not clear how we should derive these scores from prompt-based inferences. In their work, Mehta et al. 2024 simply takes the raw likelihood of generating a particular response and directly plugs them into the maximum a posteriori (MAP) inference process. Traditional structured inference algorithms rely on weighting certainty scores for the different local candidate substructures, and finding the best global assignment that satisfies the structural constraints of the problem. Historically, trained ad hoc models generated label scores, which would correspond to the local or globally normalized likelihood of the candidate label based on a learned conditional distribution P(Y|X) Lafferty et al. 2001 ; Collins 2002 ; Chang et al. 2012 ; Pacheco and Goldwasser 2021 . Unlike trained discriminative classifiers, prompt-based approaches do not learn a conditional distribution for the specific task, but rather estimate the probability of generating a token in a vocabulary given the sequence of tokens provided in the prompt Xie et al. 2022 . This makes deriving certainty scores for prompt-based predictions very challenging. Given the wide range of approaches for certainty estimation Kadavath et al. 2022 ; Xiong et al. 2024 and calibration Jiang et al. 2021 ; Tian et al. 2023 in LLMs, it is hard to ascertain which -if any- of them would be appropriate for structured inference algorithms. This is especially relevant given that many of these techniques have shown to struggle in aligning confidence scores with actual accuracy and to reliably predict failure cases Xiong et al. 2024 . In this paper, we are interested in systematically exploring and comparing different ways to score candidate substructures for prompt-based prediction, as well as exploring learning mechanisms to align LLMs with structured objectives. To this end, we present an exhaustive study of different ways to combine the predictive power of LLMs with structured inference to enforce the structural consistency of LLM predictions. Specifically, our goal is to answer the following three research questions. 1. Does combinatorial inference improve on LLMs in structured prediction tasks? 2. What is the best way to estimate confidence values from LLMs for combinatorial inference? 3. What is the best way to fine-tune LLMs for structured prediction tasks? We evaluated our methods on two challenging discourse-level structured prediction tasks: morality framing and coreference resolution, and show that inference helps performance, regardless of the strategy used to extract confidence values. Of the confidence estimation strategies we explore, formulating the prompt as a true/false question performs the best. Additionally, we show that fine-tuning models based on the global structured prediction objective leads to improved performance over fine-tuning on the individual component tasks. 2 Related Work Deep structured prediction. There is a lot of previous work combining neural models with symbolic inference for structured prediction tasks. Neural networks globally normalized using structured inference have been successfully applied to sentence-level NLP tasks such as named entity recognition and dependency parsing Chen and Manning 2014 ; Weiss et al. 2015 ; Ma and Hovy 2016 ; Lample et al. 2016 ; Kiperwasser and Goldberg 2016 ; Malaviya et al. 2018 . When dealing with tasks that go beyond sentence-level dependencies, most work combines the output scores of independently trained classifiers using inference Beltagy et al. 2014 ; Ning et al. 2018 ; Pryor et al. 2023 ; Leto et al. 2024 while others create ad-hoc joint learning