A Regression Framework for Understanding Prompt Component Impact on LLM Performance

Andrew Lauziere, Jonathan Daugherty and Taisa Kushner · 2026

Read A Regression Framework for Understanding Prompt Component Impact on LLM Performance by Andrew Lauziere, Jonathan Daugherty and Taisa Kushner (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-26830.txt.

Introduction

Lauziere and co-authors build a regression framework that measures how each prompt part affects language model scores. The method fits statistical models that link prompt portions to task results. They test it on Mistral-7B and GPT-OSS-20B solving a simple arithmetic problem. The regressions explain 72 and 77 percent of performance variation. Wrong example answers hurt both models. Positive and negative instructions showed mixed, contradictory effects across the two models.

Catalog record

CREATORAndrew Lauziere, Jonathan Daugherty and Taisa Kushner
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE39353
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.26830

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A Regression Framework for Understanding Prompt Component Impact on LLM Performance Andrew Lauziere, Jonathan Daugherty and Taisa Kushner Abstract As large language models (LLMs) continue to improve and see further integration into software systems, so does the need to understand the conditions in which they will perform. We contribute a statistical framework for understanding the impact of specific prompt features on LLM performance. The approach extends previous explainable artificial intelligence (XAI) methods specifically to inspect LLMs by fitting regression models relating portions of the prompt to LLM evaluation. We apply our method to compare how two open-source models, Mistral-7B and GPT-OSS-20B, leverage the prompt to perform a simple arithmetic problem. Regression models of individual prompt portions explain 72% and 77% of variation in model performances, respectively. We find misinformation in the form of incorrect example query-answer pairs impedes both models from solving the arithmetic query, though positive examples do not always improve performance. In terms of text-instructions, we find significant variability in the impact of positive and negative instructions – these prompts have contradictory effects on model performance. The framework serves as a tool for decision makers in critical scenarios to gain granular insight into how the prompt influences an LLM to solve a task. keywords [name=Index Terms: ] LLM; XAI; regression modeling; interpretable AI; prompt engineering. I Introduction Large language models (LLMs) are a class of deep neural networks which proficiently model patterns found in text data [ 39 ] . These models have achieved dominant performance across tasks such as text summarization [ 2 ] and machine translation [ 40 ] ; their performance continues to improve as training corpora and learning strategies such as reinforcement learning develop [ 3 , 27 ] . The models serve as the intelligence behind tools which have experienced cultural impact unseen in machine learning technology, such as Chat-GPT [ 4 ] , Grammarly [ 9 ] and Microsoft Copilot [ 8 ] . Despite comprehensive adoption, LLMs are some of the most opaque of machine learning methods. This is true for both intrinsic model features such as complexity due to size and inter-connectivity, as well as extrinsic aspects including the use of large and closed-source training corpora and optimization routines. These factors lead to to a concerning gap between deployment of LLMs and their understanding. Larger and more powerful models are being increasingly integrated into software systems as they find new use-cases and improve upon existing ones. However, these models are simultaneously becoming harder to understand and thus trust as they are less interpretable and more likely to be closed-source. LLMs and tools which leverage them are also highly influenced by the user-specified prompt. While guardrails imposed during fine-tuning, e.g., [ 27 ] , can reduce risk, the models can still output unwanted or harmful content. This direct-access paired with a lack of understanding of the mechanisms in which the prompt drives LLM output compounds risk. Researchers and decision-makers alike are interested in uncovering how LLMs function. At the moment there is little understanding as to when, why, or how an LLM will perform on a given task; researchers point to high performance on benchmark datasets as reason to trust (and thus use) their models [ 26 , 37 ] . In response, some researchers argue for slowing down AI research [ 29 ] , while others pursue developing technologies to audit it. In this work, we help fill the gap in understanding how LLMs function by developing an explainable artificial intelligence (XAI) framework for analyzing the impact of prompting on LLM performance. We coin this framework IAMs : I nterpretable A ttribution M odel s . IAMs adapts previous XAI methods [ 31 , 22 ] to fit regression models comprising features representing portions of the LLM input prompt. The framework enables granular and statistically rigorous inspection of LLM behavior by estimating the impact of various prompt components, and combinations thereof, on model performance via regression models. Section II first introduces necessary background concerning LLMs and prompting followed by an overview of XAI and a review of research related to this work. Then, Section III details the IAMs framework. Section IV applies IAMs to analyze and compare how two open-source LLMs solve an arithmetic problem. Finally Section V summarizes findings and outlines future work. II Related Work LLMs are unique from other data-driven models in that they are not only trained offline (i.e., unsupervised pre-training and supervised fine-tuning) as in traditional statistical learning, but they also use “in-context learning” via the prompt to guide the model during inference [ 3 ] . As a result, the end-user has direct impact on the quality of the output, so much so that a common step of model training is to censure its ability to output harmful content [ 27 ] . Designing the prompt, or prompting , has become an integral part in effectively using an LLM. Explainable artificial intelligence (XAI) methods enable interpretation of low-bias high-variance machine learning models; here, we focus on applying local model-agnostic methods [ 24 ] to understand LLMs by mutating the input prompt. Local methods aim to explain complex model behavior at a specific input, whereas model-agnostic tools demonstrate interpretability independent of the complex model at hand. Ribeiro et al. developed LIME: Local Interpretable Model-agnostic Explanations [ 31 ] , a surrogate modeling approach which “can be applied to any classifier.” In LIME, the local model is trained using sampled points around a specific input in the complex model space; then, a binary vector is formed representing the inclusion or exclusion of certain features, such as words in a text model or pixels in an image model. An interpretable model is trained on the binary vectors and associated labels. The authors also propose a “fidelity-interpretability” tradeoff using an L1 regularization term (i.e., Lasso: Least Absolute Shrinkage and Selection Operator) on the local model fitting. A higher penalty will drive parameter estimates of less impactful features to zero. Shapley values are a canonical local model-agnostic approach; the concept arises from game theory in which features of a model are “allocated payout” according to each one’s contribution in a prediction [ 34 ] . Lundberg and Lee unified the surrogate modeling approach in LIME and Shapley values in their SHAP: Shapley Additive Explanations framework [ 19 ] . The authors show a unique set of equations for guaranteeing Shapley value properties in an additive attribution model. Lundberg and Lee provide approximation algorithms for SHAP whereas both Grah and Thouvvenot [ 12 ] and Štrumbelj and Kononenko [ 35 ] provide general approximation algorithms for Shapley values. Lundberg et al. then extended SHAP to tree-based methods such as decision trees, random forests, and gradient-boosted trees [ 21 , 20 ] . The method was then improved and applied to explain AI models used in medicine via tree-based methods [ 1 ] . Mohammadi applied Grah and Thouvenot’s algorithm [ 12 ] to estimate Shapley values according to a vectorization of the prompt [ 22 ] . The method assessed the extent to which certain tokens impacted LLM performance. Liu et al. also applied Shapley values to quantify which prompts best contributed to performance by considering an ensemble of prompts

Read the complete text