Persuasion Tokens for Editing Factual Knowledge in LLMs

Paul Youssef Christin Seifert Jörg Schlötterer · 2026

Read Persuasion Tokens for Editing Factual Knowledge in LLMs by Paul Youssef Christin Seifert Jörg Schlötterer (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-16781.txt.

Introduction

Paul Youssef, Christin Seifert, and Jörg Schlötterer find a cheap way to teach chatbots new facts. One known path shows the bot long sets of worked cases. Those sets cost time to build for each fact. They also eat space in the bot's short view. Their 2026 preprint swaps those sets for small trained marks.

Each mark is a short code trained to sway the bot. The marks ape the pull of the long case sets. Yet they need no fresh cases per fact. Bots could then gain facts fast and cheap. This could help news, care, and school bots stay fresh.

Catalog record

CREATORPaul Youssef Christin Seifert Jörg Schlötterer
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE33 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-16781

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Persuasion Tokens for Editing Factual Knowledge in LLMs Paul Youssef Christin Seifert Jörg Schlötterer Abstract In-context knowledge editing (IKE) is a promising technique for updating Large Language Models (LLMs) with new information. However, IKE relies on lengthy, fact-specific demonstrations which are costly to create and consume significant context window space. In this paper, we introduce persuasion tokens ( P-Tokens ) – special tokens trained to replicate the effect of IKE demonstrations, enabling efficient knowledge editing without requiring fact-specific demonstrations. We evaluate P-Tokens across two editing datasets and three LLMs, demonstrating performance comparable to, and often exceeding, IKE. We further find that editing performance is robust to distractors with small negative effects to neighboring facts, and that increasing the number of P-Tokens improves performance. Our work addresses key limitations of IKE and provides a more practical and scalable alternative for editing LLMs. 1 1 1 https://github.com/paulyoussef/p-tokens 1 Introduction Large Language Models (LLMs) encode facts about the world in their parameters 16 ; 22 ; 23 . Knowledge editing methods (KEs) have been introduced to address the problem of outdated factual knowledge in LLMs 21 ; 11 . KEs differ in how they update knowledge in LLMs. Parameter-modifying KEs 13 ; 17 directly change the model’s parameters, whereas parameter-preserving KEs 20 ; 6 introduce additional memory modules to update knowledge without affecting the original parameters. In-context knowledge editing (IKE) 29 makes use of the strong in-context learning abilities of LLMs and updates knowledge in LLMs by adding the updated knowledge as input to the model. More specifically, IKE constructs a prompt that contains the new fact with a set of 32 demonstrations to teach the model to use the new fact in semantically similar contexts, and to not affect other irrelevant facts. IKE has been shown to have strong performance. The diverse demonstrations, which are the reason for the strong performance of IKE, bring also key limitations. These demonstrations are fact-specific and have to be constructed from scratch for each edit. These demonstrations also make the prompt longer, which consumes much of the context window and makes inference slower. Figure 1: In-context knowledge editing (IKE) relies on complex demonstrations and leads to slower inference. Persuasion tokens ( P-Tokens ) eliminate the need for long demonstrations and lead to faster inference. We introduce persuasion tokens ( P-Tokens ), which are special tokens that are tuned to have the same effect as the IKE demonstrations and can edit facts in-context. P-Tokens eliminate the need for fact-specific demonstrations and replace the long IKE edits, leading to faster inference (see Figure 1 ). We train and evaluate P-Tokens on two standard knowledge editing datasets and three LLMs. Our experiments show strong performance of P-Tokens compared to IKE across all settings. Performance improves, with increasing the number of P-Tokens . We further study the effect of distractors (additional edits) on the editing performance. We find that the performance on editing and paraphrased prompts remains robust to distractors, but neighboring facts are negatively affected. We further compare the number of tokens and inference time for IKE and P-Tokens . Compared to IKE, P-Tokens require less tokens and have less inference time, highlighting the efficiency of P-Tokens . Our work provides an efficient, effective and a more practical alternative to IKE, paving the way for wider adoption. 2 Background and Problem Statement In-context Knowledge Editing. Facts are often represented as triplets of (subject,relation,object) , or (s,r,o) for short. Querying an LLM with a prompt p(s,r) , where p expresses the relation r with the subject s (e.g., “In which city is the Eiffel Tower?”), should lead to generating the object o (e.g., “Paris”), given that the fact (s,r,o) is encoded in the LLM. A knowledge editing operation E(s,r,o,o^{\prime},p) is successful if it changes the output of the LLM such that the retrieved object is o^{\prime} instead of o . IKE edits are conducted by prepending an editing prompt p_{{}_{IKE}}(s,r,o^{\prime}) to the query prompt p(s,r) , i.e., p_{{}_{IKE}}(s,r,o^{\prime})\oplus p(s,r) , where \oplus is the string concatenation operation. The editing prompt p_{{}_{IKE}}(s,r,o^{\prime}) causes the LLM’s output to change from o to o^{\prime} . Problem Statement. Given a model \mathcal{M} that outputs the object o , when provided with a prompt p(s,r) , i.e., o=argmax_{o*}\ \mathbb{P}_{\mathcal{M}(p(s,r))}[o^{*}] , where \mathbb{P}_{\mathcal{M}(p(s,r))} is the model’s output probability distribution over the vocabulary \mathcal{V} given the prompt p(s,r) and o^{*}\in\mathcal{V} . \mathcal{M} ’s output is changed to o^{\prime} with IKE 29 by prepending an IKE editing prompt p_{{}_{IKE}}(s,r,o^{\prime}) (see Figure 3 in the appendix for an example) to the original prompt, i.e., o^{\prime}=argmax_{o^{*}}\ \mathbb{P}_{\mathcal{M}(p_{{}_{IKE}}(s,r,o^{\prime})\oplus p(s,r))}[o^{*}] . Our goal is to replace the editing prompt p_{{}_{IKE}}(s,r,o^{\prime}) with a significantly shorter prompt p_{{}_{PT}}(s,r,o^{\prime}) such that o^{\prime}=argmax_{o^{*}}\ \mathbb{P}_{\mathcal{M}(p_{{}_{PT}}(s,r,o^{\prime})\oplus p(s,r))}[o^{*}] . Accordingly, the shorter prompt p_{{}_{PT}}(s,r,o^{\prime}) should have the same effect as the IKE editing prompt p_{{}_{IKE}}(s,r,o^{\prime}) , and lead to generating o^{\prime} . 3 Method To replace the IKE prompt with a short and efficient editing prompt, we enclose the edit p(s,r,o^{\prime}) with special editing tokens: BEGIN_EDIT and END_EDIT . We refer to these tokens as persuasion tokens or P-Tokens for short. We further optimize the embedding vectors of these tokens to minimize the Kullback-Leibler (KL) divergence loss between two output distributions: \mathcal{L}=KL[P_{{}_{PT}}||\ P_{{}_{IKE}}] (1) where P_{{}_{PT}}=\mathbb{P}_{\mathcal{M}(p_{{}_{PT}}(s,r,o^{\prime})\oplus p(s,r))} is the output distribution of the model when using the above described editing prompt with P-Tokens , and P_{{}_{IKE}}=\mathbb{P}_{\mathcal{M}(p_{{}_{IKE}}(s,r,o^{\prime})\oplus p(s,r))} is the output distribution when using the long IKE editing prompt. To improve performance, we further minimize the KL-divergence between the output distributions that correspond to the following pairs of inputs: Paraphrases: p_{{}_{PT}}(s,r,o^{\prime})\oplus p^{\prime}(s,r) and p_{{}_{IKE}}(s,r,o^{\prime})\oplus p^{\prime}(s,r) , where p^{\prime}(s,r) refers to a paraphrased version of the prompt p(s,r) . Neighbors: p_{{}_{PT}}(s,r,o^{\prime})\oplus p(\bar{s},r) and p(\bar{s},r) . Here, we use p(\bar{s},r) to refer to neighboring prompts, that query similar facts to the one targeted by the edit (same relation, but different subject). Our goal is to avoid affecting irrelevant facts that should not be changed by the edit. Distractors: We add a distractor that consists of several edits (with P-Tokens ) between the edit p_{{}_{PT}}(s,r,o^{\prime}) , and the querying prompt p(s,r) , to enhance robustness. Other: We add P-Tokens to other prompts that do not include any edits, such that P-Tokens have no effect when there are no edits. We provide an overview of all of the pairs of inputs in Tables 5 and 6 in Appendix A . Each training batch includes all types of input pairs. 4 Experimental Setup Datasets. We use two datasets in our experiments. The first is CounterFact 12 , which contains counterfactual statements (e.g., “The space needle is located in Rome.”). We use the same subset of 2,000 examples as 29 . We use 800 of these examples for training, 200 for validation and the remaining 1,000 for testing. The second dataset is zsRE 8 ; 15 , which contains question-answer pairs. From the training set, we randomly sample 800 instances for training and 200 for validation. For testing, we use the whole test set of 19,086 examples. There are no IKE edits for this dataset. As a replacement for IKE edits, we use a baseline containing the editing prompt or the paraphrased prompt. An overview of the examples used for zsRE is shown in Table 6

Read the complete text