SWI: Speaking with Intent in Large Language Models

Yuwei Yin, EunJeong Hwang, Giuseppe Carenini · 2025

Read SWI: Speaking with Intent in Large Language Models by Yuwei Yin, EunJeong Hwang, Giuseppe Carenini (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-21544.txt.

Introduction

Yuwei Yin and co-authors teach language models to state their intent before they speak. People plan before they talk; models usually just generate. The method, Speaking with Intent, makes the model write its goal first. That short plan then guides the answer that follows.

Tests cover summaries, mixed question answering and math problems. Stating intent first beat direct generation across the board. The gain held under varied settings. Human judges rated the stated intents as coherent and useful. They also found the outputs easier to follow. The authors frame explicit intent as a cheap cognitive upgrade, a pause that sharpens both reasoning and prose.

Catalog record

CREATORYuwei Yin, EunJeong Hwang, Giuseppe Carenini
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE44 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-21544

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

SWI: Speaking with Intent in Large Language Models Yuwei Yin, EunJeong Hwang, Giuseppe Carenini Abstract Intent, typically clearly formulated and planned, functions as a cognitive framework for communication and problem-solving. This paper introduces the concept of Speaking with Intent (SWI) in large language models (LLMs), where the explicitly generated intent encapsulates the model’s underlying intention and provides high-level planning to guide subsequent analysis and action. By emulating deliberate and purposeful thoughts in the human mind, SWI is hypothesized to enhance the reasoning capabilities and generation quality of LLMs. Extensive experiments on text summarization, multi-task question answering, and mathematical reasoning benchmarks consistently demonstrate the effectiveness and generalizability of Speaking with Intent over direct generation without explicit intent. Further analysis corroborates the generalizability of SWI under different experimental settings. Moreover, human evaluations verify the coherence, effectiveness, and interpretability of the intent produced by SWI. The promising results in enhancing LLMs with explicit intents pave a new avenue for boosting LLMs’ generation and reasoning abilities with cognitive notions. 1 1 1 Source code: https://github.com/YuweiYin/SWI 1 Introduction Intent, the goal-oriented intention in our mind ( Adams, 1986 ; Mele, 1989 ; Mele and Moser, 1994 ) , serves as a critical component in communication and a guiding framework for problem-solving. As illustrated in Figure 1 (a), human thinking ( Kahneman, 2011 ) typically follows a structured loop where intent—a mental state or proactive commitment to perform a specific action or produce a particular outcome—directs problem analysis and logical reasoning, therefore also facilitating communication and interaction. Hence, we hypothesize that enabling AI systems to speak with their intent explicitly can replicate this meta-cognitive process, thereby improving their generation quality and reasoning ability. Figure 1: SWI Overview. (a) The intent, functioning as meta-thought and planning, guides the analysis with reasoning to answer the question. (b) The performance improvements brought by SWI on various tasks. In recent years, large language models (LLMs) ( Zhao et al., 2023 ; Min et al., 2023 ; Minaee et al., 2024 ) have revolutionized Natural Language Processing (NLP) with their excellent generative capabilities ( OpenAI, 2024 ; Anthropic, 2024 ; Gemini, 2024 ) . Enhancing LLMs on various language understanding and logical reasoning tasks ( Hendrycks et al., 2021 ; Suzgun et al., 2023 ; Lightman et al., 2024 ; Vendrow et al., 2025 ) is vital for their ongoing development ( Huang and Chang, 2023 ; Qiao et al., 2023 ; Patil, 2025 ) . This work introduces Speaking with Intent (SWI), requiring LLMs to articulate their own intent as a planning mechanism during generation, which makes LLM intentionality more explicit, in a way reminiscent of the long tradition of intent-driven generation in classic NLG ( Grosz and Sidner, 1986 ; Mann and Thompson, 1988 ; Moore and Paris, 1993 ; Reiter and Dale, 2000 ) . In essence, we hypothesize that, due to the autoregressive nature of LLMs ( Radford et al., 2019 ) and the attention mechanism ( Vaswani et al., 2017 ) , explicitly stated intent provides high-level guidance for subsequent analysis and reasoning. For example, when applying SWI to summarization tasks, each analytical step in summarizing an article is effectively guided by a preceding intent statement, which is a piece of free-form text generated by instruction-following LLMs ( Ouyang et al., 2022 ; Rafailov et al., 2023 ; Llama, 2024 ) instead of a predefined class as in traditional intent modeling ( Weld et al., 2022 ) . In this work, we verify the proposed hypothesis by comprehensively evaluating the effectiveness and generalizability of the proposed SWI method. Specifically, the experimental results across three diverse task categories (i.e., text summarization, multi-task question answering, and mathematical reasoning) demonstrate that speaking with intent in LLMs consistently outperforms directly generating responses without explicit intent. In summarization tasks, SWI produces summaries that are more accurate, concise, and factually reliable, with fewer hallucinations ( Ji et al., 2023 ; Li et al., 2024a ) in the output. In math reasoning tasks, SWI surpasses the LLM reasoning method Chain-of-Thought (CoT) ( Kojima et al., 2022 ) and LLM planning method Plan-and-Solve (PS) ( Wang et al., 2023 ) , and SWI can work synergistically with these methods to further improve them. Additionally, we perform human evaluations to assess the coherence, effectiveness, and interpretability of the intent generated by our SWI method. Evaluators largely agree on the quality of the generated intent, particularly for mathematical reasoning tasks. The evaluation results confirm that SWI enhances task performance and output explainability. The key contributions of this work are as follows: ➊ We introduce Speaking with Intent in LLMs, where the generated intent effectively guides problem analysis, logical reasoning, and text generation, boosting performance across various benchmarks. ➋ Extensive experiments and analyses across diverse task types and multiple datasets, including text summarization, multi-task QA, and mathematical reasoning, demonstrate the consistent effectiveness and generalizability of SWI. ➌ Human evaluations validate the coherence, effectiveness, and interpretability of the intent generated by SWI, with our evaluation practice providing standards for assessing freely generated intents. 2 Speaking with Intent This section presents the problem-solving workflow of LLMs and introduces Speaking with Intent (SWI), enabling LLMs to explicitly articulate their intent during response generation. 2.1 Problem-solving Workflow using LLMs Let \mathcal{D}=\{\mathcal{X},\mathcal{Y}\} be a dataset, where \mathcal{X}=\{X_{1},X_{2},\dots,X_{n}\} is the input information (questions), \mathcal{Y}=\{y_{1},y_{2},\dots,y_{n}\} is the corresponding references (correct answers), and n is the number of instances in \mathcal{D} . For text summarization datasets, X_{i} is the source article, and y_{i} is one of the reference summaries. For multiple-choice QA datasets, X_{i} contains the question and options, and y_{i} is the answer label such as (A)/(B)/(C) or Yes/No. For mathematical reasoning datasets, X_{i} is the math problem, and y_{i} is the correct answer (usually an integer number). In this work, we employ instruction-following LLMs (aka Chat LLMs) \mathcal{M} for experiments and apply the chat template with the system prompt P_{s} and user prompt P_{u} . The system prompt specifies the general behavior of the model (assistant), and the user prompt poses questions to the model. Therefore, the generated output \hat{y}_{i} is obtained by \displaystyle\hat{y}_{i}=\mathcal{M}(P_{s},P_{u},X_{i};\Theta,\zeta), (1) where P_{s} is the system prompt, P_{u} is the user prompt, and X_{i} is the task input. These string objects are concatenated using line breaks (“ \backslash n”) as the delimiter. With parameters \Theta and hyper-parameters \zeta , the LLM \mathcal{M} generates new tokens one by one until reaching the generation limit or generating the “end-of-text” special token provided by the tokenizer. 2.2 LLM Speaking with Intent SWI is a novel method that brings a significant cognitive concept (i.e., intent) into LLM generation. SWI is implemented in a simple and reproducible approach, i.e., we require LLMs to speak with intent (SWI) by presenting detailed instructions in the system prompts P_{s} and restating the SWI requirement in the user prompt P_{u} . Table 1 presents the SWI instructions for QA and math tasks. For summarization tasks, the fourth requirement in the system prompt is At last, clearly and concisely give your final summary starting with "Final Summary:" and the user prompt becomes Speak with intent and summarize the following article. {{article}} . As showcased in Figure 2 (math) and Figure 3 (summarization), LLMs that speak with intent articulate their

Read the complete text