TEMPER: Testing Emotional Perturbation in Quantitative Reasoning
Atahan Dokme, Benjamin Reichman, Larry Heck · 2026
Read TEMPER: Testing Emotional Perturbation in Quantitative Reasoning by Atahan Dokme, Benjamin Reichman, Larry Heck (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-07801.txt.
Introduction
Dokme, Reichman, and Heck ask whether emotional wording alone can damage a language model's math reasoning. Their TEMPER framework rewrites problems in emotional styles while keeping every number and relationship intact. The resulting Temper-5400 set holds 5,400 verified pairs across three math benchmarks, tested on eighteen models. Emotional framing cuts accuracy by 2 to 10 percentage points. Stripping the emotion back out recovers most of the loss, showing the damage comes from style, not corrupted content.
Catalog record
| CREATOR | Atahan Dokme, Benjamin Reichman, Larry Heck |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 83944 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.07801
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
TEMPER: Testing Emotional Perturbation in Quantitative Reasoning Atahan Dokme, Benjamin Reichman, Larry Heck Abstract Large language models are trained and evaluated on quantitative reasoning tasks written in clean, emotionally neutral language. However, real-world queries are often wrapped in frustration, urgency or enthusiasm. Does emotional framing alone degrade reasoning when all numerical content is preserved? To investigate this, a controlled emotion translation framework is developed that rewrites problems into emotional variants while preserving all quantities and relationships. Using this framework, Temper-5400 (5,400 semantically verified emotion–neutral pairs) is constructed across GSM8K, MultiArith, and ARC-Challenge, and evaluated on eighteen models (1B to frontier scale). Two core results emerge: First, emotional framing reduces accuracy by 2–10 percentage points even though all numerical content is preserved. Second, neutralizing emotional variants recovers most of the lost performance, showing both that the degradation is tied to emotional style rather than content corruption and that neutralization can serve as a lightweight inference-time mitigation. Non-emotional paraphrases cause no such degradation, implicating emotional content rather than surface-level changes. Beyond emotion specifically, the benchmark construction procedure provides a general framework for controlled stylistic translation and robustness evaluation. 1 Introduction When a frustrated student types “Ugh, my teacher is such a jerk! I got a 70 on the first exam and a lousy 45 on the second, my homework average is 90, and each component is worth 25% of the grade. He says I need at least a 70 overall to pass this garbage class. What the hell do I need on the final to not fail?!” , the underlying arithmetic is straightforward, yet the query looks nothing like the sanitized word problems in GSM8K ( 4 ) or MultiArith ( 21 ) . Real users frame questions with human emotions but benchmarks assume emotionally neutral input. Does this mismatch matter? There is reason to suspect this mismatch does matter. LLM performance is fragile under surface-level perturbations such as formatting ( 22 ) , irrelevant context ( 23 ) , and few-shot ordering ( 13 ) . On the other hand, emotional signals are encoded across model layers ( 17 ) , suggesting they could interfere with downstream tasks. Prior studies change both tone and content simultaneously and do not evaluate the effects of human-like emotional tone on quantitative reasoning performance. This paper isolates emotion as a variable and provides numerical, behavioral and representational evidence that standard neutral benchmarks overestimate reasoning robustness under emotionally framed inputs. A teacher-student framework is developed for training controlled emotion translators that rewrite math problems into emotionally framed variants while preserving all numbers, quantifiers, and relationships. To test whether the resulting degradation is tied to emotional style rather than content corruption, the same translators can neutralize emotional variants back to neutral tone. Across three benchmarks and eighteen reasoning models (1B to frontier scale), two core findings are established: (1) emotional framing of mathematically identical problems significantly degrades reasoning accuracy (2–10%), and (2) neutralization acts as a partial denoising step, recovering most of the lost performance and confirming that the degradation is tied to emotional style rather than content corruption. Hidden-state analysis across four architectures shows that emotional text shifts final-layer representations 3–4 \times further from the original in cosine distance compared to neutralized and paraphrased versions, consistent with representational interference rather than simple rewording. The contributions of this work are: (1) a teacher-student emotion translation framework combining emotional latent space distillation with intensity-controllable auxiliary losses to produce controlled emotional rewrites; (2) Temper-5400 , a benchmark of 5,400 verified emotion–neutral pairs (900 problems \times 6 emotions) across three reasoning domains, constructed using multi-translator generation, semantic filtering, and non-emotional paraphrase controls; (3) evidence across eighteen models that emotional framing degrades reasoning by 2–10% while non-emotional paraphrases do not; (4) evidence that neutralization recovers most lost performance, serving as both a diagnostic tool and a lightweight inference-time mitigation; and (5) representational evidence that emotion shifts hidden states 3–4 \times further than neutral text with linear separability. 2 Related work Emotion and LLM Behavior. EmotionPrompt ( 10 ) and NegativePrompt ( 25 ) show that emotional phrases alter LLM performance, and 24 find they amplify disinformation. Recent work (citation withheld for anonymity) demonstrate that emotional tone degrades reading comprehension, but do not isolate emotion from content changes in a quantitative reasoning setting. Related work on toxicity ( 6 ) and politeness ( 16 ) explores how social register affects generation quality but does not measure reasoning impact. This isolation is provided through controlled translators that preserve all numerical content and evaluation across eighteen models from 1B to frontier scale. Robustness of mathematical reasoning. Behavioral testing frameworks such as CheckList ( 19 ) systematically probe model capabilities through controlled perturbations. LLM math performance is sensitive to paraphrasing, irrelevant context ( 23 ) , and prompt formatting ( 22 ) , while chain-of-thought prompting ( 26 ) partially mitigates such fragilities. Concurrent work perturbs the mathematical content itself: GSM-Symbolic ( 15 ) changes numerical values, GSM-PLUS ( 11 ) augments problem structure. This work complements these by holding math constant and perturbing only the emotional wrapper, producing consistent 2–10% drops that persist even under CoT prompting. Knowledge distillation and style transfer. Text style transfer aims to change stylistic attributes while preserving content ( 9 ) , with sentiment and formality transfer being the most studied directions. The proposed translator extends this paradigm to emotion in mathematical text, where content preservation is verifiable through numerical constraints. Architecturally, knowledge distillation ( 7 ) is adapted with intermediate representation matching inspired by FitNets ( 20 ) : the student’s hidden states are projected into the teacher’s latent space providing richer supervision. 3 Methodology This section describes how controlled emotion translators are built that can rewrite math problems into emotional variants while preserving mathematical content. The core idea is to combine a standard language model fine-tuned for translation with a frozen emotion classifier that provides auxiliary supervision, aligning the translator’s internal representations with the classifier’s emotion space. This produces translators whose emotional intensity can be controlled via a single hyperparameter. Figure 1 illustrates the full pipeline, with implementation details in Appendix A . (a) Inference Charlie has 31 more snowballs than Lucy. She has 19 . How many does Charlie have? Translator Target emotion: disgust Ugh, Charlie is hoarding 31 more slushy snowballs than Lucy. She’s stuck with a measly 19 . How many does Charlie have? (b) Training Instruction + source Llama 3.1-8B + LoRA (trainable) Target text DistilRoBERTa frozen classifier 100-d latent 7-d categorical \mathcal{L}_{\text{CE}} \mathcal{L}=\mathcal{L}_{\text{CE}}+\lambda\,\mathcal{L}_{\text{aux}} \mathcal{L}_{\text{aux}} 4096-d h_{L} 100-d proj. 7-d proj. Emo100 Emo7 Emo100 Emo7 Figure 1: Overview. (a) The translator rewrites a neutral math problem into an emotional variant, preserving numerical structure (bold). (b) Training combines generation loss ( \mathcal{L}_{\text{CE}} ) with auxiliary alignment ( \mathcal{L}_{\text{aux}} ). h_{L} denotes the final-layer (layer L{=}32 ) hidden state of Llama 3.1-8B (4096-d), mean-pooled and linearly projected to match the teacher’s representation space. Emo100 supervises at the 100-dim latent layer; Emo7 at the 7-dim categorical output. \lambda controls the emotion–fidelity trade-off. 3.1 Emotion teacher and student translator The emotion translator is trained using a student-teacher framework. The student (Llama 3.1-8B-Instruct with LoRA) learns to translate between neutral and emotional text, while a frozen emotion classifier