Framing Matters: Addressing Framing Sensitivity in Decision-Making through Behaviorally-Grounded Value Alignment

Seojin Hwang, Minju Kim, Junhyuk Choi, JeongHyun Park, Hwanhee Lee · 2026

Read Framing Matters: Addressing Framing Sensitivity in Decision-Making through Behaviorally-Grounded Value Alignment by Seojin Hwang, Minju Kim, Junhyuk Choi, JeongHyun Park, Hwanhee Lee (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-28188.txt.

Introduction

Hwang and colleagues show that language-model decisions wobble when the same facts are framed differently. Their Fragile benchmark varies value-tinted narration, time slice, and vividness, flipping decisions over a quarter of the time on average. Simple prompt and activation fixes worsened the flips, while their Valign method, which anchors choices to a stable value prior, cut them steadily.

Catalog record

CREATORSeojin Hwang, Minju Kim, Junhyuk Choi, JeongHyun Park, Hwanhee Lee
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE117080
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.28188

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Framing Matters: Addressing Framing Sensitivity in Decision-Making through Behaviorally-Grounded Value Alignment Seojin Hwang, Minju Kim, Junhyuk Choi, JeongHyun Park, Hwanhee Lee Abstract Large Language Models (LLMs) are increasingly deployed in high-stakes decision-making settings such as legal reasoning, where consistency under factually equivalent inputs is critical. However, we find that fact-preserved but differently framed inputs can significantly destabilize LLM decisions. To systematically investigate this problem, we introduce Fragile , a large-scale benchmark that isolates fact-preserving semantic framing across three controlled dimensions: value-tinted narration , temporal slice , and narrative vividness . Our experiments reveal a high susceptibility of LLMs to framing, with an average decision flip rate of 28.6%. We find that simple prior prompt-level and activation-level interventions not only fail to suppress framing sensitivity but actively amplify it. We therefore propose Valign , a representation-level method that explicitly targets these framing dimensions by anchoring decisions to a stable value prior, steering hidden states toward the model’s value-consistent direction, and projecting out temporal-vividness-sensitive directions from the model’s hidden states. Valign consistently reduces framing-induced decision flips, demonstrating that robust mitigation requires directly targeting the internal pathways in which framing operates. 1 Introduction Large Language Models (LLMs) are increasingly deployed in decision-making settings, where they must choose between competing options under language descriptions. While prior work has focused on improving accuracy, alignment, a fundamental question remains underexplored: Are LLM decisions stable under semantically equivalent but differently framed inputs? In human cognition, framing effects are known to alter decisions without changing the underlying facts 33 of the situation, revealing framing biases such as present bias and loss aversion 13 . Figure 1: Framing-induced decision sensitivity in LLMs. Despite identical facts, value-tinted narrative framing shifts the model’s choice. If LLMs show a similar tendency to prioritize framing over factual content, this raises serious concerns about their reliability. As illustrated in Figure 1 , even a subtle shift in framing can hijack the model’s internal reasoning, causing severe decision reversals despite identical underlying facts. Recent framing-related studies either examine shifts under minor lexical, surface-level variations 36 ; 29 ; 21 ; 23 ; 19 , or conflate fact-preserving framing with persuasion 30 ; 22 ; 2 , emotional cues 3 , or latent factual variation 35 ; 26 , without explaining the internal mechanisms 4 ; 34 . As a result, the representational sources of pure, fact-preserving framing sensitivity remain poorly understood. To investigate this problem, we introduce Fragile , a large-scale benchmark designed to isolate fact-preserving semantic framing across four high-stakes decision domains. Fragile transforms each instances scenario or options along three controlled dimensions: (i) value-tinted narration , which embeds latent value orientations; (ii) temporal slice , which shifts the perceived time horizon of consequences; and (iii) narrative vividness , which modulates experiential concreteness. Using Fragile , we first establish the prevalence of framing sensitivity of various LLMs by evaluating behavioral changes through flip rates and distributional shifts ( L_{1} distance). Our results confirm that LLM decisions are significantly destabilized by these frames, often leading to decision reversals despite identical underlying facts. We then conduct an analysis using logit lens projections to examine how framing alters internal representations at the decision token. Logit analysis reveals that internal representation shifts align with each framing’s intended direction, confirming that framing-induced context directly governs decisions. We additionally evaluate several existing mitigation strategies commonly used to promote objective or stable reasoning, including prompt-level interventions 2 ; 4 and activation-based steering methods 34 . However, none substantially reduce framing sensitivity, suggesting that they address only surface symptoms without targeting the underlying representational sources of framing sensitivity, and therefore are insufficient. Motivated by this observation, we introduce Valign , a representation-level mitigation framework designed to stabilize LLM decisions under semantic framing. Drawing inspiration from human cognition, where stable value systems promote robust judgments, Valign aligns the model’s latent decision representations with persistent value-centered directions rather than transient framing cues, combining: (i) value anchoring to establish stable normative priors, (ii) value steering to guide hidden representations toward value-consistent decision directions, and (iii) orthogonal projection to suppress framing-sensitive components that compete with these aligned internal values. Valign consistently reduces framing-induced decision flips across all framing types and model architectures, demonstrating that directly targeting the internal pathways in which framing operates is required. Our contributions are as follows: • We introduce Fragile , a benchmark isolating fact-preserving framing across four high-stakes domains and three controlled dimensions. • We uncover LLM volatility for each framing, identifying three distinct mechanistic pathways that drive behavioral flips. • We propose Valign , which utilizes value steering and framing subspace projection that significantly reduces decision flips. 2 Related Work 2.1 Framing Effects in Decision-Making Framing effects—where differences in presentation alter judgment without changing the underlying facts—have been extensively studied in behavioral economics and cognitive psychology 33 ; 13 . Logically equivalent choices presented differently lead to different decisions, a phenomenon linked to loss aversion 14 , psychological distance 32 , and selective attention 27 . This suggests that decisions are shaped not only by factual content but also by which aspects of a situation are made salient. While such effects are well-documented in human cognition, existing work on LLMs tends to conflate framing with persuasion or factual variation, and mitigates only surface symptoms without addressing underlying representational causes. We address these limitations by isolating fact-preserving framing across diverse domains and examining how framing affects both model decisions and internal representations. 2.2 Framing Sensitivity and Mitigation in LLMs Prior work shows that LLMs are sensitive to surface-level framing, where semantically equivalent inputs can elicit different responses depending on wording or formulation 36 ; 23 . Similar sensitivity has been observed under natural reframing, predicate-level framing, yes/no asymmetries, and epistemic markers 19 ; 10 ; 38 ; 17 . Beyond surface variation, LLMs are also vulnerable to contextual influence such as sycophancy and persuasion 30 ; 2 , and framing instability has been reported in moral dilemmas and high-stakes decision settings 26 ; 3 . However, these studies often involve emotional cues, domain-specific biases, or broader prompt perturbations, leaving fact-preserving semantic framing across diverse decision domains less explored. Existing mitigation, including instruction prompting, Chain-of-Thought, and steering, provides only partial or setting-specific robustness 2 ; 4 ; 34 , motivating our more root-targeted internal analysis our value-grounded mitigation. Figure 2: Overview of the FRAGILE construction and evaluation framework. ( Left ) Base scenarios are synthesized into label-swapped and framed variants along three dimensions and undergo quality filtering. The evaluation pipeline quantifies framing sensitivity by comparing LLM decisions on base versus framed inputs. ( Right ) 3 FRAGILE Benchmark 3.1 Task Formulation We introduce Fragile , a benchmark for LLM’s framing sensitivity in semantically equivalent but framed decision-making, as illustrated in Figure 2 . Formally, each instance consists of: • A high-stake base scenario S ; • A binary option (decision) space D=\{d_{1},d_{2}\} ; • A set of framing transformations \mathcal{F}=\{f_{1},\ldots,f_{n}\} applied to S or D , each generating a set of framed variants V=\{f_{i}(S)\mid f_{i}\in\mathcal{F}\} . Each transformation modifies only the presentation of S while preserving (i) factual content, (ii) decision structure. Given a framed variant v_{i}\in V , the model selects one decision from D . Framing sensitivity is then defined

Read the complete text