A Dynamic Fusion Model for Consistent Crisis Response
Xiaoying Song Anirban Saha Anik Eduardo Blanco, Vanessa Frias-Martinez Lingzi Hong · 2025
Read A Dynamic Fusion Model for Consistent Crisis Response by Xiaoying Song Anirban Saha Anik Eduardo Blanco, Vanessa Frias-Martinez Lingzi Hong (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-01053.txt.
Introduction
Xiaoying Song leads a team of five authors on a fusion model for consistent crisis response. Automated replies can assist communication with crisis-affected people. Consistency of style is a key factor, though often overlooked. Style affects the trust affected people place in responders. Few studies explore methods for keeping style consistent.
The team proposes a new metric for style consistency. Their fusion-based approach to generation is grounded in that metric. The method works in two stages at the instance level. It first assesses the style of candidate replies. It then optimizes and merges them through a fusion step. High-quality replies result with much less variation in style. Tests across datasets show gains over baselines in quality and uniformity both.
Catalog record
| CREATOR | Xiaoying Song Anirban Saha Anik Eduardo Blanco, Vanessa Frias-Martinez Lingzi Hong |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 55 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-01053
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Dynamic Fusion Model for Consistent Crisis Response Xiaoying Song Anirban Saha Anik Eduardo Blanco, Vanessa Frias-Martinez Lingzi Hong Abstract In response to the urgent need for effective communication with crisis-affected populations, automated responses driven by language models have been proposed to assist in crisis communications. A critical yet often overlooked factor is the consistency of response style, which could affect the trust of affected individuals in responders. Despite its importance, few studies have explored methods for maintaining stylistic consistency across generated responses. To address this gap, we propose a novel metric for evaluating style consistency and introduce a fusion-based generation approach grounded in this metric. Our method employs a two-stage process: it first assesses the style of candidate responses and then optimizes and integrates them at the instance level through a fusion process. This enables the generation of high-quality responses while significantly reducing stylistic variation between instances. Experimental results across multiple datasets demonstrate that our approach consistently outperforms baselines in both response quality and stylistic uniformity. 1 Introduction People in crisis often turn to social networks for information, support, and assistance, especially when other sources cannot be relied upon Bukar et al. 2022 . Although some responses in social media from the general public offer valuable information and emotional support, others may be inaccurate and even misleading to those in crisis Jafar et al. 2023 . For example, during Hurricane Irma, users on Twitter (now X) shared conflicting information about whether shelters required identity checks, which affected whether some immigrants decided to evacuate Hunt et al. 2022 . Direct communication from relevant government agencies or NGOs that carry out disaster relief efforts is critical to providing accurate information and verifying misleading information. However, authorities and NGOs often do not have enough resources to respond promptly to all affected individuals. At the same time, people’s needs are so different that a one-size-fits-all response is rarely effective Paulus et al. 2024 ; Lenz and Eckhard 2023 . This challenge can be mitigated using LLM-based chat engines to understand natural conversations and generate informed responses Song et al. 2025a . Leveraging AI to improve the efficiency, scalability, and accuracy of crisis communication has become a critical research focus Ziberi et al. 2024 . Figure 1: Examples of responses with high and low professionalism and actionability. Professional responses include explanations backing recommendations, demonstrating authority. Actionable responses offer specific guidance (e.g., phone numbers, website links) that users can follow to seek help. In this paper, we focus on generating consistent responses, i.e., ensuring that professionalism, actionability, and relevance are roughly the same across all responses. Recent studies have explored the potential role of LLMs in supporting crisis communication Hong et al. 2025 ; Xiao and Yu 2025 ; Otal et al. 2024 ; Grigorev et al. 2024 . These systems aim to provide actionable, real-time guidance to affected individuals, focusing on user satisfaction, responsive interaction, and efficient use of resources Lei et al. 2025 . However, an important issue remains overlooked: the consistency of automatically generated responses. Authorities and NGOs have shown bias in their responses to people in crisis, which leads to inequitable access to aid and distrust van Voorst et al. 2022 ; Huang and Su 2009 . We define consistency as the uniformity of the style in which information is conveyed across all responses. In particular, the core information conveyed should maintain the same level of quality regardless of the audience, crisis scenario, or communication platform. Consistency signals organizational reliability. When messages remain aligned, audiences are more likely to trust the source Correia 2024 . In contrast, inconsistent responses can be confusing and diminish trust Chatratichart et al. 2024 . For example, if some responses offer clear guidance while others are vague or off-topic, users may be uncertain about what to believe or do. Figure 1 shows examples of replies with different degrees of professionalism and actionability. When responses vary in quality across users, those receiving lower quality replies may perceive the interaction as inattentive or dismissive, resulting in dissatisfaction. Previous studies have explored the generation of consistent responses in general-purpose dialogue systems, with particular attention to persona consistency Lee et al. 2024 , semantic consistency Fan et al. 2025 , and factual consistency Mesgar et al. 2021 . Few studies have addressed style consistency in crisis communications Huang and Su 2009 . Additionally, these studies typically employ fine-tuned generative models to increase consistency Lee et al. 2024 ; Mesgar et al. 2021 . There are no established metrics to evaluate the consistency of responses in crisis communication. Effective crisis communication requires adherence to critical communicative functions Sellnow and Seeger 2021 ; Coombs 2007 . These responses should be professional Steimle et al. 2024 ; Coombs 2007 , actionable Coche et al. 2021 ; Bono 2024 , and relevant to user needs. Response consistency, therefore, entails delivering messages with stable characteristics across these dimensions, regardless of user query or scenario. We propose a task-oriented definition for crisis communication: consistency refers to the degree to which all responses have similar characteristics across the three dimensions: professionalism, actionability, and relevance, while exhibiting minimal variation across responses. In addition, we propose a fusion framework to generate crisis responses with improved consistency. The approach integrates the strengths of the responses generated by multiple methods, taking advantage of their complementary advantages to produce highly effective outputs in all evaluation dimensions, resulting in reduced variations. Our approach employs state-of-the-art generation methods and explores various fusion methods. We evaluate the generation approaches in the three critical dimensions (professionalism, actionability, and relevance) as well as consistency across these dimensions. Experiments show the fusion framework enables the generation of responses with higher overall quality and consistency. Specifically, we propose a novel fusion method grounded on assigning tailored weights to each dimension. We experiment with Llama and Mistral and demonstrate that our fusion method results in superior performance compared to alternatives. The contributions of this study include: • We introduce a novel crisis response evaluation metric, Consistency , designed to ensure uniformity across key evaluation dimensions while addressing diverse information-need queries across crisis events. • We propose a Fusion Framework that generates responses by integrating the strengths of outputs from different models, achieving strong performance on key evaluation metrics while ensuring consistency. • We conduct detailed analyses demonstrating the fusion mechanisms obtains strong performance across LLMs, crisis scenario, and other realistic scenarios. 2 Related Work Information Needs and Responses in Crisis Individuals frequently use social media platforms to seek assistance in times of crisis. Previous studies have proposed methods for detecting and classifying user needs. Several datasets offer granular categorizations of needs Alam et al. 2021a ; Alam et al. 2021b . Recent studies have proposed using LLMs to facilitate timely responses Hong et al. 2025 ; Otal et al. 2024 ; Yin et al. 2024 ; Chowdhury et al. 2024 . For example, Goecks and Waytowich 2023 and Otal et al. 2024 leveraged LLMs to generate actionable plans or guidance to crisis-affected individuals. Grigorev et al. 2024 developed IncidentResponseGPT, which leverages LLMs to automatically generate traffic incident response plans by synthesizing guidelines and processing real-time accident reports to inform authorities. Rawat 2024 introduced DisasterQA, which is designed to evaluate LLMs