Causal Discovery and Counterfactual Reasoning to Optimize Persuasive Dialogue Policies

Donghuo Zeng 1* , Roberto Legaspi 1* , Yuewen Sun 2 , Xinshuai Dong 2 , Kazushi Ikeda 1 , Peter Spirtes 2 , and Kun Zhang 2 · 2025

Read Causal Discovery and Counterfactual Reasoning to Optimize Persuasive Dialogue Policies by Donghuo Zeng 1* , Roberto Legaspi 1* , Yuewen Sun 2 , Xinshuai Dong 2 , Kazushi Ikeda 1 , Peter Spirtes 2 , and Kun Zhang 2 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-16544.txt.

Introduction

Donghuo Zeng and six co-authors tune persuasive chat systems with causal finds and what-if reasoning. Their paper is from two thousand twenty-five; the pack row gives no title or year, so the text head is the source. A chat that bends to a user's state persuades better, but user states shift as talks run.

A search method maps which user moves cause which system replies, with user moves as states and system moves as acts. A paired generative net then drafts what-if replies the system could have made. A deep Q-network learns from those drafts which reply to pick. On a charity persuasion data set, the chain lifts rewards past base methods, which shows cause maps can sharpen talk policy.

Catalog record

CREATORDonghuo Zeng 1* , Roberto Legaspi 1* , Yuewen Sun 2 , Xinshuai Dong 2 , Kazushi Ikeda 1 , Peter Spirtes 2 , and Kun Zhang 2
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-16544

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Causal Discovery and Counterfactual Reasoning to Optimize Persuasive Dialogue Policies Donghuo Zeng 1* , Roberto Legaspi 1* , Yuewen Sun 2 , Xinshuai Dong 2 , Kazushi Ikeda 1 , Peter Spirtes 2 , and Kun Zhang 2 Abstract Tailoring persuasive conversations to users leads to more effective persuasion. However, existing dialogue systems often struggle to adapt to dynamically evolving user states. This paper presents a novel method that leverages causal discovery and counterfactual reasoning for optimizing system persuasion capability and outcomes. We employ the Greedy Relaxation of the Sparsest Permutation (GRaSP) algorithm to identify causal relationships between user and system utterance strategies, treating user strategies as states and system strategies as actions. GRaSP identifies user strategies as causal factors influencing system responses, which inform Bidirectional Conditional Generative Adversarial Networks (BiCoGAN) in generating counterfactual utterances for the system. Subsequently, we use the Dueling Double Deep Q-Network (D3QN) model to utilize counterfactual data to determine the best policy for selecting system utterances. Our experiments with the PersuasionForGood dataset show measurable improvements in persuasion outcomes using our approach over baseline methods. The observed increase in cumulative rewards and Q-values highlights the effectiveness of causal discovery in enhancing counterfactual reasoning and optimizing reinforcement learning policies for online dialogue systems. keywords Persuasive dialogue system; counterfactual reasoning; causal discovery; deep reinforcement learning. † † affiliation: 1 Human-Centered AI Labs, KDDI Research, Inc., Saitama, Japan. 2 Department of Philosophy, Carnegie Mellon University, Pittsburgh, PA USA 1 Introduction Persuasive conversations [ 20 , 32 , 36 , 39 ] play a pivotal role in shaping user opinions, attitudes, and behaviors, particularly within the realms of marketing [ 1 ] , health communication [ 24 , 5 ] , and social interventions [ 12 ] . The effectiveness of these conversations hinges on adapting communication strategies to account for individual differences among users, such as in terms of their personality traits [ 17 ] , current situation [ 14 ] , and prior interactions [ 25 ] . Conventional systems for persuasive dialogues typically depend on fixed interaction policies known beforehand or rigid models that overlook the intricate and evolving aspects of the interactions, resulting in less effective persuasions. Current research on persuasive dialogue systems has mainly concentrated on how predefined persuasive strategies influence potential outcomes [ 26 , 33 ] , which often neglects the dynamic and personalized adaptation required to suit individual users. For example, the study in [ 8 ] contends that the order of persuasive strategies aimed at specific demographics may not be significant, advocating instead for a consistent sequence of persuasive appeals. While these systems have achieved some success in strategy learning, they lack the flexibility to adapt to users’ potentially ever-changing states, which can lead to unsatisfactory or undesirable persuasion outcomes. Figure 1 : An example of a persuasive dialogue between the persuader (ER) and persuadee (EE), which was extracted from the PersuasionForGood dataset (ID:20180826-181951_904_live, donation: $0.05). Each utterance of both ER and EE has been annotated in the dataset with a strategy. By identifying the causal relationship between EE’s negative-reaction-to-donation strategy and ER’s logical-appeal strategy, the persuader can replace the ground-truth foot-in-the-door strategy in the PersuasionForGood dataset with the more effective logical-appeal strategy. If counterfactual reasoning (CL) is applied, BiCoGAN generates the next action with logical-appeal strategy; otherwise, it is selected from the ground truth with logical-appeal strategy. The resulting donations are: ground truth ($0.05), causality without CL ($0.10), and causality with CL ($1.00). To address the above challenges, we innovate from our work in [ 40 ] to now focus on causal discovery guiding counterfactual reasoning. In contrast to existing methods that depends on already established strategies or to random selection of counterfactual actions, we use the Greedy Relaxation of the Sparsest Permutation (GRaSP ) [ 13 , 41 ] algorithm to discover from the data the cause-effect relationships at the strategy level of the dialogue utterances. The discovered causal relationships is then leveraged by a Bidirectional Conditional Generative Adversarial Network (BiCoGAN) [ 10 , 15 ] to select intelligibly from a wide range of alternative scenarios when constructing the counterfactual dialogue dataset. Specifically, our approach identifies the strategies dictating the persuadee’s ongoing utterances and treats them as the causal factors. This enables us to leverage the strategies associated with these factors, i.e., the effect strategies, as counterfactual actions, which enable BiCoGAN to produce alternative utterances. Let us take for instance the dialogue sample in Fig. 1 between a persuader (ER) and persuadee (EE). In the dataset, the utterances of both ER and EE had been annotated with strategies. Our approach would identify which among the strategies of ER would result from the causal influence of EE’s strategies. At the upper right side of Fig. 1 1 , we see that EE’s negative-reaction-to-donation strategy has been inferred to have caused ER to respond with an utterance that follows a logical-appeal strategy. With this causal knowledge, the counterfactual reasoning part at the bottom right will take this information to provide an alternative answer. Had there been no causal discovery involved, as shown at the left of Fig. 1 1 , the ER strategy would take on the ground truth strategy in the data, while disregarding the causal structure that plausibly underlies the interactions of ER and EE. The ER adapting its response from a supposed foot-in-the-door strategy to logical-appeal . If we apply counterfactual reasoning using BiCoGAN to generate the next action with logical-appeal strategy, it would increase the donation of $0.05 to $1.0; otherwise the next state with logical-appeal strategy will be selected from the ground truth database, it will increase the donation of $0.05 to $0.1. At the tail end of our framework, we optimize the selection of system utterances based on the counterfactual data using the Dueling Double Deep Q-Network (D3QN) [ 22 ] . By learning the best interaction protocols from the causality-navigated counterfactual data, the system is better able to dynamically adjust its responses. ultimately improving the quality and effectiveness of its persuasive policies. Our experimental results using the PersuasionForGood dataset [ 35 ] validate the ability of our proposed method to significantly improve the cumulative rewards and Q-values compared to our methods in [ 40 ] as baseline. Our findings highlight how reinforcement learning policies for online persuasive system interactions can be improved by combining causal discovery and counterfactual reasoning. To summarize, the contributions of this work are as follows: • We integrated causal discovery into the system response generation process using the GRaSP algorithm to identify causal relationships at the strategy level. This allows us to generate counterfactual actions that are established on underlying causal relationships. • The BiCoGAN model aided by the discovered strategy-level causal relationships generates effective counterfactual data. This generated data embodies the alternative and enhanced utterances that extend the original dialogues of the PersuasionForGood dataset. • The D3QN model learns the optimal policy from the causal graph-based counterfactual data, which enables the system to dynamically adapt its responses conditioned by user states, which would increase the quality of persuasive conversations yielding desirable persuasion outcomes. 2 Related Works 2.1 Persuasive Strategies Dialogue data from online discussions and social media that are annotated with persuasive strategies are often used to enhance argument-mining

Read the complete text