Prompting Strategies for Enabling Large Language Models to Infer Causation from Correlation

Eleni Sgouritsa, Virginia Aglietti, Yee Whye Teh, Arnaud Doucet, Arthur Gretton, Silvia Chiappa · 2024

Read Prompting Strategies for Enabling Large Language Models to Infer Causation from Correlation by Eleni Sgouritsa, Virginia Aglietti, Yee Whye Teh, Arnaud Doucet, Arthur Gretton, Silvia Chiappa (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-13952.txt.

Introduction

Eleni Sgouritsa and five co-authors teach language models causal reasoning in a paper from twenty twenty-four. Correlation alone does not prove causation, yet models are often asked to infer one from the other. Several large language models do poorly at that task. The authors offer a prompting strategy built on a formal algorithm.

Their method, PC-SubQ, splits the task into fixed subquestions. Each subquestion mirrors one step of the PC algorithm for causal discovery. The model answers one step at a time. Each new prompt carries the answers so far, so the chain stays grounded. They tested the approach on the Corr2Cause benchmark. Performance improved across the models they tried. Readers get a way to lend algorithmic discipline to a model's guesses.

Catalog record

CREATOREleni Sgouritsa, Virginia Aglietti, Yee Whye Teh, Arnaud Doucet, Arthur Gretton, Silvia Chiappa
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE89 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-13952

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Prompting Strategies for Enabling Large Language Models to Infer Causation from Correlation Eleni Sgouritsa, Virginia Aglietti, Yee Whye Teh, Arnaud Doucet, Arthur Gretton, Silvia Chiappa Abstract The reasoning abilities of Large Language Models ( LLM s) are attracting increasing attention. In this work, we focus on causal reasoning and address the task of establishing causal relationships based on correlation information, a highly challenging problem on which several LLM s have shown poor performance. We introduce a prompting strategy for this problem that breaks the original task into fixed subquestions, with each subquestion corresponding to one step of a formal causal discovery algorithm, the PC algorithm. The proposed prompting strategy, PC-SubQ , guides the LLM to follow these algorithmic steps, by sequentially prompting it with one subquestion at a time, augmenting the next subquestion’s prompt with the answer to the previous one(s). We evaluate our approach on an existing causal benchmark, Corr2Cause : our experiments indicate a performance improvement across five LLM s when comparing PC-SubQ to baseline prompting strategies. Results are robust to causal query perturbations, when modifying the variable names or paraphrasing the expressions. 1 Introduction Advances in scaling Large Language Models ( LLM s) and training data sizes have led to unprecedented capabilities across a wide range of tasks. Several works ( Huang & Chang, 2023 ; Sun et al., 2023 ) focus on enhancing LLM s on various reasoning tasks, such as arithmetic, commonsense, logical or causal reasoning. It is often argued that the ability to demonstrate reasoning cannot be solely overcome by increasing model scale ( Rae et al., 2021 , inter alia ) . An active area of research is therefore investigating prompting approaches in order to elicit and enhance reasoning in LLM s ( Qiao et al., 2023 ) . Wei et al. (2022) proposed Chain-of-Thought ( CoT ) prompting, where a language model is prompted to generate a series of thoughts that mimic the reasoning process a person might employ when solving a task. For settings in which the problem to solve is harder than the demonstration examples, various works suggest to decompose the original complex task into simpler subtasks that are easier to solve ( Zhou et al., 2023a ; Khot et al., 2023 ; Dua et al., 2022 ) . Among the different reasoning capabilities, the ability to reason about cause and effect is fundamental to human intelligence, playing a pivotal role in scientific understanding and accurate decision-making. Most existing research on causal reasoning and LLM s investigates whether they can serve as a knowledge base for causal relationships ( Kıcıman et al., 2023 ; Willig et al., 2022 ; Zečević et al., 2023 ; Long et al., 2022 ) , thus assessing the commonsense reasoning capabilities of LLM s. More recent work ( Jin et al., 2023 ; Jin et al., 2024 ) focuses, instead, on their formal (pure) causal reasoning skills, i.e., their ability to reason using known procedures and formal rules from the causal inference literature ( Pearl, 2000 ; Pearl & Mackenzie, 2018 ; Spirtes et al., 2000 ) . One such ability, studied in Jin et al. (2024) , is that of inferring causal relationships from correlation statements . In this case, correlations or conditional independencies about a set of variables are given in natural language, for instance, “Ice cream sales correlate with shark attacks”, and the validity of a causal relationship between a pair of variables is inferred, for instance, whether “Ice cream sales cause shark attacks”. This is an important skill for LLM s as the training corpus may not directly contain certain causal relationships between variables, but instead events’ co-occurrence or correlation statements. To this end, Jin et al. (2024) formulated Corr2Cause , a causal benchmark that assesses this ability, on which they showed LLM s to perform poorly. Expanding the task of inferring causal relationships from correlation statements, one could more generally infer the causal structure from correlation statements , that is, identify the entire structure instead of a specific causal relationship between a pair of variables. We refer to this task as Natural Language Causal Discovery ( NL-CD ) to contrast it with standard/statistical Causal Discovery ( S-CD ) considered in the statistical causality literature ( Pearl, 2000 ; Pearl & Mackenzie, 2018 ; Spirtes et al., 2000 ) , that identifies the causal graph based on observed data. NL-CD , instead, is an LLM task that is based on natural language correlation statements. Even though there exist known statistical algorithms for certain causal tasks, our goal is to instead investigate the ability of LLM s to solve such tasks. This motivation is also shared in Jin et al. (2024) and Jin et al. (2023) for causal tasks, in Markeeva et al. (2024) and Veličković et al. (2022) for algorithmic tasks and in other works for arithmetic tasks. In this work, we address NL-CD by introducing a prompting strategy, PC-SubQ . Inspired by prompting approaches that decompose a complex task into simpler ones, PC-SubQ leverages one of the most widely used algorithms for S-CD , the PC algorithm ( Spirtes et al., 2000 ) , in order to decompose the NL-CD task. In particular, PC-SubQ decomposes the original task into several fixed subtasks, each corresponding to one step of the PC algorithm. We guide the LLM to follow these PC steps by having few-shot examples for each subtask and sequentially prompting the LLM , augmenting the next subtask with the answer(s) to the previous one(s). Given the final inferred graph, one can subsequently pose various causal queries, such as the ones included in Corr2Cause . We assess PC-SubQ on Corr2Cause and consistently observe improved performance compared to existing prompting strategies across five LLM s. Moreover, unlike models fine-tuned on Corr2Cause ( Jin et al., 2024 ) , LLM s’ performance using PC-SubQ is robust to query perturbations: even though the few-shot examples are based on Corr2Cause textual expressions, performance does not drop when variable names are modified or expressions are paraphrased. In summary, our main contributions are: • We propose a prompting strategy that addresses NL-CD by guiding the LLM to reason through applying the PC algorithm steps, thus also offering transparent and interpretable reasoning steps. • We evaluate PC-SubQ on Corr2Cause and show that it outperforms a range of widely used prompting strategies across five LLM s. • We show that PC-SubQ is robust to causal query perturbations in terms of variable renaming and paraphrasing, and can be applied unchanged to examples with natural stories. 2 Related Work Causal reasoning and LLM s There is an increasing attention on the strengths and limitations of LLM s on causal tasks ( Kıcıman et al., 2023 ; Willig et al., 2022 ; Zečević et al., 2023 ; Zhang et al., 2023 ) . A large body of existing literature assesses how well LLM s capture commonsense and domain knowledge about causal relations ( Kıcıman et al., 2023 ; Long et al., 2022 ; Zhang et al., 2023 ; Tu et al., 2023 ; Vashishtha et al., 2023 ; Jiralerspong et al., 2024 ) . Consider, for example, the BIG-bench Cause and Effect task of deciding which of the two events, "The driver

Read the complete text