Extracting narrative signals from public discourse: a network-based approach
Armin Pournaki, Tom Willaert · 2024
Read Extracting narrative signals from public discourse: a network-based approach by Armin Pournaki, Tom Willaert (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2411-00702.txt.
Description
Abstract Abstract Narratives are key interpretative devices by which humans make sense of political reality. As the significance of narratives for understanding current societal issues such as polarization and misinformation becomes increasingly evident, there is a growing demand for methods that support their empirical analysis.
Catalog record
| CREATOR | Armin Pournaki, Tom Willaert |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 86 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2411-00702
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Extracting narrative signals from public discourse: a network-based approach Armin Pournaki, Tom Willaert Abstract Abstract Narratives are key interpretative devices by which humans make sense of political reality. As the significance of narratives for understanding current societal issues such as polarization and misinformation becomes increasingly evident, there is a growing demand for methods that support their empirical analysis. To this end, we propose a graph-based formalism and machine-guided method for extracting, representing, and analyzing selected narrative signals from digital textual corpora, based on Abstract Meaning Representation (AMR). The formalism and method introduced here specifically cater to the study of political narratives that figure in texts from digital media such as archived political speeches, social media posts, transcripts of parliamentary debates, and political manifestos on party websites. We conceptualize these political narratives as a type of ontological narratives: stories by which actors position themselves as political beings, and which are akin to political worldviews in which actors present their normative vision of the world, or aspects thereof. We approach the study of such political narratives as a problem of information retrieval: starting from a textual corpus, we first extract a graph-like representation of the meaning of each sentence in the corpus using AMR. Drawing on transferable concepts from narratology, we then apply a set of heuristics to filter these graphs for representations of 1) actors and their relationships, 2) the events in which these actors figure, and 3) traces of the perspectivization of these events. We approach these references to actors, events, and instances of perspectivization as core narrative signals that allude to larger political narratives. By systematically analyzing and re-assembling these signals into networks that guide the researcher to the relevant parts of the text, the underlying narratives can be reconstructed through a combination of distant and close reading. A case study of State of the European Union addresses (2010 – 2023) demonstrates how the formalism can be used to inductively surface signals of political narratives from public discourse. 1 Introduction Complex societal phenomena such as political polarization and misinformation challenge analyses of public discourse based on traditional markers of political orientation. Recent scholarship indeed recognizes that these developments might be better understood in terms of how diverging interpretative frameworks shape people’s understanding of reality ( Friedman, 2023 ) . This shifting focus towards interpretation and interpretative devices recalls a broader “narrative turn” in the social sciences ( Goodson & Gill, 2011 ) , which highlights the importance of storytelling and narratives as key sense-making devices that organize and frame political reality. Examples of such political narratives include stories about power and where it resides, such as online conspiracy theories that position power with an invisible political elite ( Birchall & Knight, 2022 ) , or stories that shape collective identities, and that pit an “us” against an opposing “them” ( Benkler et al., 2018 ) . As the significance of such narratives for understanding current societal issues becomes increasingly evident, there is a growing demand for methods that support their empirical analysis. Specifically, disciplines across the social sciences and humanities are marked by an urgent need for robust, machine-guided methods that enable large-scale, empirical analysis of political narratives circulating in digital media, including archived political speeches, social media posts, transcripts of parliamentary debates, and political manifestos on party websites. This work addresses this need by combining transferable approaches from natural language processing and network science into a theoretically-informed method for extracting relevant narrative signals from text. We define narrative signals as core elements of narratives, such as actants, their goals, their actions, and their relationships within the narrative. We will refer to the textual instantiations of these signals as narrative traces . On a methodological level, the study of narratives is typically associated with the practice of close reading , whereby selected texts are carefully examined and analyzed by drawing on the conceptual frameworks and sensitizing concepts from the field of (literary) narratology ( 1 ; Bal & Boheemen, 2009 ) . Recent work in the area of small stories analysis has demonstrated that this method of close reading can be fruitfully applied to the analysis of born-digital traces, such as specifically curated collections of messages or posts from social media ( Georgakopoulou, 2021 ; Georgakopoulou, 2022 ; Page, 2010 ) . Likewise, conceptual advances in transmedial narratology have opened up the field of close narratological analysis to digital media and their emerging storytelling modes ( Thon, 2016 ) . Yet, as a result of the on-going digitalization of political communication, the volumes of texts that might be considered relevant for studying the narrative aspects of public discourse, have surpassed the capacity of individual researchers to explore each text in depth, and have rendered manual coding and analysis of documents exceedingly expensive ( Borgman, 2017 ) . This challenge of information overload highlights the need for alternative, machine-guided reading protocols, which rely on (semi-)automated text processing to surface relevant narrative signals from texts. As illustrated by advances in the interdisciplinary field of digital humanities ( Burdick et al., 2016 ) , the application of tools and techniques from natural language processing, along with approaches from other computational fields such as (social) network analysis, can inform a practice of distant reading ( Moretti, 2013 ; Underwood, 2019 ) and guided close reading ( Pournaki et al., 2021 ) , in which fundamental questions in the humanities and social sciences are approached through quantitative analyses of digital corpora. It has thus been shown that sensitizing concepts from narratology, some of which long predating the advent of personal computers, can effectively be operationalized in computational terms ( Boyd et al., 2020 ; Willaert, 2023 ) . Likewise, work at the intersections of corpus linguistics and critical discourse analysis has started to explore how corpus-based methods might capture such politically-relevant elements as framing and perspectivization ( Baker et al., 2008 ) . In this paper, we demonstrate that such data-driven approaches to narratives and narrative signals could similarly benefit research in social science and media studies, in particular the study of political discourse on digital platforms. To this end, we propose an unsupervised, computational, network-based approach to extracting and analyzing narrative signals from public discourse. 1.1 Objectives The present paper aims to contribute to the development of robust and replicable methods for the extraction and representation of narrative signals from text to support sociological interpretation of political narratives in large corpora. In accordance with on-going work in digital humanities and computational social science, we approach the extraction of narrative signals from texts as an information-retrieval problem, which we address by combining techniques for natural language processing with methods from network analysis. Specifically, one objective of this paper is to explore how Abstract Meaning Representation (AMR) ( Banarescu et al., 2013 ) , a formal language for representing the meanings of sentences, can be leveraged for the study of political narratives. The fundamental methodological challenge our proposed method thus faces, is one of operationalization: namely that due to the complexities of language and discourse, narrative signals, such as references to particular actors and events, might be manifested in texts in many different forms. We argue that this limits the applicability of deductive top-down, pattern-matching