Elite Polarization in European Parliamentary Speeches: a Novel Measurement Approach Using Large Language Models

Gennadii Iakovlev · 2025

Read Elite Polarization in European Parliamentary Speeches: a Novel Measurement Approach Using Large Language Models by Gennadii Iakovlev (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-06658.txt.

Introduction

Gennadii Iakovlev introduces a new way to measure hostility among political elites using large language models. His 2025 paper argues that comparative research tracks public polarization and party ideology, but rarely the direct evaluations politicians aim at each other. The new Elite Polarization Score fills that gap from parliamentary speech.

The method finds named actors in debate transcripts, pairs speakers with their targets, and scores the sentiment aimed at each one. Scores are then rolled up into party and parliament measures of mutual negativity. Tests on British, Hungarian, and Italian debates spanning up to four decades found no false discoveries. Sentiment estimates landed close to human coding, and the model matched or beat human sensitivity in two of the three countries.

Catalog record

CREATORGennadii Iakovlev
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE64 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-06658

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Elite Polarization in European Parliamentary Speeches: a Novel Measurement Approach Using Large Language Models Gennadii Iakovlev Abstract This project introduces a new measure of elite polarization via actor and subject detection using artificial intelligence. I identify when politicians mention one another in parliamentary speeches, note who is speaking and who is being addressed, and assess the emotional temperature behind these evaluations. This maps how elites evaluate their various out-parties, allowing us to create an index of mutual out-party hostility, that is, elite polarization. While I analyzed polarization data over the past four decades for the UK, and two decades for Hungary and Italy, my approach lays the groundwork for a twenty-year, EU-wide time-series dataset on elite polarization. I obtain the results that can be aggregated by party and quarter. The resulting index demonstrates a good face validity: it reacts to events such as electoral campaigns, country- and party-level crises, and to parties losing and assuming power. 1 Introduction Mutual emotional hostility among politicians—those who write the rules rather than merely obey them—can reshape democracy far more quickly than mass-level partisanship. Because elite attitudes are filtered only by institutions, not by party heuristics or media frames, spikes of animosity at the apex of power can transmit directly into legislative obstruction, constitutional hardball, and even coups. Indeed, democratic-stability scholarship shows that emotional antipathy among governing elites almost always intensifies in the run-up to democratic breakdowns ( Linz 1978 ; Bermeo 2016 ; Levitsky and Ziblatt 2018 ; Lührmann 2021 ; Wunsch and Blanchard 2023 ) . Political polarisation more generally has become a cornerstone of research on party politics and regime change. Scholars argue that excessively large—or, at the other extreme, vanishingly small—ideological divides coupled with heightened partisan affect can undermine virtually every aspect of democratic practice ( Iyengar, Sood and Lelkes 2012 ; McCoy, Rahman and Somer 2018 ; Iyengar et al. 2019 ; Druckman et al. 2020 ; Reiljan 2020 ; Orhan 2022 ; Schedler 2023 ; Turkenburg and Janssen 2023 ) . Yet one phenomenon distinct from mass affect—the mutual hostility inside political elites—remains understudied ( Hetherington 2001 ; Banda and Cluverius 2018 ; Iyengar et al. 2019 ; Druckman et al. 2020 ) . The demand for reliable measures of any form of polarization within political science has grown in recent years, but the available tools have been limited. Traditional methods, such as aggregating survey data, are typically confined to specific countries and time periods, typically once in five years. Likewise, sentiment or contextual analyses often required extensive training and manual coding, which restricted most projects to a single country ( Abercrombie and Batista-Navarro 2020 ) . This methodological gap had thwarted cross-country studies — until recent advances in artificial intelligence. This article proposes a novel methodology for measuring polarization among political elites using Large Language Models (LLMs). Unlike previous natural language processing (NLP) techniques, LLMs can identify instances where political entities are mentioned in political speeches and accurately gauge the speaker’s attitude toward these entities. The LLMs can differentiate between emotions tied to a specific issue and those directed at an opponent, and can even articulate the reasoning behind their interpretations. In addition, they can distinguish substantive references to political figures in parliamentary speeches from merely procedural regular expressions. This allows us to disaggregate the unit of analysis from a single speech to a single reference to a political entity. Without the AI-based actor-subject recognition, the traditional sentiment or stance recognition using speech as a unit of analysis would, at maximum, measure the mean temperature of policy debates, and not the relationships between the democratic adversaries. I introduce a multi-stage artificial intelligence-driven algorithm that extracts and analyzes parliamentary speeches to measure elite polarization. First, I standardize the speeches from existing corpora and submit them via Application Programming Interface (API) queries to a Large Language Model (LLM). Instead of relying on specific keywords, the LLM autonomously identifies every instance where politicians mention one another and evaluates the speaker’s sentiment toward the referenced counterpart, drawing on contextual cues rather than mere word matches. It explains the reasoning behind its interpretations in natural language, and I retain metadata on both the speaker and the entity addressed. Next, additional algorithms use subsequent API queries to categorize these outputs into the dyads of political parties referring to each other. Finally, by aggregating hundreds of thousands of such mentions, I generate an index of Elite Polarization. To ensure reliability, I have also developed a customized approach for assessing the sensitivity and accuracy of my findings. Apart from additional capabilities, using LLMs for NLP yields several crucial advantages over previous machine learning techniques and dictionary-based analyses. Comparative studies have shown that pre-trained general AI models achieve higher accuracy than previous generations of neural language models designed for specific tasks ( Kheiri and Karimi 2023 ; Mens and Gallego 2023 ) . First, my method eliminates the need for extensive training, which previously limited similar projects to computer science experts rather than political scientists ( Abercrombie and Batista-Navarro 2020 ) . Second, LLMs can operate seamlessly across different languages without additional training, paving the way for cross-country datasets. My trials with various versions of LLMs indicate that models from the ChatGPT-4 family—and comparable systems such as LLAMA 3.1 70B and Mistral Small 22B—are adept at capturing textual nuances that were previously unmanageable with older machine learning techniques. That said, certain single steps in this actor and subject detection approach could be executed using traditional NLP techniques. For example, dictionary-based or machine-learning Named Entity Recognition (NER) methods ( Li et al. 2020 ) might capture some references to political entities. However, these techniques would likely only detect explicit mentions of governments and political parties but not their MPs, and their effectiveness would be limited to a few large, predominantly English-speaking democracies. Next, one could approximate the speaker’s attitude toward these actors by applying dictionary-based sentiment analysis to the words surrounding the entity names. Without the benefit of contextual embedding, traditional methods would not be able to distinguish, whether these words are used to actually characterise the speaker’s stance towards a referred entity or something else. In many cases, evaluations located close to entities’ names often simply describe the entity’s situation, hence, those being victims of a situation or taking advantage of it would be misjudged. Moreover, the adjacent words might simply not refer to this entity at all. Hence, both steps of extracting a subject and extracting the evaluation of a subject would suffer from extremely low precision and recall, with errors compounding over the process (see, among many others, Caselli et al. 2015 ). To qualitatively assess the performance of the proposed concept and methodology within individual countries, I apply proposed method to three European nations: Hungary, the United Kingdom, and Italy. These countries were selected based on factors such as known levels of affective mass polarization ( Orhan 2022 ) , the stability of their party systems, the type of their electoral systems (majoritarian or proportional), and the occurrence of democratic backsliding. I chose Hungary because it exhibits an extremely high level of affective mass polarization ( Orhan 2022 ) , has experienced the collapse of its de facto two-party system ( Powell and

Read the complete text