Political Actor Agent: Simulating Legislative System for Roll Call Votes Prediction with Large Language Models

Hao Li, Ruoyuan Gong, Hao Jiang · 2024

Read Political Actor Agent: Simulating Legislative System for Roll Call Votes Prediction with Large Language Models by Hao Li, Ruoyuan Gong, Hao Jiang (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-07144.txt.

Introduction

Predicting how a legislature will vote usually means compressing politicians into vectors, and Hao Li, Ruoyuan Gong, and Hao Jiang replace the vectors with actors in a 2024 paper. Their Political Actor Agent framework has large language models role-play the members of a legislature, then simulates the chamber to forecast roll call votes.

The design answers three complaints about embedding methods: hand-built features, hunger for training data, and reasoning nobody can read. Agents argue from the roles they inhabit, so each prediction comes with human-understandable reasoning from several viewpoints. Tested on voting records from the 117th and 118th United States House of Representatives, the framework beat the older approaches on accuracy while exposing its logic. The authors offer it as a tool for political science, where an explanation can matter as much as the forecast.

Catalog record

CREATORHao Li, Ruoyuan Gong, Hao Jiang
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE31 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-07144

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Political Actor Agent: Simulating Legislative System for Roll Call Votes Prediction with Large Language Models Hao Li, Ruoyuan Gong, Hao Jiang Abstract Predicting roll call votes through modeling political actors has emerged as a focus in quantitative political science and computer science. Widely used embedding-based methods generate vectors for legislators from diverse data sets to predict legislative behaviors. However, these methods often contend with challenges such as the need for manually predefined features, reliance on extensive training data, and a lack of interpretability. Achieving more interpretable predictions under flexible conditions remains an unresolved issue. This paper introduces the Political Actor Agent (PAA), a novel agent-based framework that utilizes Large Language Models to overcome these limitations. By employing role-playing architectures and simulating legislative system, PAA provides a scalable and interpretable paradigm for predicting roll call votes. Our approach not only enhances the accuracy of predictions but also offers multi-view, human-understandable decision reasoning, providing new insights into political actor behaviors. We conducted comprehensive experiments using voting records from the 117-118th U.S. House of Representatives, validating the superior performance and interpretability of PAA. This study not only demonstrates PAA’s effectiveness but also its potential in political science research. Introduction Legislative actions, such as proposing, reviewing, and voting on bills, enable political actors to influence national and societal development. Modeling these actors has emerged as an interdisciplinary focus within quantitative political science and computer science. The representations obtained from modeling political actors are applied to downstream tasks such as roll-call vote prediction ( Feng et al. 2022 ; Mou et al. 2021 ) , and political stance prediction ( Feng et al. 2021 ; Li and Goldwasser 2019 ) . In this paper, we primarily focus on the problem of predicting legislators’ roll call votes.With voting records, bill texts, and background knowledge, there are two main approaches to modeling political actors. The ideal point model, one of the most widely used methods for roll call vote prediction, represents legislators and bills as points in one or multiple dimensions ( Clinton, Jackman, and Rivers 2004 ; Kraft, Jain, and Rush 2016 ) . Recently, some studies have employed heterogeneous information graphs to represent legislators, bills, and contextual knowledge, including complex relationships between party affiliations, lobbying ( Davoodi, Waltenburg, and Goldwasser 2020 ) , and assets ( Feng et al. 2022 ; Feng et al. 2021 ; Mou et al. 2024 ) . These studies then use heterogeneous graph neural networks to generate embeddings for nodes within the graph and predict voting outcomes. Both approaches embed legislators and bills into a vector space and use neural networks or similarity measures to predict results. However, the aforementioned embedding-based methods exhibit several limitations: 1. Limitations of predefined features: The model’s training relies solely on predefined features, preventing natural extension to new, untrained relationships. 2. Volume of training data: Most models depend on large datasets to achieve optimal performance, which is not feasible in real-world scenarios, such as predicting votes of newly elected legislators. 3. Interpretability of predictions: Predictions based on embeddings lack interpretability, particularly in providing insights in a manner understandable to humans. To address these challenges, we have turned our attention to the accomplishments of agent research based on Large Language Models (LLMs) ( Wang et al. 2024 ) . With designed profile, planning, and action modules, LLM agents can exhibit intelligent decision-making behaviors. Some studies have applied LLM Agents in fields such as economics ( Kim et al. 2024 ; Zhou et al. 2024a ) , social simulation ( Mou, Wei, and Huang 2024 ; Chuang et al. 2024 ; Dai et al. 2024 ) , and voting decision-making ( Yang et al. 2024 ; Majumdar, Elkind, and Pournaras 2024a ) . As shown in figure 1 , by reframing the problem of modeling political actors as constructing political agents, we introduce deeper insights into this field. Figure 1: Examples of different political actor modeling methods include: The ideal point model represents legislators and bill entities as vectors. The graph-based model embeds nodes from heterogeneous information graphs into vectors using a graph embedding model. Our agent-based model does not rely on distances between embeddings; instead, it directly generates voting outcomes using LLM agents. Specifically, we designed the Political Actor Agent (PAA) based on a role-playing architecture ( Li et al. 2023 ) , which offers several advantages: 1. Scalable Politician Profile: Each agent is equipped with a scalable profile. This profile is more flexible and easier to manage compared to manually designed relational rules. 2. Multi-view Planning: From various views, such as the delegate and trustee views ( Alexander 2019 ) , the PAA can formulate different voting plans. Decision-making reasons understandable to humans can better provide new insights for political science research. 3. Simulated Legislative Action: Based on legislators’ voting strategies, we developed an Influence Mechanism that simulates parliamentary dynamics. Legislators are categorized as leader agents and follower agents, with follower agents being influenced by the voting outcomes of leader agents. This mechanism allows for accurate vote predictions even with limited known data. Our contributions are as follows: 1. We propose a new agent-based paradigm for political actor research. Compared to embedding-based methods, our role-playing framework for legislator simulation offers more accurate and interpretable results for corresponding downstream tasks. 2. We introduce the Political Actor Agent (PAA) for roll-call vote prediction. Our approach, through the design of scalable profiles, multi-view planning, and simulated legislator actions, significantly enhances prediction accuracy and offers interpretable decision-making insights for political science research. 3. We conduct comprehensive experiments using voting records from the 117-118th House of Representatives. Our experiments demonstrate that our method not only achieves high prediction accuracy but also provides interpretable political insights. Related Works This section introduces roll call voting prediction based on political actor modeling and the use of LLM agents for decision simulation. Modeling Political Actors for Voting Prediction Legislators’ voting behavior in parliament has been a primary research focus due to its characteristic transparency and significance. One of the most popular techniques in political science is the ideal point model, constructed based on voting records and typically used to represent unidimensional or multidimensional ideological positions ( Poole and Rosenthal 1985 ; Clinton, Jackman, and Rivers 2004 ) . The ideal point model has been expanded in several studies. For instance, ( Gerrish and Blei 2011 ) employ a topic model to perform a detailed analysis of legislative texts, enhancing the contextual understanding of votes. Further extending this approach, researchers have developed a topic factorized ideal point model that assigns ideal points for each topic rather than globally, allowing for more nuanced interpretations of legislative behavior ( Gu et al. 2014 ) . Additionally, efforts have been made to learn multidimensional embeddings of legislators and bills to improve prediction accuracy ( Kraft, Jain, and Rush 2016 ) , and to integrate broader political texts, such as speeches and tweets, into the ideal point model to enrich the dataset ( Vafa, Naidu, and Blei 2020 ) . In terms of incorporating richer contextual information, graph-based methods, driven by advancements in knowledge graphs and graph neural networks, have gained popularity. External knowledge is introduced into voting prediction in the form of heterogeneous information graphs. Compared to ideal

Read the complete text