Open Political Corpora: Structuring, Searching, and Analyzing Political Text Collections with PoliCorp
Nina Smirnova, Muhammad Ahsan Shahid, Philipp Mayr · 2025
Read Open Political Corpora: Structuring, Searching, and Analyzing Political Text Collections with PoliCorp by Nina Smirnova, Muhammad Ahsan Shahid, Philipp Mayr (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-17465.txt.
Introduction
Nina Smirnova, Muhammad Ahsan Shahid, and Philipp Mayr built a web portal for political text research. Their 2025 arXiv paper presents PoliCorp, a platform for structuring, searching, and analyzing large political collections. The launch collection holds transcripts of German parliament debates that span more than seven decades of proceedings.
Researchers can search with logical operations that combine or exclude criteria across many fields. That power makes it easy to carve out custom subcollections tuned to one question, then download them in JSON form for deeper study. Extra processing steps prepare the texts for web search and add features. A key draw is that the interface needs no programming skill, so historians and social scientists can query processed texts directly. The authors frame the portal as shared infrastructure for discourse research over long spans of time.
Catalog record
| CREATOR | Nina Smirnova, Muhammad Ahsan Shahid, Philipp Mayr |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 23 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-17465
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Open Political Corpora: Structuring, Searching, and Analyzing Political Text Collections with PoliCorp Nina Smirnova, Muhammad Ahsan Shahid, Philipp Mayr Abstract In this work, we present PoliCorp , a web portal designed to facilitate the search and analysis of political text corpora. PoliCorp provides researchers with access to rich textual data, enabling in-depth analysis of parliamentary discourse over time. The platform currently features a collection of transcripts from debates in the German parliament, spanning 76 years of proceedings. With the advanced search functionality, researchers can apply logical operations to combine or exclude search criteria, making it easier to filter through vast amounts of parliamentary debate data. The search can be customised by combining multiple fields and applying logical operators to uncover complex patterns and insights within the data. Additional data processing steps were performed to enable web-based search and incorporate extra features. A key feature that differentiates PoliCorp is its intuitive web-based interface that enables users to query processed political texts without requiring programming skills. The user-friendly platform allows for the creation of custom subcorpora via search parameters, which can be freely downloaded in JSON format for further analysis. 1 Introduction Parliamentary debates offer a broad variety of topics for academic exploration, serving as an effective instrument for agenda-setting and influencing political power. By examining parliamentary speeches, researchers can uncover the implicit programmatic and ideological positions political parties hold. Recent studies include investigations into gender dynamics and examinations of negativity levels inferred from interjections ( Ash et al. 2025 ) and sentiment and negativity analysis ( Jenny et al. 2021 ) . Additional efforts focus on developing automated topic modeling ( Watanabe and Zhou 2022 ) and discursive framing approaches within legislative settings ( Reinig et al. 2024 ) . Parliamentary data from many countries is openly available online through governmental initiatives and open data platforms. Examples include the Open Data portal of the German parliament (Bundestag) 1 1 1 https://www.bundestag.de/services/opendata , the Austrian parliament transcripts 2 2 2 https://www.data.gv.at/en/ , and Hansard, the official record of the UK Parliament 3 3 3 https://hansard.parliament.uk/ . In addition to raw data, some initiatives provide preprocessed and linguistically annotated corpora, e.g., the Polish Parliamentary Corpus 4 4 4 https://clip.ipipan.waw.pl/PPC , GermaParl, a linguistically annotated corpus of German Bundestag plenary debates ( Blaette 2021 ; Blaette 2017 ) , and DutchParl, which contains documents from the parliaments of the Netherlands, Flanders, and Belgium in Dutch ( Marx and Schuth 2010 ) . Several platforms offer web-based search interfaces for parliamentary records, such as the polit-X portal 5 5 5 https://polit-x.de/ , which includes transcripts from the German Bundestag and state parliaments; the StateParl portal 6 6 6 https://stateparl.de/ , which covers debates from the 16 German state parliaments; and the Italian parliamentary transcripts portal 7 7 7 https://accademiadellacrusca.it/it/contenuti/discorsi-parlamentari/23591 . Although these resources provide comprehensive collections, they often present certain limitations. Raw data typically requires significant preprocessing before it can be analyzed, and many annotated datasets are distributed as complete corpora, necessitating advanced analytical skills to extract specific information ( Marx and Schuth 2010 ; Blaette 2017 ) . Furthermore, some data sets are embedded within specialized software environments, which require a knowledge of particular programming languages for effective use ( Blaette 2021 ; Blaette 2020 ) . Although certain platforms, such as polit-X, offer user-friendly online interfaces for data exploration, they often operate on a subscription basis, limiting open access. Overall, the lack of standardized, machine-readable annotations for parliamentary speeches limits the potential for quantitative research in this area ( Wissik 2021 ) . To overcome these challenges, we introduce the Pollux Political Corpora (PoliCorp) platform 8 8 8 https://demo-pollux.gesis.org/ , an advanced resource that offers researchers open, structured, and searchable access to processed political corpora. The platform currently contains a collection of transcripts of Bundestag debates, spanning 76 years of parliamentary debates – from September 1949 to July 2025. The platform is designed for political scientists, interdisciplinary researchers, and others engaged in the analysis of parliamentary discourse. Additional data processing steps were performed to enable web-based search and incorporate supplementary features. For instance, PoliCorp allows users to perform targeted searches not only within speeches but also across "interjections" and "calls to order". Calls to order can serve as indicators for analyzing incivility in parliamentary discourse, and offer a unique perspective on political polarization ( Jenny et al. 2021 ) , and are therefore of particular interest for political research. Moreover, analysis of calls to order as markers of disruptive language is a novel approach to studies of parliamentary corpora, going beyond traditional sentiment or stance analysis. Interjections constitute a key resource for understanding democratic processes, uncovering hidden power dynamics, and examining conflicts within parliament ( Ilie 2015 ; Truan 2017 ) . A key feature that differentiates PoliCorp is its intuitive web-based interface that enables users to query processed political texts without requiring programming skills 9 9 9 A demonstration of the search functionality is available at the following link: https://youtu.be/KplgIZRVVwQ . The user-friendly platform allows the creation of custom subcorpora via search parameters, which can be freely downloaded in JSON format for further analysis. The portal’s content is distributed under the CLARIN PUB+BY+NC+SA license. Background on Parliamentary Discourse The legislative period is a specific period of time for which a parliament is elected. In Germany, it spans four years. Within each legislative period, the work of the German Bundestag is organized through plenary sessions, which follow a set procedure. The session is presided over by a member of the Bundestag Presidium, comprising the president and two secretaries. The president moderates the session, ensuring procedural compliance and managing the allocation of speaking time. Speaking time is distributed proportionally among parliamentary groups, reflecting their relative representation in the parliament. Each session usually comprises several agendas, dedicated to a specific topic. If the speaker or an attending parliamentary member violates parliamentary order, i.e., interruptions, the president is authorized to issue a formal call to order 10 10 10 https://www.bundestag.de/services/glossar/glossar/O/ordnungsruf-869614 . Calls to order were analysed by Jenny et al. 2021 from a perspective of negativity analysis. Figure 3 demonstrates an example of a call to order during a parliamentary session from the PoliCorp interface. Interruptions or interjections during a speech may include spontaneous remarks or attempts to insert commentary by other members of parliament 11 11 11 https://de.wiktionary.org/wiki/Zwischenruf . Interjections are widely examined in political science research. Research on interjections has largely addressed their pragmatic, rhetorical, and disruptive functions ( Truan 2017 ; Shenhav 2008 ) . Many scholarly works have further investigated interjections in relation to gendered dynamics of interjections, including gendered patterns of attacks, interruptions, and participation in legislative debates across different contexts ( van Dijk and Poljak 2025 ; Ash et al. 2025 ; Vallejo Vera and Gómez Vidal 2022 ; Och 2020 ; Poljak 2022 ; Vallejo Vera and Gómez Vidal 2022 ; Miller and Sutherland 2023 ) . Additional lines of inquiry have explored interjections in relation to expertise, seniority, and affiliation dynamics ( Diener 2025 ) , cross-cultural variation in speech styles ( Isosävi et al. 2025 ) , and broader patterns of interruption behavior ( Poljak 2023 ) . 2 Backend Implementation Raw parliamentary speeches up to September