ParlaSpeech 3.0: Richly Annotated Spoken Parliamentary Corpora of Croatian, Czech, Polish, and Serbian

2025

Read ParlaSpeech 3.0: Richly Annotated Spoken Parliamentary Corpora of Croatian, Czech, Polish, and Serbian (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-01619.txt.

Introduction

Nikola Ljubešić, Peter Rupnik, Ivan Porupski, and Taja Kuzman Pungeršek present ParlaSpeech 3.0, a set of spoken corpora built from debates in four parliaments: Croatian, Czech, Polish, and Serbian. All told, the corpora hold about 6,000 hours of speech. They were built by matching ParlaMint transcripts and metadata to each parliament's audio.

This release adds layers of markup to both text and speech. The texts gain language annotations and sentiment scores. The speech gains marked filled pauses, the most common slip in normal talk. For two of the four languages, the team also added word- and letter-level alignments and marked stress in longer words. A sample study links sound features to sentiment. The corpora can be downloaded as JSONL or TextGrid files, or searched with a concordancer.

Catalog record

YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-01619

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

ParlaSpeech 3.0: Richly Annotated Spoken Parliamentary Corpora of Croatian, Czech, Polish, and Serbian Abstract ParlaSpeech is a collection of spoken parliamentary corpora currently spanning four Slavic languages – Croatian, Czech, Polish and Serbian – all together 6 thousand hours in size. The corpora were built in an automatic fashion from the ParlaMint transcripts and their corresponding metadata, which were aligned to the speech recordings of each corresponding parliament. In this release of the dataset, each of the corpora is significantly enriched with various automatic annotation layers. The textual modality of all four corpora has been enriched with linguistic annotations and sentiment predictions. Similar to that, their spoken modality has been automatically enriched with occurrences of filled pauses, the most frequent disfluency in typical speech. Two out of the four languages have been additionally enriched with detailed word- and grapheme-level alignments, and the automatic annotation of the position of primary stress in multisyllabic words. With these enrichments, the usefulness of the underlying corpora has been drastically increased for downstream research across multiple disciplines, which we showcase through an analysis of acoustic correlates of sentiment. All the corpora are made available for download in JSONL and TextGrid formats, as well as for search through a concordancer. Keywords: spoken corpora, parliamentary corpora, Slavic languages, sentiment, filled pauses, speech alignment, primary stress ParlaSpeech 3.0: Richly Annotated Spoken Parliamentary Corpora of Croatian, Czech, Polish, and Serbian Nikola Ljubešić †‡ , Peter Rupnik, Ivan Porupski, Taja Kuzman Pungeršek Jožef Stefan Institute, Ljubljana, Slovenia \dagger Faculty of Computer and Information Science, University of Ljubljana, Slovenia \ddagger Institute of Contemporary History, Ljubljana, Slovenia {nikola.ljubesic, peter.rupnik, ivan.porupski, taja.kuzman}@ijs.si Abstract content 1. Introduction Spoken corpora remain scarce compared to their written counterparts, largely due to the technical, logistical and legal challenges of their creation. Collecting natural speech often requires fieldwork, securing participant consent, and encouraging authentic conversation, while transcription and additional enrichment demands significant time, specialized skills, and deep knowledge of the communicative context. These difficulties are compounded when documenting unwritten languages or non-standard varieties (such as dialects, heritage languages, or L2 speech) which exist only in oral form. Even when available, spoken corpora, especially Slavic ones among European languages, are often small, limited in representativeness, and inconvenient to use, making them less effective for linguistic or phonetic analysis despite their importance for both research and speech technology development Dobrushina and Sokur 2022 . The CLARIN Resource Family ( Fišer et al. 2018 ) for spoken corpora 1 1 1 https://www.clarin.eu/resource-families/spoken-corpora reveals a highly skewed distribution of resources across European languages. While some, like Finnish and German, are well-resourced with thousands of hours of data, many others (including Croatian, Polish and Serbian) have only a small single corpus recorded. Most languages lack a corpus entirely. However, emerging corpus platforms, such as those hosted on CLARIN or TalkBank, have contributed significantly to the accessibility of spoken corpora across multiple languages concurrently. Parliamentary proceedings offer an exceptional opportunity for building spoken corpora of various official languages due to the open status of the data, and their public status regarding privacy concerns. While there have been parliamentary corpora constructed in the past, they mostly focused only on the basic alignment of transcripts and recordings, having primarily automatic speech recognition (ASR) use cases in mind. In this paper, we present the ParlaSpeech collection of spoken corpora, currently consisting of recordings from four parliaments, with speeches given in four languages. Different to all other parliamentary spoken corpora, the corpora have been enriched with various linguistic and paralinguistic layers, making the corpora highly useful for downstream research in various disciplines. The comparable nature of the corpora enables insights across languages, which significantly improves the strength of the resulting findings. 2. Related Work There is a number of languages already represented via parliamentary spoken corpora, e.g., Virkkunen et al. 2023 list corpora of 10 different languages. However, most of these corpora are primarily aimed at supporting development and improvement of automatic speech recognition (ASR) systems. A slight deviation from simplistic datasets, primarily aimed at ASR, is the Norwegian Parliamentary Speech Corpus ( Solberg and Ortiz 2022 ) which has its speeches automatically transcribed and manually checked, with non-standardized words explicitly marked and annotated with standardized equivalents. Another example of a parliamentary spoken corpus being more than just an ASR training dataset is the FT Speech Danish parliamentary corpus Kirkedal et al. 2020 , which includes normalizations of the official parliamentary transcripts, the lexic being aligned with the Språkbanken lexicon, and a grapheme-to-phoneme conversion. However, none of the available corpora (1) cover multiple languages, enabling cross-lingual studies, and, what is even more, (2) enrich the data on as many layers as is the case with the ParlaSpeech corpora. Outside the realm of parliamentary corpora, there have been activities in automatic enrichment of spoken corpora, enabling researchers to analyze not just the linguistic content, but also the accompanying prosodic and paralinguistic signals such as disfluencies, prosodic variation, speaker-specific characteristics, laughter or gestures Christodoulides et al. 2014 ; Nasr et al. 2014 ; Dobrushina and Sokur 2022 ; Wu et al. 2022 ; Lemmenmeier 2023 . Just recently multi-layer automation approaches with high-quality results started to emerge Liao et al. 2025 , while there is a consensus in the community that automatic multilayer annotations of spoken corpora are very much needed Wieczorkowska 2025 . We organize the remainder of this section by types of enrichment layers applied inside this work. Alignment . Transcript-aligned corpora are the most common type of corpora. All the parliamentary spoken corpora presented in Virkkunen et al. 2023 have been aligned on the level of instances of medium length, mostly up to a duration of 30 seconds, to streamline development of ASR systems. Most parliamentary corpora are aligned via time-stamped output of ASR, which is a practical solution given that ASR output on the spoken modality is needed to align the spoken modality with the official parliamentary transcripts. However, by now it is almost common knowledge that forced aligners such as the Montreal Forced Aligner (MFA) McAuliffe et al. 2017 significantly outperform ASR-based time alignments Rousso et al. 2024 . Moreover, grapheme- or phoneme-level aligned corpora are rare, nne such corpus being the British National Corpus ( Love et al. 2017 ) . In this paper we apply a MFA-based word-level and grapheme-level alignment model Ljubešić et al. 2022 on two out of our four languages, showing significant improvements to the baseline ASR-based word alignment. Primary word stress . Corpora containing stress labels for vowels or syllables are exceedingly rare, especially automatically annotated. One such corpus is the ISLE Corpus ( Atwell et al. 2003 ) , consisting of Italian and German learners’ spoken English (18 hr), that contains word, phone and stressed syllable alignments done manually by experts. Another such corpus is the Russian National Corpus, specifically in the Accentological corpus (135 Mw). However, audio files are not available and their approach is based on software that accents words using a built-in lexicon, again followed by human expert review and correction ( Savchuk 2009 ) . Recently, a spoken dataset of English disyllabic words was automatically constructed from three datasets by using CNN-based models of accuracy around 90% ( Allouche et al. 2025 ) .

Read the complete text