Swiss Parliaments Corpus Re-Imagined (SPC_R): Enhanced Transcription with RAG-based Correction and Predicted BLEU
Vincenzo Timmel, Manfred Vogel, Daniel Perruchoud, Reza Kakooee · 2025
Read Swiss Parliaments Corpus Re-Imagined (SPC_R): Enhanced Transcription with RAG-based Correction and Predicted BLEU by Vincenzo Timmel, Manfred Vogel, Daniel Perruchoud, Reza Kakooee (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-07726.txt.
Introduction
Vincenzo Timmel and colleagues rebuild a corpus of Swiss parliamentary debates as long, clean speech-text pairs. The recordings are hours long and spoken in Swiss German dialect. Official session protocols exist as a reference text. Writing in twenty twenty-five, their pipeline first transcribes the audio into standard German with a strong speech model under generous compute. A large language model then corrects the transcript twice. One pass fixes misrecognitions, mainly names, using the protocols. A second pass grades each segment for completeness. Segments scoring below threshold on predicted quality are dropped.
The release holds hundreds of hours of audio, most passing quality control. Against the earlier sentence-level version, the long-form corpus scores clearly higher on a standard transcription metric. The authors present the recipe as a template for low-resource, specialized speech collections.
Catalog record
| CREATOR | Vincenzo Timmel, Manfred Vogel, Daniel Perruchoud, Reza Kakooee |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 17 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-07726
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Swiss Parliaments Corpus Re-Imagined (SPC_R): Enhanced Transcription with RAG-based Correction and Predicted BLEU Vincenzo Timmel, Manfred Vogel, Daniel Perruchoud, Reza Kakooee Abstract This paper presents a new long - form release of the Swiss Parliaments Corpus, converting entire multi - hour Swiss German debate sessions (each aligned with the official session protocols) into high - quality speech–text pairs. Our pipeline starts by transcribing all session audio into Standard German using Whisper Large - v3 under high - compute settings. We then apply a two - step GPT - 4o correction process: first, GPT - 4o ingests the raw Whisper output alongside the official protocols to refine misrecognitions, mainly named entities. Second, a separate GPT - 4o pass evaluates each refined segment for semantic completeness. We filter out any segments whose Predicted BLEU score (derived from Whisper’s average token log - probability) and GPT - 4o evaluation score fall below a certain threshold. The final corpus contains 801 hours of audio, of which 751 hours pass our quality control. Compared to the original sentence level SPC release, our long - form dataset achieves a 6 - point BLEU improvement, demonstrating the power of combining robust ASR, LLM - based correction, and data - driven filtering for low - resource, domain - specific speech corpora. 1 Introduction Data scarcity in low-resource domains still hinders the development of Automatic Speech Recognition (ASR) systems. For Swiss German, Plüss et al. 2021 contributed the Swiss Parliaments Corpus (SPC), including a meticulously prepared training dataset with high alignment quality of 176 hours of Swiss German speech paired with Standard German transcripts of Bernese parliamentary debates with a corresponding curated test dataset of 6 hours. The corpus was built using a forced sentence alignment procedure and alignment quality estimator that overcomes challenges such as sentence reordering and language mismatches between Swiss German audio and Standard German text. They used a global alignment algorithm based on Needleman-Wunsch and an Intersection over Union (IoU) estimator to filter out poor-quality alignments. Additional filters, such as character-per-second limits and language detection, ensured that only accurately aligned sentences were included. The SPC_R corpus presented in this paper is an extension of the original SPC corpus focusing on the creation, curation, and release of datasets tailored to Swiss German NLP applications. Originally, crawled data from the parliament debates of the Grosser Rat Kanton Bern encompass 801 hours of session recordings in long-form with a length spanning from 28 to 242 minutes paired with official session protocols. In contrast to Plüss et al. 2021 , which extracts sentences from parliamentary sessions by finding near-perfect matches between automatically generated transcriptions and the official session protocols, we incorporate an advanced transcription pipeline in SPC_R. This includes the Whisper Large-v3 model Radford et al. 2023 for transcription, and a post-correction step using GPT-4o Hurst et al. 2024 , aligned with the official protocol to further enhance transcription quality and overall data accuracy. In addition, the SPC_R corpus provides the data in long-form, whereas the original SPC is segmented at sentence level. The primary contributions include: • High-quality transcription by Whisper Large-v3 of approximately 801 hours of audio with high-compute settings, see Section 3 . • BLEU score Papineni et al. 2002 prediction based on Whisper transcription outputs via linear regression. • A two - step large language model (LLM) approach in which a first model corrects the transcription and a second, independent model evaluates that correction. This paper provides detailed insights into the methodology, experimental results, and implications for future NLP dataset releases in Swiss German. 2 Related Work In the past years, several initiatives Plüss et al. 2021 ; Plüss et al. 2022 ; Plüss et al. 2023 ; Dogan-Schönberger et al. 2021 made valuable contributions for the development of Swiss German ASR solutions; an overview of the released datasets is shown in Figure 1 . However, these datasets are all at sentence level which typically does not improve ASR solutions for real-world situations Timmel et al. 2024 . Additionally, not all existing datasets can be used for commercial purposes. Figure 1: Overview of Swiss German speech to German text datasets. Usage of SPC is possible under MIT license, SDS-200 and STT4SG-350 under SwissNLP license. SwissDial can be used exclusively for research purposes. 3 Transcription with Whisper Large-v3 The starting point for the construction of the SPC_R Corpus is 801 hours of long-form audio from parliament debates of Grosser Rat Kanton Bern which we transcribe with Whisper Large-v3. Our transcription pipeline uses Whisper Large - v3 via WhisperX Bain et al. 2023 under high - compute settings, namely beam_size set to 10, best_of set to 10, and log_prob_threshold set to –2. All transcriptions are performed on an NVIDIA A4500 GPU with 20 GB of VRAM, using float16 precision and a batch_size of 8. These high - compute settings further improve results, as shown in Figure 5 . For all transcribed parliament sessions, we store Whisper’s avg_log_prob output, which reflects the model’s prediction confidence and exhibits strong predictive power for transcription quality, as described in Subsection 3.1 . 3.1 BLEU Prediction We observed a linear relationship between the confidence metric calculated by Whisper Kim 2023 , as presented in Equation 1 , and the BLEU score (sacreBLEU 1 1 1 https://github.com/mjpost/sacreBLEU (default settings: 4-gram, standard tokenization and smoothing) , more precisely) of datasets transcribed with Whisper. \displaystyle\text{confidence} \displaystyle=\exp\!\left(\frac{1}{N}\sum_{i=1}^{N}p_{i}\right) (1) The confidence is derived from Whisper’s segment-specific average log-probabilities avg_log_prob , which are averaged over the whole audio file. In Equation ( 1 ), p_{i} denotes the average log-probability for the i th segment, and N is the total number of segments in the entire audio file, where a segment is the text between two timestamps predicted by Whisper. Thus, the confidence is the exponential of the average avg_log_prob over a whole audio file. Figure 2: Linear relationship between BLEU score vs. Whisper confidence score for ten long-form conversations, represented by numbers 1-10. The blue shaded area represents the 95% confidence interval. Figure 2 shows this linear relationship between the BLEU score (calculated between the transcription and a manually created ground truth) and the confidence on ten distinct, independent Swiss German datasets. Each dataset of approximately one hour (ca. 8’000 tokens) consists of manually transcribed Swiss German conversations (the ground truth) between two or more speakers (these datasets cannot be disclosed due to data privacy and NDA restrictions). Our analysis shows that higher confidence values are associated with higher BLEU scores in a near-linear fashion, indicating that the confidence metric is a strong predictor of transcription quality, suggesting its potential for assessing transcription performance. A linear regression fitted to these data produced an intercept of -0.68 and a slope coefficient of 1.59 and allows to predict a BLEU score based solely on the confidence, called the Predicted BLEU, without first creating a ground truth. Figure 3 shows the distribution of Predicted BLEU scores for all 131’291 segments of SPC_R, corresponding to a total of 801 hours of audio. Figure 3: Distribution of Predicted BLEU scores across SPC_R ( N = 131’291 data segments). Figure 4 shows the cumulative proportion of data samples for a given Predicted BLEU score threshold. As the threshold rises, fewer samples qualify, underscoring the