VoxKnesset: A Large-Scale Longitudinal Hebrew Speech Dataset for Aging Speaker Modeling
Yanir, Arad, David, Adam, Yoad, Yair, Eran · 2026
Read VoxKnesset: A Large-Scale Longitudinal Hebrew Speech Dataset for Aging Speaker Modeling by Yanir, Arad, David, Adam, Yoad, Yair, Eran (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-01270.txt.
Introduction
Marmor and six colleagues release VoxKnesset, an open dataset of about 2,300 hours of Hebrew parliamentary speech from 2009 to 2025 covering 393 speakers with spans up to 15 years. Aligned transcripts and verified demographics support rigorous longitudinal study of aging voices. Benchmarks show speaker-verification error more than doubles over 15 years for the strongest model, cross-sectional age models miss within-speaker aging, and longitudinal training recovers a real temporal signal, aiding aging-robust speech systems.
Catalog record
| CREATOR | Yanir, Arad, David, Adam, Yoad, Yair, Eran |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 16805 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.01270
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
VoxKnesset: A Large-Scale Longitudinal Hebrew Speech Dataset for Aging Speaker Modeling Yanir, Arad, David, Adam, Yoad, Yair, Eran Abstract Speech processing systems face a fundamental challenge: the human voice changes with age, yet few datasets support rigorous longitudinal evaluation. We introduce VoxKnesset, an open-access dataset of 2,300 hours of Hebrew parliamentary speech spanning 2009–2025, comprising 393 speakers with recording spans of up to 15 years. Each segment includes aligned transcripts and verified demographic metadata from official parliamentary records. We benchmark modern speech embeddings (WavLM-Large, ECAPA-TDNN, Wav2Vec2-XLSR-1B) on age prediction and speaker verification under longitudinal conditions. Speaker verification EER rises from 2.15% to 4.58% over 15 years for the strongest model, and cross-sectionally trained age regressors fail to capture within-speaker aging, while longitudinally trained models recover a meaningful temporal signal. We publicly release the dataset and pipeline to support aging-robust speech systems and Hebrew speech processing. Marmor Zulti Krongauz Gabet Snapir Lifshitz Segal keywords longitudinal speech dataset, aging speaker modeling, multilingual speech processing, under-resourced speech corpus, Hebrew speech † † address: 1 Department of Computer Science and Applied Mathematics, Department of Molecular Cell Biology, Weizmann Institute of Science, Rehovot, Israel 2 ivrit.ai † † email: [email protected] 1 Introduction From biometric security to automated transcription to health diagnostics, speech processing systems now underpin critical infrastructure across domains — making their vulnerability to the slow, inevitable drift of vocal aging a problem that can no longer be ignored [ 26 , 28 , 15 , 40 , 21 ] . Natural aging of the vocal folds and vocal tract induces continuous physiological changes that alter acoustic and prosodic patterns over time [ 13 , 22 , 38 , 46 , 37 ] , degrading speaker verification reliability [ 24 , 18 ] and challenging models that rely on stable vocal characteristics, including a growing line of work on automatic age estimation from speech [ 27 , 35 , 5 , 7 , 2 , 43 , 30 ] . Figure 1 : VoxKnesset pairs single-speaker speech segments with aligned transcripts and verified demographic labels across 16 years of parliamentary recordings. Despite these well-recognized challenges, dataset development has not kept pace. Traditional benchmarks such as TIMIT [ 19 ] provide high-quality recordings with reliable demographic labels but are cross-sectional, capturing each speaker only once. Longitudinal corpora such as CSLU [ 12 ] , TCDSA [ 27 ] , MARP [ 31 ] , and Greybeard [ 6 ] track speakers over time but at the cost of scale, covering small cohorts too sparse for modern deep-learning methods. Large-scale in-the-wild collections such as VoxCeleb2 [ 11 ] , even when enriched with estimated age labels (AgeVoxCeleb [ 41 ] ), offer acoustic diversity and scale but were not designed to capture longitudinal vocal change. Recent efforts such as HPP Voice [ 29 ] , a large Hebrew-speaker cohort with verified clinical metadata, represent progress on label quality and scale, yet with recordings separated by approximately two years, temporal resolution remains limited. The result is a trilemma: no existing resource simultaneously provides (1) dense, repeated recordings of the same speakers spanning many years, (2) sufficient scale and diversity for contemporary models, and (3) trustworthy ground-truth labels. Figure 2 : Longitudinal coverage in VoxKnesset by sex. Bars show the age range per recording year; white markers indicate median age; color intensity reflects the number of unique speakers (annotated). A recent effort to close this gap is VoxAging [ 1 ] , which provides web-sourced recordings spanning up to 17 years and uses them to benchmark speaker verification under aging conditions. Yet VoxAging also highlights a persistent tension in web-sourced longitudinal data: the difficulty of obtaining verified age labels at scale. In lieu of ground-truth metadata, VoxAging assigns age groups using facial age-recognition algorithms — a practical choice that nonetheless introduces label noise from the recognition model and complicates interpretation of downstream benchmarks, which may partly reflect labeling errors rather than true physiological aging. This underscores the need for longitudinal speech resources grounded in verified, independently sourced demographic metadata, a need the present work directly addresses. We introduce VoxKnesset, an open-access longitudinal speech dataset derived from 16 years of Israeli parliamentary (Knesset) plenary recordings spanning 2009 to 2025. Parliamentary proceedings offer a unique combination of properties for longitudinal speech research: a consistent, semi-controlled acoustic environment, a large and rotating cast of identified speakers, and rich administrative records that supply verified demographic metadata. VoxKnesset joins a growing family of parliamentary speech resources [ 17 , 16 , 32 , 45 , 44 ] and is designed explicitly for longitudinal speaker and age analysis. The dataset pairs around 2,300 hours of speaker-attributed speech from 393 Members of Knesset (MKs) with verified ground-truth labels, including age, gender, country of origin, and religion. It aligns each segment with official human-verified session protocols. Many speakers appear repeatedly across multiple parliamentary terms, with time spans of up to 15 years between recordings of the same individual. The dataset is in Hebrew, which is a morphologically rich language that remains relatively underserved in open-access speech data [ 23 ] despite the recent expansion of dedicated resources [ 34 , 42 , 39 , 33 ] . This scarcity makes VoxKnesset a valuable contribution to the broader Hebrew speech processing community in addition to its primary longitudinal focus. We use this resource to make three contributions: 1. Dataset Release: We publicly release VoxKnesset, the first large-scale longitudinal Hebrew speech dataset with verified demographic labels and high-quality aligned transcripts. 2. Longitudinal Benchmarking: We evaluate modern speech embeddings such as ECAPA-TDNN [ 14 ] , Wav2Vec2-XLSR-1B [ 4 , 3 ] , and WavLM [ 8 ] on both age prediction and speaker verification. Specifically, we quantify how performance degrades as the enrollment–test time gap increases. 3. Cross-Dataset Age Prediction: We evaluate age prediction across TIMIT, HPP-Voice, AgeVoxCeleb, and VoxKnesset using modern speech embeddings, showing that VoxKnesset yields results consistent with established benchmarks while introducing cross-lingual and longitudinal dimensions previously unavailable. 2 Dataset Figure 3 : Data curation pipeline: from raw parliamentary recordings to the speaker-attributed longitudinal subset. Figure 4 : Age distributions across commonly used speech datasets, illustrating differences in demographic coverage. 2.1 Full Corpus The dataset is derived from official plenary recordings and transcripts of the Israeli Knesset spanning sixteen years (March 2009 – February 2025), comprising approximately 8,825 hours across roughly 1,550 plenary sessions. Raw parliamentary data pairs audiovisual recordings with timestamped protocol documents; however, these are not directly usable for speech modeling due to timestamp inconsistencies and transcript normalization artifacts. We implemented a multi-stage alignment pipeline. Audio was extracted from A/V files at 16 kHz mono; timestamps were corrected for backward jumps and drift; and word-level forced alignment was performed using Whisper [ 36 ] and a Hebrew-adapted variant, following the recovery strategy of Stable-Whisper [ 25 ] . Each word was assigned an alignment confidence score, and segment-level quality was computed as the median of the word probabilities. The corpus reflects real-world parliamentary conditions, including overlapping speech, audience noise, and non-verbatim transcription. Confidence scores are provided so researchers can apply quality thresholds appropriate for their task. The full pipeline and processing code are publicly available. 1 1 1 Anonymous link 2.2 Speaker-Attributed Longitudinal