Fotheidil: an Automatic Transcription System for the Irish Language

Liam Lonergan, Ibon Saratxaga, John Sloan, Oscar Maharog, Mengjie Qian, Neasa Ní Chiaráin, Christer Gobl, Ailbhe Ní Chasaide · 2025

Read Fotheidil: an Automatic Transcription System for the Irish Language by Liam Lonergan, Ibon Saratxaga, John Sloan, Oscar Maharog, Mengjie Qian, Neasa Ní Chiaráin, Christer Gobl, Ailbhe Ní Chasaide (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-00509.txt.

Introduction

Liam Lonergan and seven co-authors present in 2024 Fotheidil, the first web-based automatic transcription system for the Irish language. Irish lacks the data wealth of major languages, so the system blends ready-made voice detection and speaker labeling with models trained specially for Irish. Semi-supervised learning stretched the acoustic model's reach to dialects thin in the training set.

A sequence-to-sequence approach to capitals and punctuation beat the usual classification method. The service will be free to the public under the ABAIR initiative. Transcripts corrected by users flow back into training, so the system improves with use. For a minority language, such community-fed tools can decide whether speech technology arrives at all.

Catalog record

CREATORLiam Lonergan, Ibon Saratxaga, John Sloan, Oscar Maharog, Mengjie Qian, Neasa Ní Chiaráin, Christer Gobl, Ailbhe Ní Chasaide
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE33 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-00509

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Fotheidil: an Automatic Transcription System for the Irish Language Liam Lonergan, Ibon Saratxaga, John Sloan, Oscar Maharog, Mengjie Qian, Neasa Ní Chiaráin, Christer Gobl, Ailbhe Ní Chasaide Abstract This paper sets out the first web-based transcription system for the Irish language - Fotheidil, a system that utilises speech-related AI technologies as part of the ABAIR initiative. The system includes both off-the-shelf pre-trained voice activity detection and speaker diarisation models and models trained specifically for Irish automatic speech recognition and capitalisation and punctuation restoration. Semi-supervised learning is explored to improve the acoustic model of a modular TDNN-HMM ASR system, yielding substantial improvements for out-of-domain test sets and dialects that are underrepresented in the supervised training set. A novel approach to capitalisation and punctuation restoration involving sequence-to-sequence models is compared with the conventional approach using a classification model. Experimental results show here also substantial improvements in performance. The system will be made freely available for public use, and represents an important resource to researchers and others who transcribe Irish language materials. Human-corrected transcriptions will be collected and included in the training dataset as the system is used, which should lead to incremental improvements to the ASR model in a cyclical, community-driven fashion. 1 Introduction Artificial intelligence (AI) has become a pervasive part of today’s world. While AI undoubtedly brings many benefits, these benefits are felt primarily by speaker communities of the world’s major languages. Speakers of minority languages have not been adequately serviced with technology that works for them and is appropriate for their needs. Automatic speech recognition (ASR), the process of automatically transcribing speech into text, is a prime example of this disparity. While modern systems for English or Chinese approximate, or even improve upon, the performance of human transcription, for most languages Speech-to-Text does not exist. One of the largest barriers to developing ASR systems for minority languages is a lack of large, transcribed speech corpora. Recently, approaches leveraging large unlabelled speech corpora, such as semi-supervised learning Zhang et al. 2020 ; Radford et al. 2023 and self-supervised learning Baevski et al. 2020 have achieved state-of-the-art performance for common ASR benchmarks, and were beneficial for low-resource languages DeHaven and Billa 2022 . Speech-to-Text integrated technologies like automatic closed captioning on platforms such as YouTube and TikTok have been widely adopted by users of major languages. However, lesser-resourced languages are not included in such services. In light of this gap, we present Fotheidil 1 1 1 https://fotheidil.abair.ie - a freely available web-based transcription system for the Irish language that utilises various speech-related AI components to transcribe long audio and video files. The structure of the paper is as follows: Section 2 outlines relevant background information; Section 3 details the system Interface; and section 4 describes the transcription pipeline, and the experiments carried out to improve Irish ASR performance using semi-supervised learning (SSL), as well as experiments carried out to train a Capitalisation and Punctuation Restoration (C&PR) model, which improves the legibility of the ASR outputs for the end-user; and finally, Section 5 contains the discussion and conclusions. 2 Background 2.1 Irish language Irish, a Goidelic or Gaelic language, is a member of the Celtic branch of the Indo-European language family. Today, the Gaelic languages are spoken in small communities scattered mostly along the western seaboard of Ireland and the western islands of Scotland. The almost extinct Manx, which is currently being revived, is also a Goidelic language and is spoken on the Isle of Man. The Irish language is highly inflected and has a complex phonological system. The language is diverse in its dialects and accents, with three regional dialects of Ulster (Ul), Connaught (Co) and Munster (Mu) and further sub-dialects, as well as the accents of non-native speakers i.e., learners and new speakers (Nn). The dialects vary significantly in terms of pronunciation, vocabulary and grammar and the phonology and syntactic structure of non-native speakers can often approximate that of English. Speaker variety is used here to describe the dialect or accent of a speaker. 2.2 ABAIR The ABAIR initiative has been developing speech technology and applications to close the technology gap for the Irish language. Synthetic voices for the 3 major dialects of the languages of Ulster (Ul), Connacht (Co) and Munster (Mu) have been developed, with plans to expand this to further sub-dialects. Additionally, speech recognition systems for Irish have been developed with a sociolinguistic focus, by ensuring that we have adequate coverage of the different varieties of the language where possible and by evaluating our systems for their performance on speakers of different varieties. 2.3 Automatic Speech Recognition ASR, the task of converting speech into text, has seen significant progress in recent years, due to advances in deep learning, access to hardware such as graphical processing units (GPU) and the increasing use of very large speech corpora. There are two conventional approaches to ASR - the traditional, modular approach, where the speech-to-text task is broken into the distinct components of acoustic modeling, pronunciation lexicon, and language modeling. The sub-modules are modeled independently and then combined in a decoding graph as a weighted finite-state transducer. In contrast, End-to-End (E2E) systems handle the entire speech-to-text task within a single model, directly learning the mapping from audio to text without the need for separate modules, offering a more streamlined but data-intensive approach. While E2E systems have surpassed modular systems in most performance benchmarks for ASR, the need to use large training corpora makes them less suitable for low-resource languages Lonergan et al. 2024 . 2.3.1 Semi-supervised learning One of the most significant bottlenecks to the development of speech recognition for an under-resourced language is the availability of transcribed audio material to train an ASR system in a supervised manner. However, untranscribed speech is more readily available, due to the increasing proliferation of audio and video materials on the internet. Semi-supervised learning (SSL) is a paradigm that seeks to incorporate large unlabelled datasets in the learning framework to reduce the reliance on a large amount of labelled data. Among various SSL techniques applied to ASR, Noisy Student Teacher training (NST) has gained significant attention, achieving state-of-the-art performances across various datasets Zhang et al. 2020 ; Park et al. 2020 . Moreover, it has improved performance in code-switching ASR Xi et al. 2024 and in low-resource ASR Li and Vu 2024 . Noisy Student Teacher training : in NST training, a teacher model is trained with the available labelled data. This model is used to generate pseudo-labels for the unlabelled dataset, which is combined with the labelled data to create a new training set for the student model. Noise is introduced to the new training set, forcing the student model to learn to reproduce the teacher model’s outputs under noisy conditions, steering the model to learn more robust features that may better match the variability of real use. 2.4 Capitalisation and Punctuation Restoration The output of the ASR system consists of raw text, using just lowercase characters, without punctuation symbols, acronyms or digits. This format is not very suitable in terms of readability and thus an additional processing is needed to restore proper capitalization and punctuation. Typically, capitalisation and punctuation restoration (C&PR) systems are word-level classifiers which implement either two separate classifiers for

Read the complete text