Dynamical model parameters from ultrasound tongue kinematics

Sam Kirkham, Patrycja Strycharczuk · 2025

Read Dynamical model parameters from ultrasound tongue kinematics by Sam Kirkham, Patrycja Strycharczuk (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-18629.txt.

Introduction

Sam Kirkham and Patrycja Strycharczuk ask whether ultrasound images of the tongue can stand in for a more cumbersome speech measurement. Speech scientists model the tongue and jaw as a driven spring-like system moving toward targets, and they usually fit those models with electromagnetic sensors glued to the tongue, a setup called articulography. Ultrasound is easier to use, but its model parameters had not been checked against the sensor standard.

Recording both methods at the same time, the authors found that ultrasound produced dynamical parameters comparable to the sensor data, so the fitted spring constants and related values agreed across methods. A short-tendon tracking approach for the jaw also captured jaw motion adequately. The results support using ultrasound tongue imaging to test models of speech control, which could make such studies cheaper and more comfortable for participants.

Catalog record

CREATORSam Kirkham, Patrycja Strycharczuk
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE25 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2510-18629

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Dynamical model parameters from ultrasound tongue kinematics Sam Kirkham, Patrycja Strycharczuk Abstract The control of speech can be modelled as a dynamical system in which articulators are driven toward target positions. These models are typically evaluated using fleshpoint data, such as electromagnetic articulography (EMA), but recent methodological advances make ultrasound imaging a promising alternative. We evaluate whether the parameters of a linear harmonic oscillator can be reliably estimated from ultrasound tongue kinematics and compare these with parameters estimated from simultaneously-recorded EMA data. We find that ultrasound and EMA yield comparable dynamical parameters, while mandibular short tendon tracking also adequately captures jaw motion. This supports using ultrasound kinematics to evaluate dynamical articulatory models. I Introduction A major goal in the study of speech communication is understanding the nature of articulatory control. A common approach is to cast this problem in terms of a dynamical system with point attractor dynamics, where a small number of parameters drive the vocal tract to a stable equilibrium position Fowler 1980 ; Saltzman and Munhall 1989 ; Browman and Goldstein 1986 ; Gafos 2006 ; Tilsen 2016 . A standard model in this framework is the linear harmonic oscillator, m\ddot{x}+b\dot{x}+kx=0 (1) where m is mass (typically m=1 ), k is a stiffness coefficient, and b is a damping coefficient, usually set to critically damped b=2\sqrt{mk} . Gestural activation can be governed by step activation, with gestural parameters changing instantaneously at the point of activation and remaining constant over the activation interval. In this study we focus on whether the parameters of a linear harmonic oscillator can be estimated from ultrasound tongue imaging data, which we compare with the more common method of fitting to electromagnetic articulography (EMA) data. A major barrier to this goal is that the linear harmonic oscillator is known to be a poor fit to empirical articulatory trajectories, as it predicts overly short time-to-peak velocity, meaning that it is inappropriate for evaluating how the model can fit different data modalities. There are three common solutions to this issue. The first allows gestural activation to vary over time Byrd and Saltzman 1998 , which adds extrinsic complexity to the model. The second is a nonlinear model, such as adding a cubic term to the linear model Sorensen and Gafos 2016 ; Kirkham 2025b , or novel nonlinear models ( Stern and Shaw 2025 ) . The third is to abandon oscillatory models and develop new time-dependent (i.e. non-autonomous) models ( Elie et al. 2023 ) . All three approaches add significant complexity, but we take an alternative route, which is to retain the simple linear oscillator with step activation, but simply relax the critical damping constraint. This allows for a simple autonomous model that is generally more accurate than critically damped models Kirkham 2024 ; Kirkham 2025a . We note that all of the above models focus only on piecewise dynamics, such as the movement between articulatory targets, so our decision to relax critical damping only adds a small level of complexity compared with nonlinear or non-autonomous models. An important aspect of adjudicating between different models is evaluating their fit to empirical data, which allows us to establish prospective parameters for articulatory control. In other words: given an empirical articulatory trajectory, which model parameter values would be required to reproduce its dynamics? To date, the majority of dynamical articulatory model development has focused on fleshpoint tracking data, such as X-ray microbeam and EMA Iskarous 2016 ; Elie et al. 2023 ; Kirkham 2025a ; Stern and Shaw 2025 , with some applications to MRI data Lammert et al. 2013 . Such data has a number of shortcomings, including limited information on the tongue posterior (EMA), invasive data collection (EMA, MRI), and limited portability (EMA, MRI). Ultrasound imaging largely overcomes these issues and provides good imaging of the tongue, as well as hyoid and mandibular short tendon Wrench and Balch-Tomes 2022 , but suffers from lower frame rates and noisy images. Despite this, recent advances suggest it is possible to derive kinematics from ultrasound, either via tracking manually-identified fanlines Strycharczuk and Scobbie 2015 or anatomically-defined landmarks using deep learning Wrench and Balch-Tomes 2022 . For example, Wrench and Balch-Tomes 2022 trained a deep learning model on human-labelled data, where anatomically-defined landmarks were placed along the tongue. The accuracy of landmarking was comparable to between-human differences, allowing for automated frame-to-frame tracking of fleshpoint-like trajectory data, which also showed reasonable agreement with EMA. The above suggests that ultrasound is a candidate for estimating dynamical model parameters from data. This would be a substantial step forwards for evaluating dynamical models, as ultrasound is cheaper, less invasive, and provides richer information about lingual motion. It stands to reason that being able to accurately estimate dynamical parameters from ultrasound would open up a new range of applications for fieldwork and clinical data, which would facilitate model evaluation across more diverse samples and languages. In this study, we compare task dynamic parameters derived from simultaneous EMA and ultrasound data during vowel production. We focus on estimating the parameters of an undamped linear harmonic oscillator (i.e. Equation 1 but without the critical damping constraint). We use this model because it is simple and has known characteristics, which makes it an attractive case study for comparing model parameters estimated from ultrasound and EMA data. We expect that the same principles should apply to more complex models, but we use the simple model to establish a straightforward comparison without too many degrees-of-freedom. II Methods II.1 Speakers and stimuli The data set comprises simultaneous electromagnetic articulography and ultrasound tongue imaging data, which was recorded concurrently from six female speakers of Northern Anglo British English. The materials comprised the full set of British English vowels in /bV/ and /bVd/ contexts in two carrier phrases: She said X and She said X eagerly . Each speaker produced four repetitions of 29 words in two carrier phrases, except for one speaker who produced five repetitions. We excluded some blocks from two speakers due to excessive ultrasound probe movement. In total, we analyse 1095 tokens. II.2 Instrumentation EMA data were recorded using a Carstens AG501, with sensors placed on the tongue tip, tongue mid, tongue dorsum, upper/lower lip and lower teeth, with reference sensors located on the maxilla, nasion, and mastoids. The EMA data were recorded at 1250 Hz, filtered using a 50 Hz low-pass Kaiser-windowed filter (5 Hz for reference sensors), head corrected, and rotated to the occlusal plane. Ultrasound data were recorded in Articulate Assistant Advanced Wrench 2022 at \sim 81 Hz using a Telemed MicrUS scanner with a 20-mm radius, 64-element, 2-MHz probe. The ultrasound probe was stabilised using a headset Spreafico et al. 2018 . Audio was recorded at 48 kHz using a Beyerdynamic Opus 55 microphone and pre-amplified using a Grace Designs m101 preamplifier. Audio, EMA and ultrasound data were time synchronized by aligning a TTL pulse that was triggered at the time of each prompt presentation and recorded onto each system. For further details of temporal synchronization and analysis of probe motion see Kirkham et al. 2023 . II.3 Data processing Acoustic data were forced-aligned using Montreal Forced Aligner McAuliffe et al. 2017 and subsequently hand-corrected, which was used to segment the articulatory

Read the complete text