Sonata : A Hybrid World Model for Inertial Kinematics under Clinical Data Scarcity

Blaise Delaney, Salil Patel, Yuji Xing, Dominic Dootson, Karin Sevegnani, Chrystalina Antoniades · 2026

Read Sonata : A Hybrid World Model for Inertial Kinematics under Clinical Data Scarcity by Blaise Delaney, Salil Patel, Yuji Xing, Dominic Dootson, Karin Sevegnani, Chrystalina Antoniades (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-18058.txt.

Introduction

Delaney and five colleagues introduce Sonata, a compact latent world model for six-axis trunk inertial sensing under clinical data scarcity. Clinical cohorts often hold only tens to hundreds of patients, a poor match for web-scale training. Sonata, at 3.77 million parameters, pretrains on nine public datasets covering 739 subjects and 190,000 windows, predicting future state, not rebuilding raw traces. Against a matched autoregressive baseline it shows stronger frozen-probe clinical tests, fall-risk prediction, and cross-cohort transfer, while fitting wearable use.

Catalog record

CREATORBlaise Delaney, Salil Patel, Yuji Xing, Dominic Dootson, Karin Sevegnani, Chrystalina Antoniades
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE83308
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.18058

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Sonata : A Hybrid World Model for Inertial Kinematics under Clinical Data Scarcity Blaise Delaney, Salil Patel, Yuji Xing, Dominic Dootson, Karin Sevegnani, Chrystalina Antoniades Abstract Correspondence: [email protected] Abstract We introduce Sonata , a compact latent world model for six-axis trunk IMU representation learning under clinical data scarcity. Clinical cohorts typically comprise tens to hundreds of patients, making web-scale masked-reconstruction objectives poorly matched to the problem. Sonata is a 3.77 M-parameter hybrid model, pretrained on a harmonised corpus of nine public datasets ( \sim 739 subjects, \sim 190k windows) with a latent world-model objective that predicts future state rather than reconstructing raw sensor traces. In a controlled comparison against a matched autoregressive forecasting baseline (MAE) on the same backbone, Sonata yields consistently stronger frozen-probe clinical discrimination, prospective fall-risk prediction, and cross-cohort transfer across a 14-arm evaluation suite, while producing higher-rank, more structured latent representations. At 3.77 M parameters the model is compatible with on-device wearable inference, offering a step toward general kinematic world models for neurological assessment. 1 Introduction In many clinical domains, the early signatures of disease are encoded in continuous physiological time series long before they surface in a clinic: the cardiac trace that first reveals an arrhythmia, the EEG that anticipates a seizure, the respiratory waveform that marks the onset of decline. In neurology, where dysfunction manifests in the mechanics of movement, this signal is kinematic—and it is accessible, non-invasively, through the body in motion, raising a concrete representation learning problem. The gait patterns that reveal early Parkinson’s disease, or distinguish progressive multiple sclerosis from stable remission, are legible in the raw sensor signal. They are encoded in the amplitude and timing of each footfall, in the rotational dynamics of the trunk through a turn, in the subtle asymmetries that accumulate over a walk. Wearable inertial sensors can capture these patterns continuously, outside the clinic, and without interrupting daily life [ 23 , 35 ] . The biological signal is rich and the measurement problem is tractable. The constraint is elsewhere. Figure 1 : Radar summary of representation quality comparing Sonata against a same-backbone IMU forecasting baseline across six evaluation domains. Values are normalized per axis; higher is better. Sonata is stronger on the clinically oriented mix of discrimination, robustness, and representation-quality probes, while forecasting is stronger on raw-signal reconstruction. Both variants share the same encoder backbone; legend parameter counts refer to total model size including the respective pretraining heads. Clinical instruments in neurology are deployed in studies that span tens to hundreds of patients. This reflects the realities of patient recruitment timescales, regulatory oversight, and the demands of longitudinal monitoring in complex disease populations. Even the most coordinated multicentre efforts operate within these bounds: the Mobilise-D consortium, spanning six disease cohorts and sixteen clinical sites, enrolled on the order of 750 participants over several years. The motivating question is therefore not how to mimic the scale of general-purpose wearables research, but how to learn robust, interpretable representations under strict clinical constraints. While recent large-scale time-series foundation models (TSFMs) [ 12 , 4 , 26 , 25 , 10 ] achieve massive scale through out-of-domain consumer corpora or synthetic data mixtures, transferring these models to healthcare endpoints often compromises reliability. Representations learned from domain-agnostic pretraining—whether on consumer activity corpora or synthetic simulations—need not encode the clinical structure on which interpretable, actionable inference depends; that structure must be built in from the outset through exposure to authentic patient variation. In contrast, pretraining directly on in-domain clinical data—even when limited to hundreds of patients—forces the latent space to organize strictly around authentic physiological variation. When the corpus is small, scale cannot rescue the model, but the resulting representations gain a critical property for clinical deployment: reliability and interpretability grounded in real patient biomechanics. In clinical movement analysis, this translates into a concrete architectural discipline. Every parameter must be allocated to learning the biomechanics underlying neurodegeneration—such as the shuffling hypokinesia of Parkinson’s disease or the axial instability of cerebellar ataxia—rather than memorizing the MEMS noise floor, thermal bias drift, or the arbitrary yaw convention of a clip-on attachment. Capacity in excess of the kinematic degrees of freedom of pathological gait is not merely wasted; it creates degrees of freedom in which sensor artefacts can stabilise as if they were clinically meaningful features. A lightweight architecture is therefore a statistical requirement in this regime, not a deployment convenience. One way to enforce it is to require the model to predict the future kinematic state of the body in a learned latent space, so that the representation is grounded in the dynamics of locomotion rather than the idiosyncrasies of the sensor. This constraint also shapes the choice of sensing modality. Clinical gait assessment with a single wearable requires a sensor that resolves the full kinematic state of trunk motion—both translational and rotational components. A tri-axial accelerometer captures linear acceleration associated with foot-strike impact and gravitational loading, but is insensitive to the angular velocity that governs swing-phase progression, turning mechanics, and postural stabilisation. These are not redundant signals: gait phase identification from accelerometry alone is often insufficient outside controlled laboratory settings [ 24 ] , and many of the signatures most relevant to neurological assessment are rotational in nature. Freezing of gait in Parkinson’s disease is identified from a pathological power surge in the 3–8 Hz band of lumbar acceleration [ 32 , 5 ] , and the loss of rhythmic lower-limb rotation that marks the episode is difficult to distinguish from a voluntary stop without angular velocity data. Longitudinal kinematic features from combined inertial signals predict future fall risk in Parkinson’s disease with AUC exceeding 0.90 at 24 months [ 44 ] , and stride-to-stride variability in gait dynamics is among the strongest predictors of functional decline in ageing populations [ 18 ] . More broadly, the spastic gait of multiple sclerosis, the hypometric shuffling of Parkinson’s disease, and the wide-based veering of cerebellar ataxia each produce distinct rotational trunk signatures that are difficult to differentiate without the gyroscope channel. Six-axis measurement—tri-axial accelerometer fused with tri-axial gyroscope—follows from the biomechanics. Sensor placement deserves the same deliberate treatment. Most clinical protocols and field deployments are constrained to a single unit, so the question of where to place it carries real diagnostic weight. The lower back, at or near the fifth lumbar vertebra, is the placement that returns the most clinical information from one sensor: it lies close to the body’s centre of mass, and trunk acceleration during locomotion provides an accurate proxy for whole-body CoM displacement that is not recoverable from any other single site [ 62 , 30 ] . Chest-mounted sensors introduce respiratory contamination at approximately 0.3 Hz with odd harmonics extending into 1.5–2.5 Hz—precisely the bands that carry gait-cycle information—whereas lumbar signals reflect stride-driven CoM displacement with minimal respiratory confound [ 31 , 37 ] . The difference is clinically material: chest placement degrades the 3–8 Hz freezing band on which closed-loop cueing systems depend, and cerebellar ataxia—fundamentally a disorder of axial coordination—propagates most cleanly through the lumbar sensor, where it is not obscured by upper-body compensatory motion. Mobilise-D’s adoption of lumbar placement across all six disease cohorts and sixteen clinical sites [ 35 ] reflects this field-wide consensus; Sonata

Read the complete text