Cross-Corpus and Cross-domain Handwriting Assessment of NeuroDegenerative Diseases via Time-Series-to-Image Conversion
Gabrielle Chavez ‡ \ddagger, Laureano Moro-Velazquez ‡ \ddagger, Ankur Butala ⋆ † \star\dagger, Najim Dehak ‡ \ddagger, Thomas Thebaud ‡ \ddagger · 2025
Read Cross-Corpus and Cross-domain Handwriting Assessment of NeuroDegenerative Diseases via Time-Series-to-Image Conversion by Gabrielle Chavez ‡ \ddagger, Laureano Moro-Velazquez ‡ \ddagger, Ankur Butala ⋆ † \star\dagger, Najim Dehak ‡ \ddagger, Thomas Thebaud ‡ \ddagger (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-16474.txt.
Introduction
Handwriting degrades in brain diseases like Parkinson's and Alzheimer's, but detectors trained on one data set often fail on another. Gabrielle Chavez and four co-authors fuse the two faces of handwriting, its time trace and its image, in one classifier built on a pretrained vision network. The joint model reads both signals at once rather than picking one view.
Across time-based and image-based sets, results reached the top tier, with clear gains on clock drawing and spiral tasks. Cross-set tests stayed strong, with detection scores near the top of the scale. One model that travels across clinics would ease screening.
Catalog record
| CREATOR | Gabrielle Chavez ‡ \ddagger, Laureano Moro-Velazquez ‡ \ddagger, Ankur Butala ⋆ † \star\dagger, Najim Dehak ‡ \ddagger, Thomas Thebaud ‡ \ddagger |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 18 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-16474
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Cross-Corpus and Cross-domain Handwriting Assessment of NeuroDegenerative Diseases via Time-Series-to-Image Conversion Gabrielle Chavez ‡ \ddagger, Laureano Moro-Velazquez ‡ \ddagger, Ankur Butala ⋆ † \star\dagger, Najim Dehak ‡ \ddagger, Thomas Thebaud ‡ \ddagger Abstract Handwriting is significantly affected by neurological disorders (ND) such as Parkinson’s disease (PD) and Alzheimer’s disease (AD). Prior works have analyzed handwriting tasks using feature-based approaches or computer-vision techniques, but these methods have struggled to generalize across multiple datasets, particularly between temporal features represented as time-series and images. We propose a framework that leverages both time-series and images of handwriting through a joint classifier, based on a ResNet50 pretrained on ImageNet-1k. Binary classification experiments demonstrate state-of-the-art performances on existing time-series and image datasets, with significant improvement on specific drawing and writing tasks from the NeuroLogical Signals (NLS) dataset. In particular, the proposed model demonstrates improved performance on Draw Clock and Spiral tasks. Additionally, cross-dataset and multi-dataset experiments were consistently able to achieve high F1 scores, up to 98 for PD detection, highlighting the potential of the proposed model to generalize over different forms of handwriting signals, and enhance the detection of motor deficits in ND. † † address: \ddagger Department of Electrical and Computer Engineering, The Johns Hopkins University, Baltimore MD, USA \star Department of Psychiatry and Behavioral Sciences, The Johns Hopkins University, Baltimore MD, USA \dagger Department of Neurology, The Johns Hopkins University, Baltimore MD, USA 1 Introduction Neurodegenerative diseseases (ND) like Parkinson’s disease (PD) and Alzheimer’s Disease (AD) affect both motor and cognitive function [ 1 ] . PD is characterized by motor and non-motor impairments that disrupt daily life. Among the motor symptoms, handwriting is particularly sensitive to subtle changes in motor control, including tremor, bradykinesia, and micrographia, making it a valuable marker of disease progression [ 2 ] . In contrast, AD primarily affects cognitive function, leading to memory loss and difficulty in spatial reasoning [ 3 ] . These impairments also manifest in handwriting through poor spatial organization and diminished motor control [ 4 ] . One widely used handwriting task is the spiral drawing task, which has long been used as a simple clinical tool to capture bradykinesia and tremor [ 5 ] [ 6 ] . With modern digitized tablets, it is now possible to record high-resolution temporal features capturing the kinematics, pressure, and dynamics of handwriting movements. Previous studies [ 7 , 8 , 9 , 10 ] have approached handwriting analysis using either image-based methods, which capture spatial irregularities from static samples, or time-series methods, which extract dynamic features such as velocity, acceleration, and pressure. Image-based approaches have shown strong performance; for example, Razzak et al. [ 7 ] achieved 98% accuracy on HandPD, NewHandPD, and Parkinson’s Drawing datasets using a ResNet50 CNN–SVM framework on all the available tasks. However, such methods often generalize poorly to time-series datasets, achieving only 37.5% accuracy on PaHaW [ 7 ] . Time-series methods, such as those of Gazda et al. [ 11 ] , have improved performance by incorporating mediator datasets and multiple fine-tuned CNNs, but at the cost of additional data requirements and model complexity. In this article, we propose a new framework with a simple and efficient solution: transforming handwriting time-series into image representations and classifying them using the same pretrained ResNet50 feature extractor followed by a multilayer perceptron (MLP), thereby unifying spatial and temporal information within a single joint model. The contributions of this article are the joint modeling of spatial and temporal features using a unique classifier, achieving state-of-the-art performance on the NLS dataset across multiple tasks and demonstrating cross-dataset and multi-dataset generalization. 2 Materials and Methods 2.1 Datasets In this study, we used five datasets: three image-based datasets ( HandPD, NewHandPD, and Parkinson’s Drawing ), two time-series handwriting dataset ( PaHaW and NLS ). The HandPD dataset was collected at Sao Paulo State University at the Faculty of Medicine of Botucatu [ 12 ] . It consists of 92 participants, 74 with PD and 18 control subjects (CTL). Each individual was asked to trace a spiral, meander, or draw circles. The NewHandPD was collected in the same manner as the HandPD dataset, but using a pen with embedded sensors to also capture its tilt and acceleration, and includes 37 people with PD and 35 CTL [ 13 ] . Both the spiral template and spiral tracing were visible in the photo for these datasets. The Parkinson’s Drawing dataset ( ParkD ) [ 14 ] recorded dynamic handwriting from 27 people with PD and 28 CTL drawing spirals via a digital tablet with a paper placed on top. The participants traced an archimedean spiral, but the template was not visible in the photo. The NeuroLogical Signals ( NLS ) dataset was collected at Johns Hopkins Hospital and includes samples from synchronized speech, eye-tracking, and handwriting tasks, from participants diagnosed with various degenerative diseases. In this study, we focus on the handwriting component which consist 13 tasks performed by 35 PD, 42 CTL, and 21 AD [ 9 ] . In this study, we ignore the point tasks (maintaining a pen without touching the tablet), and keep only 10 drawing and writing tasks, which will be easier to represent as images. Those tasks include three free-hand spiral drawing tasks, using the dominant ( SpiralDom ) and non dominant hand (SpiralNonDom), and while talking ( SpiralPaTaKa ), drawing a cube ( CopyCube ), an image ( CopyImage ), or a clock ( DrawClock ), copying a text ( CopyText ), while reading it ( CopyReadText ), writing freely ( FreeWrite ) and solving algebra equations ( Numbers ). The PaHaW dataset was collected using a digital tablet and a spiral template, however only recorded the drawing. The dataset is composed of spirals from 37 PD and 38 CTL [ 15 ] . The total number of samples per category and per dataset is available in Table 1 . Figure 1 includes some examples of spirals obtained from the five datasets. Table 1: Distribution of the different datasets at hand. The \star marker indicates when the dataset included a template in the photo. Dataset Type # Participants # Samples CTL PD AD CTL PD AD ParkD [ 14 ] Images 28 27 - 51 51 - \star HandPD [ 12 ] 18 74 - 72 296 - \star NewHandPD [ 13 ] 35 31 - 140 124 - PaHaW [ 15 ] Time 38 37 - 302 295 - NLS - All tasks [ 9 ] Series 42 35 21 712 526 124 NLS - Spirals [ 9 ] 40 33 20 251 201 54 2.2 Preprocessing Each dataset has been preprocessed according to its modality. For image-based datasets, all images, originally a 1:1 ratio, were linearly compressed to 224\times 224 pixels, scaled the luminosity to 275, and lastly applied a Gaussian blur filter with a radius of 1 to reduce noise and highlight structural patterns. Figure 1: Samples of spirals from each dataset after pre-processing. NLS and PaHaW show the images created from the times series. For time-series datasets, we used the available pressure (P) and the coordinates to construct an 1:1 ratio, 224\times 224 image representation using the Matplotlib package 1 1 1 https://matplotlib.org/ . Each time-series