Semi-parametric Functional Classification via Path Signatures Logistic Regression
Pengcheng Zeng, Siyuan Jiang · 2025
Read Semi-parametric Functional Classification via Path Signatures Logistic Regression by Pengcheng Zeng, Siyuan Jiang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-06637.txt.
Introduction
Pengcheng Zeng and Siyuan Jiang classify curve-shaped data with a self-tuning signature method in a 2025 paper. Modern sensors stream multi-dimensional curves, often with uneven sampling. Older functional logistic models depend heavily on chosen basis shapes and smoothing settings. Signature methods, which summarize a path by its layered integrals, need a truncation order that was picked by guesswork.
Their framework chooses that order from the data, by penalized risk minimization. Theory backs the choice: an optimal order exists, the estimator finds it, and error rates follow. A finite search bound makes the hunt computable, and an error analysis covers irregular sampling. On synthetic and real data, the method beat classic functional classifiers and fixed-order signature rivals. It won on accuracy, robustness, and interpretability together. The authors credit the blend of rough path theory with adaptive complexity control.
Catalog record
| CREATOR | Pengcheng Zeng, Siyuan Jiang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 95 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-06637
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Semi-parametric Functional Classification via Path Signatures Logistic Regression Pengcheng Zeng, Siyuan Jiang Abstract We propose Path Signatures Logistic Regression (PSLR), a semi-parametric framework for classifying vector-valued functional data with scalar covariates. Classical functional logistic regression models rely on linear assumptions and fixed basis expansions, which limit flexibility and degrade performance under irregular sampling. PSLR overcomes these issues by leveraging truncated path signatures to construct a finite-dimensional, basis-free representation that captures nonlinear and cross-channel dependencies. By embedding trajectories as time-augmented paths, PSLR extracts stable, geometry-aware features that are robust to sampling irregularity without requiring a common time grid, while still preserving subject-specific timing patterns. We establish theoretical guarantees for the existence and consistent estimation of the optimal truncation order, along with non-asymptotic risk bounds. Experiments on synthetic and real-world datasets show that PSLR outperforms traditional functional classifiers in accuracy, robustness, and interpretability, particularly under non-uniform sampling schemes. Our results highlight the practical and theoretical benefits of integrating rough path theory into modern functional data analysis. 1 1 footnotetext: † These authors contributed equally. 2 2 footnotetext: * Corresponding author: [email protected] Keywords : Functional Data Analysis, Functional Classification, Path Signatures, Semi-parametric Model, Model Selection 1 Introduction Recent advances in sensing technologies have led to an explosion of multi-dimensional functional data, where each observation is a vector-valued function evolving over a continuous domain such as time, space, or frequency. Unlike univariate functional data, these high-dimensional trajectories capture rich interdependencies across dimensions, offering both opportunities and challenges for statistical learning ( Ramsay and Silverman 2005 ; Horvah and Kokoszka 2012 ) . Functional Data Analysis (FDA) provides a rigorous framework for modeling such data in infinite-dimensional spaces ( Ferraty and Vieu 2006 ; Srivastava and Klassen 2016 ) . However, vector-valued functional data often exhibit complex structures—such as irregular sampling and inter-channel correlations—that demand specialized methodologies beyond conventional FDA tools ( Koner and Staicu 2023 ) . A paradigmatic example arises in the analysis of gait dynamics in Parkinson’s disease (PD), where vertical ground reaction forces (VGRFs) are recorded during walking. These signals, collected via force sensors under each foot, form multi-dimensional functional data that encapsulate critical motor control characteristics. However, such data present formidable modeling challenges due to stride-to-stride variability and inter-sensor correlations. Moreover, scalar covariates—such as age, walking speed, and clinical scores—are often available and play an essential role in predictive tasks, including disease classification and progression modeling. These complexities necessitate a modeling framework that can simultaneously incorporate functional and scalar predictors while being robust to noise and irregular sampling. A standard statistical approach for handling such data is the functional logistic regression model ( Reiss et al. 2017 ; Gertheiss et al. 2024 ) . Given a binary outcome y_{i}\in\{0,1\} , a d -dimensional functional predictor \bm{X}_{i}(t)=(X_{i}^{1}(t),\ldots,X_{i}^{d}(t))^{\top} defined on [0,T] , and a q -dimensional vector of scalar covariates \bm{z}_{i}\in\mathbb{R}^{q} , the model assumes \mathbb{P}(y_{i}=1\mid\bm{X}_{i},\bm{z}_{i})=\sigma\left(\alpha+\sum_{j=1}^{d}\int_{0}^{T}X_{i}^{j}(t)\beta_{j}(t)\,dt+\bm{z}_{i}^{\top}\bm{\gamma}\right), (1) where \sigma(u)=(1+e^{-u})^{-1} denotes the logistic link function, the functional predictors X_{i}^{j}(t) and coefficients \beta_{j}(t) are expanded in a common basis \{\phi_{k}(t)\}_{k=1}^{K} as: X_{i}^{j}(t)=\sum_{k=1}^{K}b^{j}_{ik}\phi_{k}(t),\quad\beta_{j}(t)=\sum_{k=1}^{K}c_{jk}\phi_{k}(t), and \bm{\gamma} represents the vector of scalar coefficients. Model ( 1 ) extends the classical scalar-on-function regression framework ( Ramsay and Dalzell 1991 ) , but suffers from several important limitations. First, it imposes a linearity assumption between each functional predictor X_{i}^{j}(t) and the log-odds of the response y_{i} , which may lead to model misspecification when the true relationship is nonlinear. While generalized additive and index models ( Müller and Stadtmüller 2005 ; Mclean et al. 2014 ; Fan et al. 2015 ) relax this assumption, they often inherit the next two issues. Second, the model exhibits basis selection sensitivity : its reliance on basis expansions makes it vulnerable to mismatched basis choices (e.g., Fourier for non-periodic signals or poorly placed B-spline knots), and can obscure interpretability of coefficient functions \beta_{j}(t) ( Rice and Silverman 1991 ) . Third, it is fragile to irregular sampling , a common feature in functional data. Basis projections assume complete, uniformly sampled trajectories, and their violation leads to biased coefficient estimates ( representation bias ) and potential over-smoothing when interpolation is applied ( imputation dependence ). Finally, Model ( 1 ) neglects cross-component correlations by modeling each functional input additively and independently. Although methods such as multivariate FPCA ( Chiou et al. 2014 ) aim to address this, they rely on joint decomposition and assume perfect temporal alignment, which may be impractical in real-world settings. To overcome these challenges, we propose a semi-parametric model that replaces the linear term in model ( 1 ) with a nonlinear transformation of the functional predictor. Specifically, we assume the existence of a smooth function F such that \mathbb{P}(y_{i}=1\mid\bm{X}_{i},\bm{z}_{i})=\sigma\left(F(\bm{X}_{i})+\bm{z}_{i}^{\top}\bm{\gamma}\right). (2) To model F(\bm{X}_{i}) , we treat the time-augmented signal \widetilde{\bm{X}}_{i}=(\bm{X}_{i},t) as a continuous path and apply the theory of path signatures ( Chen 1957 ; Lyons 1998 ; Friz and Victoir 2010 ) . The path signature is a sequence of algebraic features capturing the geometry of the path. Truncating at order p , we approximate F(\widetilde{\bm{X}}_{i}) as F(\widetilde{\bm{X}}_{i})\approx S_{p}(\widetilde{\bm{X}}_{i})^{\top}\bm{\beta}_{p}, (3) where S_{p}(\cdot) denotes the truncated path signature and \bm{\beta}_{p} is the associated coefficient vector. This approach—termed Path Signatures Logistic Regression (PSLR) —offers several advantages: it eliminates the need for basis selection, inherently captures inter-channel dependencies, and demonstrates robustness to irregular sampling. The truncation order p in PSLR governs model complexity and plays a critical role in balancing approximation accuracy with computational tractability. While signature transforms theoretically require an infinite expansion to fully characterize functional trajectories, practical implementations necessitate finite truncation. The choice of p thus introduces a fundamental trade-off: small values may underfit complex temporal dynamics, whereas large values risk overfitting noise and inflating computational cost due to the exponential growth in feature dimension ( \mathcal{O}(d^{p}) ). In this work, we address the following foundational questions, which remain largely unexplored in the existing literature on path signatures: (Q.1) Does there exist an optimal truncation order p^{*} and corresponding coefficient vector \bm{\beta}^{*}_{p^{*}} that both accurately approximate the functional component F and minimize the population risk? (Q.2) If such a p^{*} exists, can it be consistently estimated in a data-driven manner from finite samples? (Q.3) Can we prove non-asymptotic convergence rates for both the estimator and its corresponding model risk? To our knowledge, these questions have received limited attention, despite the increasing use of path signatures in machine learning and statistical modeling ( Chevyrev and Kormilitzin 2016 ; Fermanian 2021 ) . A related study by Fermanian 2022 investigated truncation order selection in a linear signature regression setting, but without accounting for scalar covariates or semi-parametric structure. A key innovation of our framework lies in its fully data-driven procedure for selecting the truncation order p . Unlike prior applications that heuristically fix p\in\{2,3,4,5,8\} without theoretical support ( Yang et al. 2015 ; Yang et al. 2016 ; Lai et al. 2017 ; Liu et al. 2017 ; Arribas et al. 2018 ) , we propose a penalized empirical risk criterion that adaptively selects p^{*} based on sample complexity and model expressiveness. This approach ensures that the model complexity grows only as needed to capture the intrinsic structure of the data. Our theoretical analysis establishes the existence of an optimal p^{*} and provides finite-sample guarantees for its consistent estimation—addressing a critical