Random Controlled Differential Equations
Francesco Piatti, Thomas Cass, William F. Turner · 2025
Read Random Controlled Differential Equations by Francesco Piatti, Thomas Cass, William F. Turner (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-23670.txt.
Introduction
Francesco Piatti, Thomas Cass, and William Turner build time-series models from randomly wired continuous-time reservoirs. Their base tool is the controlled differential equation, which lets a hidden state evolve in response to an incoming signal path. Instead of training the whole system, they randomize a large reservoir's parameters and train only a linear readout layer on top, making learning fast and scalable.
Two variants follow. Random Fourier CDEs first lift the input with random Fourier features; Random Rough DEs work directly on rough paths through a log-ODE scheme using log-signatures. In the infinite-width limit the two recover, respectively, an RBF-lifted signature kernel and the rough signature kernel, tying random features to path-signature theory. Across time-series benchmarks both models matched or beat the state of the art.
Catalog record
| CREATOR | Francesco Piatti, Thomas Cass, William F. Turner |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 92 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-23670
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Random Controlled Differential Equations Francesco Piatti, Thomas Cass, William F. Turner Abstract We introduce a training-efficient framework for time-series learning that combines random features with controlled differential equations (CDEs). In this approach, large randomly parameterized CDEs act as continuous-time reservoirs, mapping input paths to rich representations. Only a linear readout layer is trained, resulting in fast, scalable models with strong inductive bias. Building on this foundation, we propose two variants: (i) Random Fourier CDEs (RF-CDEs): these lift the input signal using random Fourier features prior to the dynamics, providing a kernel-free approximation of RBF-enhanced sequence models; (ii) Random Rough DEs (R-RDEs): these operate directly on rough-path inputs via a log-ODE discretisation, using log-signatures to capture higher-order temporal interactions while remaining stable and efficient. We prove that in the infinite-width limit, these model induces the RBF-lifted signature kernel and the rough signature kernel, respectively, offering a unified perspective on random-feature reservoirs, continuous-time deep architectures, and path-signature theory. We evaluate both models across a range of time-series benchmarks, demonstrating competitive or state-of-the-art performance. These methods provide a practical alternative to explicit signature computations, retaining their inductive bias while benefiting from the efficiency of random features. Code is publicly available at: https://github.com/FrancescoPiatti/RandomSigJax 1 Introduction Controlled differential equations (CDEs) generalize ordinary differential equations by allowing dynamics to be driven by an exogenous path x:[0,T]\to\mathbb{R}^{d} rather than by time alone. This viewpoint has become central to modern time-series learning: it underlies the continuous-depth limit of residual networks ( 6 ) , connects naturally to deep state-space models and sequence models with long context ( 31 ; 12 ) , and yields the neural CDE paradigm in which the vector field is represented by a neural network and learned from data ( 18 ; 17 ) . Beyond modelling, CDEs provide a clean analytical lens for studying expressivity and invariances of sequence models. A complementary analytic tool for path-valued data is the signature of a path, i.e., the sequence of iterated integrals that linearizes CDE solution maps in the tensor algebra ( 23 ) . Signatures also induce powerful kernels on path space with universality and stability guarantees. In practice, however, signature features and signature kernels can be computationally demanding at high truncation levels, motivating approximations and random features. Reservoir computing offers an appealing alternative: use a large, randomly initialized dynamical system to produce rich features of the input, and train only a linear readout ( 22 ) . This training-light approach scales well and often works competitively. Yet, principled reservoirs for path data that come with nontrivial statistical or kernel limits – and that retain the continuous-time structure of CDEs – are less developed. 1.1 Related Literature A growing body of research has drawn connections between random neural networks and kernel methods. Early works demonstrated that infinitely wide neural networks converge to Gaussian processes ( 27 ; 37 ) . This idea was later extended to deep networks and their training dynamics: in the infinite-width limit, gradient descent on a network is equivalent to kernel regression with the so-called Neural Tangent Kernel ( 15 ) . In parallel, random feature models were introduced to approximate kernel maps with random projections ( 29 ; 30 ) . For example, random Fourier features approximate shift-invariant kernels with a linear readout, while Extreme Learning Machines fix hidden weights and train only the output layer, achieving universal approximation under standard conditions on the activation and sufficient width ( 14 ) . These insights inspire reservoir computing, which leverages large random dynamical systems as feature extractors ( 25 ; 16 ) . This approach scales well and has demonstrated strong performance in time-series forecasting and classification tasks. For sequence data, the path signature provides an expressive feature map with strong guarantees ( 23 ) , spawning a body of work on signature features and signature kernels in learning and statistics ( 5 ; 7 ; 33 ; 36 ) . A key advance is the PDE/Volterra characterisation and scalable computation of the untruncated signature kernel ( 32 ) , with recent numerical refinements ( 2 ) and applications across regression, classification, and Bayesian inference ( 20 ; 21 ) . Randomized signatures compress path information by sampling random linear functionals of the (log-)signature coordinates. Discrete-time constructions with approximation and concentration guarantees were developed by 9 , their practical efficacy as reservoirs for learning rough dynamics has been demonstrated in 8 , while universal approximation on path space via finite mixtures of randomized signature features was established by 1 . Of particular relevance, 35 propose Random Fourier Signature Features (RFSF): the input path is first lifted pointwise into a RBF reproducing kernel Hilbert space via random Fourier features and the signature transform is then approximated in that feature space. We adopt RFSF as a strong baseline and point of comparison for our random differential equation-based reservoirs. 1.2 Contributions In this work, we bridge these viewpoints by developing random feature models for path-valued data that leverage the continuous-time dynamics of CDEs. Our contributions can be summarized as follows: • Models. We propose two architectures: (i) RF-CDE , which lifts inputs with random Fourier features and then evolves them through a random CDE; and (ii) R-RDE , which operates directly on geometric rough paths via a log-ODE discretization that uses log-signatures to capture higher-order temporal interactions. • Theory. We prove infinite-width limits: RF-CDE converges to the RBF-lifted signature kernel, and R-RDE converges to the rough signature kernel; in both cases, the limiting feature maps induce Gaussian–process priors over path-functionals via the standard kernel–GP correspondence. • Efficiency. At finite width, both models require training only a linear readout, yielding fast, scalable pipelines in the spirit of reservoir computing. We provide a user-friendly, optimized JAX implementation, RandomSigJax . • Experiments. Across time-series benchmarks, our models are competitive with – or surpass – baselines, including Random Fourier Signature Features. 2 Mathematical Background We use the following notation throughout: • V and W denote Banach spaces. • \Delta_{T}:=\{(s,t)\in[0,T]^{2}:0\leq s\leq t\leq T\} is the (time) two–simplex. • M_{N}(\mathbb{R}) is the set of N\times N real matrices. • \xi_{N} is the Gaussian measure of matrices in M_{N}({\mathbb{R}}) : if the random matrix A\sim\xi_{N} then its entries A_{ij} are i.i.d. according to a standard normal distribution. • C^{1}(J;V) is the space of continuously differentiable paths from J\subset\mathbb{R}^{+} into V . 2.1 Controlled Differential Equations Controlled differential equations (CDEs) describe dynamics driven by a path x:[0,T]\to\mathbb{R}^{d} rather than by time alone: Z_{t}\;=\;z_{0}\;+\;\sum_{i=1}^{d}\int_{0}^{t}f_{i}\big(Z_{s}\big)\,dx_{s}^{\,i},\qquad f_{i}:W\to W. (1) They capture how a system Z_{t}\in W reacts to an external control x , and sit at the heart of continuous-time sequence models. The main subtlety is how to define the integrals in Eq. 1 . If x has bounded variation – i.e. finite total variation, equivalently finite 1 -variation (Definition A.1 in Appendix A ) – the integrals are classical Riemann-Stieltjes integrals and the CDE is well-posed under standard Lipschitz conditions on f_{i} . If x is rougher but has finite p -variation with p<2 , Young integration applies and Eq. 1 still makes sense provided the vector fields are sufficiently regular. Beyond this threshold ( p\geq 2 ), pathwise Riemann–Stieltjes/Young integrals break down; we handle this regime by lifting x to a (geometric) rough