Adaptive Sensing of Continuous Physical Systems for Machine Learning

Felix Köster, Atsushi Uchida · 2026

Read Adaptive Sensing of Continuous Physical Systems for Machine Learning by Felix Köster, Atsushi Uchida (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-03650.txt.

Introduction

Felix Köster and Atsushi Uchida treat a physical system as a computer and learn where to read it. Dynamical systems preserve, transform, and scatter information as they evolve. Their 2026 framework learns not only from a system's data but how to measure the system itself. A trainable attention module decides both where to probe the state and how to combine the readings for the best prediction.

The demonstration system is a spatiotemporal field governed by a partial differential equation, though any samplable state qualifies. Adaptive spatial sensing improves prediction accuracy significantly on canonical chaotic benchmarks. The authors frame attention-enhanced reservoir computing, a known technique, as one special case of the broader paradigm. Their closing image is memorable: neural networks as trainable measurement devices for physical systems.

Catalog record

CREATORFelix Köster, Atsushi Uchida
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE44564
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.03650

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Adaptive Sensing of Continuous Physical Systems for Machine Learning Felix Köster, Atsushi Uchida Abstract Physical dynamical systems can be viewed as natural information processors: their systems preserve, transform, and disperse input information. This perspective motivates learning not only from data generated by such systems, but also how to measure them in a way that extracts the most useful information for a given task. We propose a general computing framework for adaptive information extraction from dynamical systems, in which a trainable attention module learns both where to probe the system state and how to combine these measurements to optimize prediction performance. As a concrete instantiation, we implement this idea using a spatiotemporal field governed by a partial differential equation as the underlying dynamics, though the framework applies equally to any system whose state can be sampled. Our results show that adaptive spatial sensing significantly improves prediction accuracy on canonical chaotic benchmarks. This work provides a perspective on attention-enhanced reservoir computing as a special case of a broader paradigm: neural networks as trainable measurement devices for extracting information from physical dynamical systems. ] 1 Introduction Input \mathbf{x}_{n} Continuous reservoir u(\mathbf{x},t) Sampling & projection \tilde{r}_{t}^{(j)}=\!\displaystyle\int\psi_{t}^{(j)}(\mathbf{x})\,u(\mathbf{x},t)\,d\mathbf{x} r_{t+T}^{(i)}=\!\displaystyle\int\phi_{t+T}^{(i)}(\mathbf{x})\,u(\mathbf{x},{t+T})\,d\mathbf{x} Weighted sum \mathbf{W}_{\mathrm{att},t+T}\mathbf{r}_{t+T} Output \bar{\mathbf{y}}_{n} Attention (trainable) F(\tilde{\mathbf{r}}_{t}) produces \phi_{t+T}^{(i)}(\mathbf{x}) (where to measure) and \mathbf{W}_{\mathrm{att},t+T} (how to combine) Gradient descent update of F(\cdot) weights \mathbf{W}_{\mathrm{att},t+T} Input measurements \tilde{\mathbf{r}}_{t} Output kernels \phi_{t+T}^{(i)}(\mathbf{x}) Figure 1 : Flow chart of the Adaptive-Sensing-Attention–Enhanced-Reservoir-Computer (ASAERC). Inputs drive a fixed continuous reservoir. The reservoir is measured at fixed locations given via the measurement kernels \psi_{t}^{(j)}(\mathbf{x}) and the resulting N_{\mathrm{fix}} states \tilde{r}_{t} are fed into the attention module. The trainable attention module outputs parameterized kernels \phi_{t+T}^{(i)}(\mathbf{x}) to guide sampling and attention weights \mathbf{W}_{\mathrm{att},t+T} to combine sampled features. The weighted combination produces \bar{\mathbf{y}}_{n} , and gradient descent (dashed path) updates the attention module. No gradients pass through the PDE reservoir. Figure 2 : Illustration of ASAERC behavior. (a) Example predicted time series (orange-dashed line) compared with ground truth (blue-solid line) on the Lorenz attractor. (b) Snapshot of the PDE reservoir field u(\mathbf{x},t^{\star}) with fixed injection points (light-blue triangles), fixed measurement points (attention input, crosses) \tilde{r}_{t}^{(j)}=\int_{\Omega}\psi_{t}^{(j)}(\mathbf{x})\,u(\mathbf{x},t)\,d\mathbf{x}, and dynamic measurement locations (attention output) overlaid r_{t+T}^{(j)}=\int_{\Omega}\phi_{t+T}^{(i)}(\mathbf{x})\,u(\mathbf{x},t+T)\,d\mathbf{x}, . The adaptive sensors (blue circles) cluster around dynamically active regions, demonstrating the network’s ability to focus its attention on informative spatial locations. (c) A histogram of the attention output locations, giving an intricate pattern that is a nonlinear projection of the Lorenz attractor on the measurement process. Dynamical systems naturally process information: their trajectories preserve, transform, and disperse information about external inputs. This idea was formalized through the concept of information processing capacity (IPC), which quantifies how well a dynamical system can reconstruct functions of its past inputs when coupled to a fixed output layer [ 4 ] . Treating dynamics as information reservoirs has motivated computational paradigms that exploit state evolution directly for prediction and control. Reservoir computing (RC) is a prominent example. It uses a high-dimensional recurrent dynamical system as a fixed nonlinear feature generator and trains only a simple readout layer [ 13 , 1 , 32 , 33 , 17 ] . RC can be computationally efficient, because only the readout is optimized and is well suited to time-series prediction, pattern recognition, and classification [ 13 , 32 ] , while also being attractive for hardware implementation. RC has been demonstrated in a wide variety of physical platforms, including electronic delay systems [ 1 , 16 ] , photonic reservoirs [ 1 , 28 ] , spintronic devices [ 33 ] , soft robotic bodies [ 26 ] , and nanostructure materials [ 17 ] . These examples emphasize that many complex media can serve as information-processing systems. Nevertheless, classical RC has a key limitation: its readout is static. Reservoir states are projected to outputs via a fixed linear mapping, which can be too restrictive to exploit nonlinear information in the state space, especially in multiscale or chaotic regimes. Several approaches attempt to mitigate this rigidity, for instance by optimizing readout hyperparameters [ 8 , 9 ] or injecting control signals to steer predictions [ 5 ] . However, such strategies often require task-specific tuning, rely on teacher forcing, or do not transfer robustly across diverse dynamical regimes. In parallel, machine learning has introduced mechanisms for adaptive feature selection. Attention dynamically re-weights a representation based on its current context [ 35 , 2 ] . Building on this idea, attention-enhanced reservoir computing (AERC) replaces the static linear readout with a small neural network that computes state-dependent weights at each time step [ 14 ] . This enables a single trained model to represent multiple attractors and switch between them without retraining, which is crucial for autonomous multifunctionality. In this work we propose a broader viewpoint: instead of adapting only the readout weights, we learn the measurement process itself. We introduce a framework for trainable information extraction from dynamical systems, in which a neural interface learns both where to measure a system’s state and how to combine the resulting measurements for prediction. We propose a concept of Adaptive-Sensing Attention-Enhanced Reservoir Computing (ASAERC), which relates to classical sensor placement and experimental design, where one selects a small set of sensors to reconstruct or monitor a spatial state. For example, data-driven sparse sensor placement methods choose fixed measurement locations that enable accurate state reconstruction in a learned low-dimensional basis [ 24 ] , and information-theoretic approaches select fixed sensor sets by maximizing mutual information under a Gaussian-process model [ 18 ] . In contrast to these predominantly offline and static designs, ASAERC learns a state-conditioned, time-varying measurement operator: the sensing kernels \{\phi^{(i)}_{t+T}\} are produced online from the current fixed measurements \tilde{\mathbf{r}}_{t} to directly minimize a forecasting loss. Our approach is also related to learned sampling modules in deep learning, such as spatial transformer networks [ 12 ] and deformable convolutions [ 3 ] , which adaptively resample feature maps to focus computation on task-relevant regions. The key distinction is that ASAERC treats sensing as an interface to an external continuous dynamical system: we learn where to probe and how to combine measurements of a fixed reservoir field u(\mathbf{x},t) , while explicitly avoiding backpropagation through the reservoir dynamics. This reformulates attention-enhanced reservoir computing as a special case of a broader paradigm in which neural networks act as trainable measurement devices for continuous physical systems. We demonstrate ASAERC on one-step-ahead prediction across a heterogeneous suite of chaotic systems spanning continuous-time flows, discrete maps, and a delay differential equation. Across all systems, adaptive sensing improves prediction accuracy compared to classical RC and fixed-sensor attention baselines, supporting the view that learning where to measure can be as important as learning how to combine measurements. Figure 3 : Prediction error as a function of number of measurement points. All methods use the same PDE reservoir. (a) Classical reservoir computing with linear readout; (b) AERC with fixed measurement positions; (c) ASAERC with adaptive sensing. Color indicates the number of measurement points at fixd locations. 2 Results 2.1 Scheme overview Figure 1 summarizes the ASAERC pipeline. A standardized discrete-time input \mathbf{x}_{n} drives a fixed continuous reservoir field u(\mathbf{x},t) . At each time step, fixed measurements \tilde{\mathbf{r}}_{t} are collected via kernels \{\psi_{t}^{(j)}\} and fed to a trainable attention

Read the complete text