Time-Delayed Transformers for Data-Driven Modeling of Low-Dimensional Dynamics
Albert Alcalde, Markus Widhalm, Emre Yılmaz · 2026
Read Time-Delayed Transformers for Data-Driven Modeling of Low-Dimensional Dynamics by Albert Alcalde, Markus Widhalm, Emre Yılmaz (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-08478.txt.
Description
Modeling unsteady flows and chaotic dynamics usually forces a choice between interpretable linear methods and powerful deep models. Albert Alcalde and two co-authors propose a time-delayed transformer that bridges the two. Their arXiv paper shows a one-layer transformer with a single attention head can be read as a nonlinear version of time-delayed dynamic-mode analysis.
The design stays deliberately minimal, with one attention layer, one query per prediction, and one feedforward layer, giving linear cost in sequence length. Tests on synthetic signals, unsteady aerodynamics, the Lorenz system, and a reaction-diffusion model show it matches linear baselines where systems are near-linear and beats them clearly in nonlinear and chaotic regimes. Readers get an efficient, interpretable model for complex dynamics.
Catalog record
| CREATOR | Albert Alcalde, Markus Widhalm, Emre Yılmaz |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 46 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-08478