Time-Delayed Transformers for Data-Driven Modeling of Low-Dimensional Dynamics

Albert Alcalde, Markus Widhalm, Emre Yılmaz · 2026

Read Time-Delayed Transformers for Data-Driven Modeling of Low-Dimensional Dynamics by Albert Alcalde, Markus Widhalm, Emre Yılmaz (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-08478.txt.

Description

Modeling unsteady flows and chaotic dynamics usually forces a choice between interpretable linear methods and powerful deep models. Albert Alcalde and two co-authors propose a time-delayed transformer that bridges the two. Their arXiv paper shows a one-layer transformer with a single attention head can be read as a nonlinear version of time-delayed dynamic-mode analysis.

The design stays deliberately minimal, with one attention layer, one query per prediction, and one feedforward layer, giving linear cost in sequence length. Tests on synthetic signals, unsteady aerodynamics, the Lorenz system, and a reaction-diffusion model show it matches linear baselines where systems are near-linear and beats them clearly in nonlinear and chaotic regimes. Readers get an efficient, interpretable model for complex dynamics.

Catalog record

CREATORAlbert Alcalde, Markus Widhalm, Emre Yılmaz
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE46 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-08478

Browse the full library · About the Tower of Babel