Pulse-Driven Neural Architecture: Learnable Oscillatory Dynamics for Robust Continuous-Time Sequence Processing

Paras Sharma · 2026

Read Pulse-Driven Neural Architecture: Learnable Oscillatory Dynamics for Robust Continuous-Time Sequence Processing by Paras Sharma (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-00153.txt.

Description

Sharma introduces PDNA, a method that adds learnable oscillatory dynamics to continuous-time recurrent networks, keeping state evolution independent of input. Built on closed-form continuous-time networks, it adds a pulse module for structured oscillations with learnable frequencies and phase tied to state. A self-attend module adds recurrent self-attention on the hidden state. In gap tests on sequential MNIST with five seeds, the self-attend variant beats baseline by 2.78 percentage points on gap trials, while the pulse variant leads by about five points with large effect.

Catalog record

CREATORParas Sharma
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35029
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.00153

Browse the full library · About the Tower of Babel