Understanding the Theoretical Foundations of Deep Neural Networks through Differential Equations

Hongjue Zhao, Yizhuo Chen, Yuchen Wang, Hairong Qi, Lui Sha, Tarek Abdelzaher, Huajie Shao · 2026

Read Understanding the Theoretical Foundations of Deep Neural Networks through Differential Equations by Hongjue Zhao, Yizhuo Chen, Yuchen Wang, Hairong Qi, Lui Sha, Tarek Abdelzaher, Huajie Shao (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-18331.txt.

Description

Zhao and co-authors survey differential equations as a theoretical base for deep neural networks. Networks succeed in practice, yet lack a principled foundation for systematic design. The survey asks how equations explain architectures, improve performance, and serve real applications. Two views organize the field: the whole network as one equation, and each layer as an equation. Links between design, analysis, and gains are traced across both views.

Catalog record

CREATORHongjue Zhao, Yizhuo Chen, Yuchen Wang, Hairong Qi, Lui Sha, Tarek Abdelzaher, Huajie Shao
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE99878
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.18331

Browse the full library · About the Tower of Babel