Padé Neurons for Efficient Neural Models
Onur Keleş, A. Murat Tekalp · 2026
Read Padé Neurons for Efficient Neural Models by Onur Keleş, A. Murat Tekalp (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-04005.txt.
Description
Onur Keleş and A. Murat Tekalp propose a new kind of artificial neuron based on Padé approximants, which are ratios of polynomials used to mimic curved functions. Standard neurons apply a fixed bend after a straight sum. Earlier non-linear neurons added power, but each still had limits.
The pair call their units Padé neurons, or Paons. Each Paon learns its own curved response, so fewer layers can do the same work. The authors note that earlier neuron types appear as special cases of theirs. They swap Paons into known ResNet-based models for image sharpening, compression, and sorting tasks. The swapped models match or beat the originals with fewer layers, and the code is shared openly.
Catalog record
| CREATOR | Onur Keleş, A. Murat Tekalp |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 64 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-04005