Manifold Random Features

Ananya Parashar, Derek Long, Dwaipayan Saha, Krzysztof Choromanski · 2026

Read Manifold Random Features by Ananya Parashar, Derek Long, Dwaipayan Saha, Krzysztof Choromanski (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-03797.txt.

Description

Approximating a kernel function with random features is a classic speedup, but classic features live on flat space. Ananya Parashar and 3 co-authors extend the idea to curved manifolds in a 2026 paper, presenting Manifold Random Features. The method lays a grid over the manifold and borrows Graph Random Features, learning continuous fields where closed-form derivations are usually out of reach.

The resulting features are positive and bounded, a pairing that keeps approximation variance low. The authors prove a deep link, in the large-sample limit, between the graph-based features and continuous random features for ordinary kernels. As a by-product, their method rediscovers a recent Gaussian kernel approximation used to improve linear-attention transformers. It reaches the result through simple random walks rather than heavy math.

Catalog record

CREATORAnanya Parashar, Derek Long, Dwaipayan Saha, Krzysztof Choromanski
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE60 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-03797

Browse the full library · About the Tower of Babel