FlashSinkhorn: IO-Aware Entropic Optimal Transport
Felix X.-F. Ye, Xingjie Li, An Yu, Ming-Ching Chang, Linsong Chu, Davis Wertheimer · 2026
Read FlashSinkhorn: IO-Aware Entropic Optimal Transport by Felix X.-F. Ye, Xingjie Li, An Yu, Ming-Ching Chang, Linsong Chu, Davis Wertheimer (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-03067.txt.
Description
Moving mass between distributions on a graphics processor gets much faster in a 2026 paper by Felix X. -F. Ye and 5 co-authors. Entropic optimal transport, computed by Sinkhorn iterations, is widely used in machine learning. Standard implementations move huge dense matrices through memory, while online versions rely on generic reduction kernels with limited fusion of operations during each iteration at scale.
Their solver, FlashSinkhorn, rewrites the stabilized updates as row-wise reductions of the same form as transformer attention. Fused kernels then stream tiles through fast on-chip memory and update potentials in a single pass. Streaming kernels also apply the resulting transport plan. On A100 processors, forward passes ran up to thirty-two times faster than leading online baselines, with open-source code released.
Catalog record
| CREATOR | Felix X.-F. Ye, Xingjie Li, An Yu, Ming-Ching Chang, Linsong Chu, Davis Wertheimer |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 114 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-03067