FlashSinkhorn: IO-Aware Entropic Optimal Transport

Felix X.-F. Ye, Xingjie Li, An Yu, Ming-Ching Chang, Linsong Chu, Davis Wertheimer · 2026

Read FlashSinkhorn: IO-Aware Entropic Optimal Transport by Felix X.-F. Ye, Xingjie Li, An Yu, Ming-Ching Chang, Linsong Chu, Davis Wertheimer (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-03067.txt.

Description

Moving mass between distributions on a graphics processor gets much faster in a 2026 paper by Felix X. -F. Ye and 5 co-authors. Entropic optimal transport, computed by Sinkhorn iterations, is widely used in machine learning. Standard implementations move huge dense matrices through memory, while online versions rely on generic reduction kernels with limited fusion of operations during each iteration at scale.

Their solver, FlashSinkhorn, rewrites the stabilized updates as row-wise reductions of the same form as transformer attention. Fused kernels then stream tiles through fast on-chip memory and update potentials in a single pass. Streaming kernels also apply the resulting transport plan. On A100 processors, forward passes ran up to thirty-two times faster than leading online baselines, with open-source code released.

Catalog record

CREATORFelix X.-F. Ye, Xingjie Li, An Yu, Ming-Ching Chang, Linsong Chu, Davis Wertheimer
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE114 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-03067

Browse the full library · About the Tower of Babel