Vortex: Overcoming Memory Capacity Limitations in GPU-Accelerated Large-Scale Data Analytics

Yichao Yuan, Advait Iyer, Lin Ma, Nishil Talati · 2025

Read Vortex: Overcoming Memory Capacity Limitations in GPU-Accelerated Large-Scale Data Analytics by Yichao Yuan, Advait Iyer, Lin Ma, Nishil Talati (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-09541.txt.

Description

Yichao Yuan, Advait Iyer, Lin Ma, and Nishil Talati introduce a system called Vortex in a 2025 computing paper. Fast chips called GPUs speed up big data work, but their memory is small and the link to the main computer is slow. Jobs that outgrow chip memory thus stall.

Vortex routes data through all the links of a multi-chip machine to the one chip doing the heavy input work. It also splits the writing of chip code from the planning of data flow, so old code can be reused with ease. The system avoids storing data on the chip at all. In tests it ran more than five times faster than a leading rival and gave better value than a CPU-based tool.

Catalog record

CREATORYichao Yuan, Advait Iyer, Lin Ma, Nishil Talati
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE72 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-09541

Browse the full library · About the Tower of Babel