Accelerating Intra-Node GPU-to-GPU Communication Through Multi-Path Transfers with CUDA Graphs CCS: Software and its engineering Message passing

Amirhossein Sojoodi, Yıltan Hassan Temuçin, Amirreza Barati Sedeh, Hamed Sharifian, Ahmad Afsahi · 2026

Read Accelerating Intra-Node GPU-to-GPU Communication Through Multi-Path Transfers with CUDA Graphs CCS: Software and its engineering Message passing by Amirhossein Sojoodi, Yıltan Hassan Temuçin, Amirreza Barati Sedeh, Hamed Sharifian, Ahmad Afsahi (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-22228.txt.

Description

For computers that link several graphics processors inside one machine, Sojoodi and four colleagues speed the chatter between chips by folding CUDA Graphs into the UCX messaging library. Sending data along several routes at once, including fast NVLink links and a path through the host machine, cuts overhead instead of relying on a single route. On a four-chip test node their method raised bandwidth by up to 2.95 times over single-path UCX at messages up to 512MB.

Catalog record

CREATORAmirhossein Sojoodi, Yıltan Hassan Temuçin, Amirreza Barati Sedeh, Hamed Sharifian, Ahmad Afsahi
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE55001
LICENSEhttp://creativecommons.org/licenses/by-sa/4.0/
RIGHTSCC BY SA
SOURCEarXiv

Source: https://arxiv.org/abs/2604.22228

Browse the full library · About the Tower of Babel