SysOM-AI: Continuous Cross-Layer Performance Diagnosis for Production AI Training CCS: Computer systems organization Heterogeneous (hybrid) systems CCS: Software and its engineering Software performance
Yusheng Zheng ∗,2 , Wenan Mao ∗,1 , Shuyi Cheng 1 , Fuqiu Feng 1 , Guangshui Li 1 , Zhaoyan Liao 1 , Yongzhuo Huang 1 , Zhenwei Xiao 1 , Yuqing Li 1 , Andi Quinn †,2 , Tao Ma †,1 · 2026
Read SysOM-AI: Continuous Cross-Layer Performance Diagnosis for Production AI Training CCS: Computer systems organization Heterogeneous (hybrid) systems CCS: Software and its engineering Software performance by Yusheng Zheng ∗,2 , Wenan Mao ∗,1 , Shuyi Cheng 1 , Fuqiu Feng 1 , Guangshui Li 1 , Zhaoyan Liao 1 , Yongzhuo Huang 1 , Zhenwei Xiao 1 , Yuqing Li 1 , Andi Quinn †,2 , Tao Ma †,1 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-29235.txt.
Introduction
Zheng and co-authors present SysOM-AI, a system for diagnosing slowdowns in production AI training. Small operating-system issues can cascade into GPU and network delays. Older profilers watch one layer at a time or add heavy overhead. SysOM-AI traces CPU stacks, GPU kernels, and network events together. It uses eBPF tracing with under 0.4 percent overhead. At Alibaba it ran on over 80,000 GPUs for a year. It helped confirm 94 production issues. Median diagnosis time fell to about ten minutes.
Catalog record
| CREATOR | Yusheng Zheng ∗,2 , Wenan Mao ∗,1 , Shuyi Cheng 1 , Fuqiu Feng 1 , Guangshui Li 1 , Zhaoyan Liao 1 , Yongzhuo Huang 1 , Zhenwei Xiao 1 , Yuqing Li 1 , Andi Quinn †,2 , Tao Ma †,1 |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 41046 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.29235
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
SysOM-AI: Continuous Cross-Layer Performance Diagnosis for Production AI Training CCS: Computer systems organization Heterogeneous (hybrid) systems CCS: Software and its engineering Software performance Yusheng Zheng ∗,2 , Wenan Mao ∗,1 , Shuyi Cheng 1 , Fuqiu Feng 1 , Guangshui Li 1 , Zhaoyan Liao 1 , Yongzhuo Huang 1 , Zhenwei Xiao 1 , Yuqing Li 1 , Andi Quinn †,2 , Tao Ma †,1 Abstract . Performance diagnosis in production-scale AI training is challenging because subtle OS-level issues can trigger cascading GPU delays and network slowdowns, degrading training efficiency across thousands of GPUs. Existing profiling tools are limited to single system layers, incur prohibitive overhead (10–30%), or lack continuous deployment capabilities, resulting in manual analyses spanning days. We argue that continuous, cross-layer observability enabled by OS-level instrumentation and layered differential diagnosis is necessary to address this gap. We introduce SysOM-AI, a production observability system that continuously integrates CPU stack profiling, GPU kernel tracing, and NCCL event instrumentation via adaptive hybrid stack unwinding and eBPF-based tracing, incurring less than 0.4% overhead. Deployed at Alibaba across over 80,000 GPUs for more than one year, SysOM-AI helped diagnose 94 confirmed production issues, reducing median diagnosis time from days to approximately 10 minutes. † † footnotetext: ∗ Equal contribution (co-first authors). † Corresponding authors: [email protected], [email protected]. 1. Introduction Large-scale AI training jobs increasingly dominate modern production datacenters, often consuming thousands of GPUs simultaneously. At such scale, even minor performance inefficiencies caused by OS-level scheduling, GPU thermal behavior, or network contention can cascade into substantial slowdowns, impacting overall training throughput ( 24 ) . Prior characterization studies report that such issues are a major source of training job inefficiencies, with diagnosis often taking days ( 11 ) . Diagnosing and mitigating these issues remains a significant operational challenge. Current performance profiling tools predominantly focus on single-layer visibility (Table 1 ): GPU-specific profilers (e.g., NVIDIA Nsight ( 20 ) ) monitor GPU execution but impose 10–30% overhead ( 19 ) ; CPU-focused tools (e.g., Strobelight ( 34 ) , async-profiler ( 22 ) ) efficiently capture call stacks but lack visibility into GPU or distributed NCCL events; and framework-level profilers (e.g., PyTorch Profiler ( 26 ) ) ignore critical OS-level behaviors. These tools cannot continuously run in large-scale production due to prohibitive overhead or incomplete system coverage. Consequently, operators must manually correlate fragmented data from multiple sources, significantly prolonging diagnosis. We argue that continuous, cross-layer observability (capturing and correlating CPU, GPU, and network activity simultaneously) is essential to identify root causes of performance degradation in production AI training. Building on this insight, we develop SysOM-AI, a production profiling system that leverages OS-level eBPF instrumentation to enable lightweight, always-on collection of CPU stacks (including full kernel call chains), GPU kernel timings, and NCCL collective events. A central analysis service correlates these signals across all ranks and performs layered differential diagnosis : comparing GPU, CPU, and OS profiles between anomalous and healthy ranks to systematically isolate the root-cause layer, or comparing against historical baselines to catch uniform degradation. Achieving production-scale deployment required addressing several challenges, including minimizing profiling overhead via adaptive hybrid stack unwinding, implementing centralized symbol resolution to avoid per-node memory pressure, and developing framework-agnostic NCCL tracing without debug symbols. SysOM-AI has been deployed for over one year across Alibaba’s production fleet encompassing more than 80,000 GPUs and 10,000+ nodes, processing \sim 400 TiB of profiling data daily. In the six-month evaluation period reported in this paper, it helped diagnose 94 confirmed performance issues (GPU thermal throttling, NIC soft-interrupt contention, VFS lock contention, logging overhead) that were not detected by existing single-layer tools, reducing median diagnosis time from days to approximately 10 minutes. Table 1. Comparison with AI profiling tools. ✓= supported, ✗= not supported. “Kernel” = OS kernel-level signals. “Scope” = single process vs. cluster-wide. Tool Py C++ Kern. Scope GPU Ovhd. MegaScan ( 32 ) ✓ ✗ ✗ Proc ✗ Low MegaScale ( 14 ) ✗ ✗ ✗ Proc ✓ Low DeepSpeed Prof. ( 18 ) ✓ ✗ ✗ Proc ✓ Med Nsight Sys. ( 20 ) ✗ ✓ ✗ Proc ✓ High Strobelight ( 34 ) ✗ ✓ ✗ Proc ✗ Low async-profiler ( 22 ) ✗ ✓ ✗ Proc ✗ Low SysOM-AI ✓ ✓ ✓ Cluster ✓ Low Among these tools, none collect kernel-level OS signals such as interrupt handling or scheduler activity. SysOM-AI adds continuous cluster-scoped observability with OS-kernel visibility. This paper makes the following contributions: (1) We design and implement SysOM-AI, a continuous cross-layer performance profiling system for production AI training, integrating CPU, GPU, and NCCL observability at less than 0.4% overhead (§ 3 – 4 ). (2) We propose a layered differential analysis methodology that systematically isolates root causes by comparing across ranks (for stragglers) and against historical baselines (for uniform degradation), using a per-communication-group CPU waterline (§ 3.1 ). (3) We implement adaptive hybrid stack unwinding, centralized symbol resolution, and framework-agnostic NCCL tracing via eBPF, enabling always-on profiling with low overhead (§ 3.3 – 3.2 ). (4) We report on a one-year production deployment across 80,000+ GPUs, presenting end-to-end case studies demonstrating cross-layer diagnosis of issues invisible to existing tools (§ 5 ). 2. Background and Motivation We first describe the performance characteristics of distributed AI training, then use a production incident to motivate the design of SysOM-AI. 2.1. AI Training Performance Characteristics Modern large-scale AI training uses synchronous data or pipeline parallelism, where each iteration comprises forward pass, backward pass, gradient reduction via collectives (e.g., AllReduce, ReduceScatter), and parameter update ( 14 ) . Because collectives are blocking, the slowest rank in a communication group determines the iteration time for all ranks. Even small per-rank delays compound at scale: a 0.3 ms slowdown per iteration on a single rank wastes over 70 GPU-hours per day in a 1,000-GPU job running at 100 ms/iteration. Prior work has shown that such performance issues are common and stem from diverse root causes spanning GPU hardware, OS kernel, network, and application runtime ( 24 ; 11 ) , making it difficult to determine which layer is responsible without profiling data from all layers simultaneously. 2.2. Motivating Example Consider a scenario from our production fleet: rank 4 in an 8-rank communication group enters each NCCL collective 0.6 ms late, slowing the entire group. An operator’s first instinct is to check GPU utilization, but nvidia-smi reports 100% on all ranks, and GPU kernel times match within 1%. Network monitoring shows no packet loss or latency anomaly. A CPU profiler ( perf ) is attached, but because asm_common_interrupt is compiled without frame pointers, FP-based unwinding truncates the stack at the interrupt boundary, hiding everything below it. The operator sees elevated CPU time in an unrelated function due to misattribution, and spends two days investigating a false lead. The actual root cause was NIC soft-interrupts ( NET_RX_SOFTIRQ ) bound to a CPU core shared with the NCCL communication thread. Diagnosing this required three capabilities that no existing tool provides together: (1) cross-rank comparison to see that GPU profiles match but CPU profiles diverge, (2) accurate kernel stacks to reveal the full interrupt chain from asm_common_interrupt through do_softirq to napi_gro_receive , and (3) always-on collection because the issue was intermittent and could not be reproduced