NVIDIA GPU Confidential Computing Demystified Conference: ; ;
Zhongshu Gu, Enriquillo Valdez, Salman Ahmed, Julian James Stephen, Michael Le, Hani Jamjoom, Shixuan Zhao, Zhiqiang Lin · 2025
Read NVIDIA GPU Confidential Computing Demystified Conference: ; ; by Zhongshu Gu, Enriquillo Valdez, Salman Ahmed, Julian James Stephen, Michael Le, Hani Jamjoom, Shixuan Zhao, Zhiqiang Lin (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-02770.txt.
Introduction
Zhongshu Gu and co-authors take a security look inside NVIDIA's confidential computing for graphics chips, in a 2025 paper. The feature promises sealed execution for AI workloads, with no code changes needed. That ease rests on a closed, complex stack that outsiders cannot inspect. The team rebuilt a coherent picture of the system from the outside.
Their tour has three parts, matching the title's blueprint, bootstrap, and bridge. First come the special engines that carry the security design. Next comes the startup process that lines up hardware and software protections. Last, experiments test whether data stay protected as they cross between the trusted processor and the chip. All findings were shared with NVIDIA's security team before release, the authors note.
Catalog record
| CREATOR | Zhongshu Gu, Enriquillo Valdez, Salman Ahmed, Julian James Stephen, Michael Le, Hani Jamjoom, Shixuan Zhao, Zhiqiang Lin |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 74 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-02770
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
NVIDIA GPU Confidential Computing Demystified Conference: ; ; Zhongshu Gu, Enriquillo Valdez, Salman Ahmed, Julian James Stephen, Michael Le, Hani Jamjoom, Shixuan Zhao, Zhiqiang Lin Abstract . GPU-CC ( GPU-CC ) was introduced as part of the NVIDIA Hopper Architecture, extending the trust boundary beyond traditional CPU-based confidential computing. This innovation enables GPUs to securely process AI workloads, providing a robust and efficient solution for handling sensitive data. For end users, transitioning to GPU-CC mode is seamless, requiring no modifications to existing AI applications. However, this ease of adoption contrasts sharply with the complexity of the underlying proprietary systems. The lack of transparency presents significant challenges for security researchers seeking a deeper understanding of GPU-CC ’s architecture and operational mechanisms. The challenges of analyzing the NVIDIA GPU-CC system arise from a scarcity of detailed specifications, the proprietary nature of the ecosystem, and the complexity of product design. In this paper, we aim to demystify the implementation of NVIDIA GPU-CC system by piecing together the fragmented and incomplete information disclosed from various sources. Our investigation begins with a high-level discussion of the threat model and security principles before delving into the low-level details of each system component. We instrument the GPU kernel module — the only open-source component of the system — and conduct a series of experiments to identify the security weaknesses and potential exploits. For certain components that are out of reach through experiments, we propose well-reasoned speculations about their inner working mechanisms. We have responsibly reported all security findings presented in this paper to the NVIDIA PSIRT Team. 1. Introduction Confidential computing enables secure outsourcing of computations involving sensitive data to TEE on public cloud infrastructures. Its goal is to ensure the confidentiality and integrity of data while in use. Initial efforts in this field focused on CPU-CC ( CPU-CC ), which protects computations within the CPU package and encrypts data residing in system memory. However, as computing workloads have evolved — particularly with the explosive growth of LLM — more computation and data are being offloaded to GPU to take advantage of their massive parallelism. To meet this shift, NVIDIA recently introduced support for GPU-CC ( Dhanuskodi et al. 2023 ) in its Hopper architecture (as well as in the forthcoming Blackwell architecture). Software support for GPU-CC is being gradually integrated into the CUDA and NVIDIA kernel drivers. GPU-CC extends the trust boundary from CPUs to GPU , encapsulating the AI ( AI ) computation pipeline within a unified protected domain leveraging both CPU-CC and GPU-CC technologies. GPU-CC significantly broadens the landscape of AI applications that require both GPU acceleration and secure execution environments. It establishes a clear separation of roles and privileges among model owners, data owners, and compute providers, while protecting the confidentiality and integrity of computation and data within the trusted domains of both CPUs and GPU . Furthermore, GPU-CC can also be leveraged in secure collaborative learning ( Mo et al. 2022 ; Guo et al. 2024 ; Quoc and Fetzer 2021 ; Eichner et al. 2024 ; Gu et al. 2019 ; Cheng et al. 2024a ) , allowing multiple mutually distrusting parties to jointly perform AI computations. For end users, enabling GPU-CC is designed to be seamless — AI applications can run without modification. However, enabling GPU-CC demands substantial changes to the underlying system stack. This includes modifications to the CUDA Runtime and user-mode driver, NVIDIA UVM and kernel-mode drivers, and support from a suite of dedicated hardware engines on the GPU. For security researchers and performance engineers, understanding the inner workings of GPU-CC is essential. Yet, analyzing this system poses significant challenges due to the lack of public specifications, the proprietary nature of NVIDIA’s ecosystem, and the architectural complexity involved. In this paper, we demystify the operations of NVIDIA Hopper GPUs in GPU-CC mode. We begin with a high-level overview of the threat model and the security principles guiding its design. We then in-depth examine the key architectural components, the bootstrap process, data protection mechanisms, and the attestation flow that collectively enable GPU-CC . Our approach synthesizes fragmented information from diverse sources to reconstruct a coherent and comprehensive understanding of the system. This understanding is grounded in experimental evidence and systematic analysis. For each component, we detail the experimental methodologies employed and highlight the resulting security insights. In cases where direct information is unavailable, we provide well-reasoned speculations to fill in the gaps. Ultimately, this work aims to shed light on the current state of GPU-CC and to lay the foundation for future research on this emerging technology within the security community. In summary, this paper makes the following key contributions: Examination of Threat Model and Security Principles. We provide a systematic examination of the threat model addressed by NVIDIA GPU-CC , outlining the types of attacks it aims to prevent, the components in the root of trust and the categories of information that may remain exposed. We also present the core security principles that underpin the GPU-CC system design. Exploration of System Architecture. We have conducted an in-depth exploration of the NVIDIA GPU-CC architecture, focusing on key components and their roles. Our analysis expands on technical details that are sparsely documented or only briefly mentioned in NVIDIA’s official materials ( Dhanuskodi et al. 2023 ; Rogers et al. 2023a ; Rogers et al. 2023b ; Rogers et al. 2025 ) . This understanding is derived from auditing and instrumenting CUDA stacks, GPU kernel modules, as well as inter-component communications. Security Analysis of Data Protection Mechanisms. We have performed dedicated security experiments to evaluate the robustness of NVIDIA GPU-CC ’s bootstrap and data protection mechanisms. For each mechanism, we assess potential information leaks through untrusted interfaces, discuss risks of exploitation, and suggest possible mitigation. All security findings presented in this paper have been responsibly disclosed to the NVIDIA PSIRT Team. 2. Background and Related Work CPU-CC Technologies. NVIDIA GPU-CC cannot operate independently. It must work in conjunction with VM ( VM ) based CPU-CC , such as Intel TDX ( TDX ) ( Intel 2023b ; Cheng et al. 2024b ) and AMD SEV ( SEV ) ( Kaplan et al. 2016 ; Kaplan 2017 ; AMD 2020 ) . CPU-CC protects the confidentiality and integrity of computations and data within CVM by enforcing cryptographic isolation from the host environment — including the hypervisor, system administrators, and I/O devices — which are considered untrusted or potentially compromised. This protection relies on security features such as trusted VM management and runtime memory encryption. Each CVM is assigned a unique ephemeral key that is used to encrypt the memory. The AES ( AES ) engine in the on-die memory controller handles the encryption and decryption of data transferred between the CPU and the CVM ’s private memory. CPU-CC also supports remote attestation to verify the authenticity and integrity of the trusted platform. I/O Protection in CPU-CC . The trust boundary of CPU-CC is limited to the CPU and its designated private memory regions. When data leaves this boundary, e.g., during I/O operations, it must pass through untrusted components such as the hypervisor and I/O devices. I/O devices commonly use DMA ( DMA ) to read/write memory without CPU involvement. Since these devices