Formal Verification of Secure Encrypted Virtualization
Hansika Weerasena, Amitabh Das, Prabhat Mishra · 2026
Read Formal Verification of Secure Encrypted Virtualization by Hansika Weerasena, Amitabh Das, Prabhat Mishra (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-01381.txt.
Introduction
Weerasena, Das, and Mishra formally verify secure encrypted virtualization. Trusted execution environments protect data and code in use. VM-based versions isolate a full system or single apps. AMD SEV encrypts VM memory in hardware for cloud use. Yet SEV often runs without formal security assurances. Their framework represents and verifies AMD SEV confidential VMs. Abstraction works at both design and property levels.
Property checking then tests the model against key attributes. Confidentiality, integrity, and availability all get checked. The approach gives a rigorous base for defining security traits. Cloud users gain stronger grounds to trust such environments. The work targets a gap between deployed tech and proof. Formal methods here serve practical confidential computing.
Catalog record
| CREATOR | Hansika Weerasena, Amitabh Das, Prabhat Mishra |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 77 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.01381
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Formal Verification of Secure Encrypted Virtualization Hansika Weerasena, Amitabh Das, Prabhat Mishra Abstract . Trusted execution environments (TEEs) provide a secure environment for data and code in use, ensuring that they are protected with respect to confidentiality and integrity. Virtual machine (VM)-based TEEs utilize virtualization technology to create isolated execution spaces that can support a complete operating system or specific applications. AMD secure encrypted virtualization (SEV) is a key technology used in confidential computing in the cloud enabling hardware-based memory encryption to protect sensitive data within VMs. However, AMD SEV often operate without formal assurances of their security guarantees. Our research introduces a formal framework for representing and verifying AMD SEV confidential VMs. Specifically, we conduct design-level and property-level abstraction on AMD SEV specification and conduct property checking on the model to ensure confidentiality, integrity and availability. This approach provides a rigorous foundation for defining and verifying key security attributes for safeguarding execution environments. 1. Introduction Modern cloud computing environments host numerous workloads from mutually untrusted tenants on the same physical infrastructure. This increases the risk of cross-tenant and hypervisor-based attacks, thereby threatening the confidentiality and integrity of data and code executing within virtual machines (VMs). To address these concerns, there is a growing demand for secure hardware primitives that can isolate execution and ensure trust even in the presence of a compromised system software stack. A trusted execution environment (TEE) is a hardware-assisted isolated environment that provides confidentiality and integrity of code and data within a VM, preventing unauthorized access or modification—even by the hypervisor. There are several commercially TEEs, which can be broadly categorized into enclave-based, VM-based, and embedded TEEs. Among thee different classes of TEEs, VM-based TEEs such as Intel TDX, ARM TrustZone, and IBM Z Secure Execution and AMD SEV have emerged as the de-facto standard due to their strong security guarantees, compatibility with legacy applications, and low performance overhead. Unlike enclave-based TEEs (e.g., SGX), VM-based TEEs offer full-VM protection with minimal changes to the application stack, making them suitable for deployment in large-scale public clouds. Embedded TEEs, on the other hand, are typically integrated into mobile and embedded platforms to ensure secure execution at the hardware level. While the architectural documentation of VM-based TEEs describes mechanisms for ensuring confidentiality and integrity, it lacks formal guarantees. Given the complexity of modern TEE designs and the potential for subtle implementation flaws, there is a critical need for formal verification of these architectures to validate that they indeed uphold their intended security guarantees. Specifically, we must verify that code and data within a guest VM remain confidential and unmodified throughout the VM’s lifecycle, even in the presence of a malicious hypervisor or system software. Figure 1 . Overview of formal verification framework. Figure 1 presents an overview of our formal verification framework for the security validation of TEE architectures. The process begins with a TEE specification that outlines the expected architecture and behavior of the TEE. From this specification, we apply two complementary forms of abstraction to construct formal models. First, design-based abstraction captures all architecturally defined behaviors and transitions described in the specification, independent of any specific property. This abstraction aims to represent the operational semantics of the TEE, forming the baseline for building comprehensive and reusable models. Second, property-based abstraction simplifies the system by focusing only on behaviors and components relevant to specific security properties. The resulting formal model is verified using the properties generated from the specification. The property generation phase extracts security properties related to confidentiality , integrity , and availability , each representing a fundamental aspect of system security. Specifically, this paper makes the following major contributions: (1) We present a comprehensive formal model that defines the security boundaries of confidential VMs, explicitly considering adversaries with access to advanced attack vectors. (2) We formally model confidentiality, integrity, and availability notions for VM-based trusted execution environments. (3) We introduce a detailed formal model for the AMD SEV architecture, developed using the Rosette language. (4) We critically evaluate the security measures of AMD SEV and compare them with those of other VM-based TEEs, such as Intel TDX. (5) Finally, we formally verify AMD SEV for confidentiality, integrity, and availability via multiple properties generated from CIA security notions. This paper is organized as follows. Section 2 provides relevant background and surveys related efforts. Section 3 discusses the threat model for VM-based TEEs and defines the formal model for the virtual machine and the adversary. Section 4 provides formal definitions for confidentiality, integrity, and availability. Section 5 conducts a security analysis of the AMD SEV architecture. Section 6 provides details on the formal modeling of an AMD SEV architecture and discusses the results of the formal analysis. Finally, Section 7 concludes the paper. 2. Background and Related Work This section provides background for trusted execution environments and AMD SEV. Next, we survey related efforts on verifying trusted execution environments and highlight their limitations. 2.1. Trusted Execution Environments (TEE) TEEs are secure areas within a multiprocessor that provide an isolated execution context to protect sensitive code and data. A TEE ensures that any code running inside it maintains confidentiality and integrity even in the presence of a compromised operating system or privileged software. This isolation guarantees that sensitive operations such as cryptographic key management, attestation, and secure computation are protected from unauthorized access or modification. There are multiple types of TEEs designed with different trust boundaries and deployment models. Enclave-based TEEs, such as Intel SGX, isolate specific regions of an application’s memory, allowing only selected code to access the enclave. These are well-suited for fine-grained protection of small, critical workloads. On the other hand, VM-based TEEs such as AMD SEV and Intel TDX operate at the granularity of full virtual machines, offering broad protection to guest VMs in cloud environments. They secure not only memory but also CPU register states and provide remote attestation, thereby enabling secure multi-tenant computing even in untrusted infrastructure. 2.1.1. VM-based TEEs A virtual machine (VM) abstracts a physical computer, enabling multiple isolated guest operating systems to run on a single host hardware. These VMs are managed by a highly privileged hypervisor that coordinates their execution. To address the threat of a compromised hypervisor, confidential virtual machines (CVMs) have emerged. These are specialized VMs enhanced with hardware-based isolation mechanisms that prevent unauthorized access to VM memory or state—even from privileged software such as the hypervisor or host OS. CVMs are typically realized through a class of TEEs known as VM-based TEEs. Unlike traditional enclave-based TEEs that protect limited code and data regions, VM-based TEEs secure entire virtual machines. They provide complete memory encryption, register state protection, and attestation mechanisms to validate the software stack within the VM. The key architectural difference lies in how the hardware enforces security boundaries. 2.1.2. AMD Secure Encrypted Virtualization (SEV) AMD SEV is a hardware extension introduced by AMD ( amd_sev_api_2020 ) to enable secure execution of VMs. SEV encrypts the memory of guest VMs using a unique encryption key managed by a secure coprocessor embedded within the AMD processor. This prevents the hypervisor or any external agent from inspecting or modifying the contents of guest memory. The first version of SEV is referred to as SEV-base in rest