CARV, ICS, FORTH B.Sc. Thesis by A. Psistakis CSD, UoC

2025

Read CARV, ICS, FORTH B.Sc. Thesis by A. Psistakis CSD, UoC (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-19258.txt.

Introduction

Antonis Psistakis reports thesis work on making remote memory access work across computer nodes. In the Unimem system, many nodes share one virtual address space, and each node's IOMMU hardware must translate addresses correctly for direct memory transfers. ARM's version of that unit, the SMMU, has sparse and unclear Linux documentation.

Psistakis wrote custom kernel modules to insert address mappings into the SMMU on a Xilinx Zynq chip. Transfers sent to virtual addresses, from both the main processors and the programmable logic, passed through the SMMU and were translated as intended. The tests confirm the hardware path that Unimem's shared memory design depends on.

Catalog record

YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE93 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-19258

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

CARV, ICS, FORTH B.Sc. Thesis by A. Psistakis CSD, UoC Abstract \addchaptertocentry Abstract In complex systems with many compute nodes consisting of many CPUs, that are coherent inside each node, one issue is to achieve coherence between them in an efficient and valid way. Unimem system [ 1 ] addresses this issue and in order to support it, it suggests a virtualized system (virtual global address space) that is able to handle this. This approach requires the use of the I/O Memory Management Unit (IOMMU) in each node. The goal of this thesis is to support this approach, by testing and using successfully the IOMMU of one node. In order to do that, we used ARM’s IOMMU, which is called System Memory Management Unit (SMMU), that, in general, enables the translation of the virtual addresses to their corresponding physical addresses. Using the SMMU is complex - the documentation when it comes to Linux support is not very clear, so we had to implement our own modules, in order to test and use the SMMU. First, we tested the SMMU in the Processing System (PS) of the Xilinx Zynq UltraScale+ MPSoC [ 2 ] , by writing a module that adds a virtual address and its corresponding translation to a physical address as an entry to the SMMU. Then, we triggered a DMA transaction sending data to the virtual address that we added to the SMMU and we noticed that our DMA transaction passed through the SMMU in order to translate the virtual address to the corresponding physical address. Later, we tested the SMMU, by doing the same but this time, by triggering the transaction from the Programmable Logic (PL). We noticed, again, that the transaction passed through the SMMU in order to translate the virtual address of the destination. Finally, we created a module that makes possible to trigger transactions from the PL, without the need of mapping the entries of virtual addresses and physical addresses before – we managed to have the SMMU being able to handle and translate all virtual addresses related to a user process, by setting the SMMU with the pointer of the page table of the user process. In general, the result for all scenarios and modules mentioned above is that we managed to have the SMMU working. Due to the limited time of this thesis, future work for understanding and using more features of the SMMU is expected. \thesistitle IOMMU Support for Virtual-Address Remote DMA in an ARMv8 environment \supervisor Manolis G.H. Katevenis \examiner B.Sc. \addresses [email protected] \subject Remote DMA acceses \university University of Crete \department Computer Science Department \group Computer Architecture and VLSI Systems (CARV) Laboratory \faculty Institute of Computer Science (ICS), Foundation of Research and Technology - Hellas (FORTH) \deptname \univname B.Sc. Thesis \HRule \ttitle \HRule Author: \authorname Supervisor: Prof. \supname March 20, 2017 † † The thesis is submitted in fulfillment of the requirements for the degree of \degreename in the \deptname (CSD), \univname (UoC). It took place in the \groupname of the \facname , from June 2016 to December 2016 and was funded by the distinguished Undergraduate Scholarship ”Stelios Orphanoudakis” . \dedicatory Dedicated to the memory of a great, kind, smart and charming person and loyal friend to me, my grandmother Maria A. Psistaki (1925 - 2016). Acknowledgements. \addchaptertocentry \acknowledgementname The work for this thesis took place in the \groupname of the \facname , from June 2016 to December 2016 and was funded by the distinguished Undergraduate Scholarship "Stelios Orphanoudakis" . I would like to thank and give credit to a lot of people who helped me in many ways throughout the thesis. First of all, I would like to start by thanking my supervisor Professor \supname , who trusted me with such new, exciting and perhaps challenging task and advised me many times during the time I was working on my thesis. Then, I would like to thank Dr. Fabien Chaix. He was very supportive from the beginning of my thesis until the last day. We worked together in many parts of this thesis, like: Petalinux and booting Linux from our Trenz Boards, the theory of the IOMMU and the implementation of it (the kernel modules - Chapter 3 ). It was his suggestion, that parts (bits) of the StreamID are the AXI ID and the Master Device (in our tests, the HPC0 - Chapter 4 ). He also helped me with the understanding of how to use Vivado and SDK, in order to create our own Linux images. Dr. Chaix was actually involved in everything I was involved. I thank him for being patient with me and also for his advices and support. Also, I would like to thank Dr. Vassilis Papaefstathiou. We met almost at the end of my thesis, but we worked together in the understanding of the IOMMU (devices, groups, domains, SMR n , S2CR n etc), how it works and how we could "pass" the page table of a process to the SMMU. The focus of the work we did together was on the last kernel module (Chapter 3 ) – he explained me how the ioctl works and we investigated together the translation/context faults we had at first and we wanted to fix, before we manage to have a translation table of a user process in a context bank of the SMMU working. I thank him for his support and persistence in guiding me to become better. For the support in the first three kernel modules (Chapter 3 ), I would like to thank my colleague John Vardas. He helped me with debugging and also he did some changes/additions to some of the modules, that made them work more efficiently. In both SMMU modules (with transactions from the PS and the PL), he run many tests and helped us understand many things about the SMMU. I would like to thank Dr. Nikolaos Chrysos, for helping John Vardas and me, with the discussions we had in order to make the third kernel "module" (the module that allowed us to have a single-page transaction from the PL, using the SMMU) work. For the system software support, I would like to thank Dimitris Poulios (M.Sc.) and Charalampos Aronis. Dimitris helped us boot Linux from the QSPI and the SD Card of the Trenz board and he was always helping us, when we needed Linux support. Charalampos helped us understand the kernel environment and he was the person who gave me guidance, in order to use the IOMMU API and build our first SMMU module for testing purposes. For the hardware support, I would like to thank Konstantinos Harteros (M.Sc.), for the discussions we had because of his experience working with an IOMMU in the past, Antonis Psathakis (M.Sc.), for his support with Xilinx Vivado and SDK and Aggelos Ioannou (M.Sc.), for providing us the hardware files that we needed, in order to create our own Linux images and use them to boot from a Trenz board. I greatly appreciate the feedback that Dr. Fabien Chaix and Panos Peristerakis gave me for my thesis before I submit it. Last but not least and while I am hoping I did not forget to thank personally anyone that I

Read the complete text