Enhancing CGRA Efficiency Through Aligned Compute and Communication Provisioning Conference: Proceedings of the 30th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 2; March 30-April 3, 2025; Rotterdam, Netherlands Proceedings of the 30th

Zhaoying Li, Pranav Dangi, Chenyang Yin, Thilini Kaushalya Bandara, Rohan Juneja, Cheng Tan, Zhenyu Bai, Tulika Mitra · 2024

Read Enhancing CGRA Efficiency Through Aligned Compute and Communication Provisioning Conference: Proceedings of the 30th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 2; March 30-April 3, 2025; Rotterdam, Netherlands Proceedings of the 30th by Zhaoying Li, Pranav Dangi, Chenyang Yin, Thilini Kaushalya Bandara, Rohan Juneja, Cheng Tan, Zhenyu Bai, Tulika Mitra (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-08137.txt.

Introduction

Zhaoying Li and co-authors present a 2024 arXiv paper on reconfigurable chip accelerators for edge devices. These arrays, called CGRAs, often carry far more wiring for data movement than their modest compute units can use, wasting power and area. The team argues that the excess comes from planning for flexibility that real programs never need.

Their design, Plaid, splits each program's dataflow graph into small recurring patterns called motifs. A new collective unit runs a motif's operations and routes its data together, and the compiler maps the graph by motif levels. Against a high-performance baseline, Plaid cut power by 43 percent and area by 46 percent at the same speed.

Catalog record

CREATORZhaoying Li, Pranav Dangi, Chenyang Yin, Thilini Kaushalya Bandara, Rohan Juneja, Cheng Tan, Zhenyu Bai, Tulika Mitra
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE40 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-08137

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Enhancing CGRA Efficiency Through Aligned Compute and Communication Provisioning Conference: Proceedings of the 30th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 2; March 30-April 3, 2025; Rotterdam, Netherlands Proceedings of the 30th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 1 (ASPLOS ’25), March 30-April 3, 2025, Rotterdam, Netherlands DOI: 10.1145/3669940.3707230 ISBN: 979-8-4007-0698-1/25/03 CCS: Computer systems organization Multicore architectures CCS: Reconfigurable computing CCS: Data flow architectures Zhaoying Li, Pranav Dangi, Chenyang Yin, Thilini Kaushalya Bandara, Rohan Juneja, Cheng Tan, Zhenyu Bai, Tulika Mitra Abstract . Coarse-grained Reconfigurable Arrays (CGRAs) are domain-agnostic accelerators that enhance the energy efficiency of resource-constrained edge devices. The CGRA landscape is diverse, exhibiting trade-offs between performance, efficiency, and architectural specialization. However, CGRAs often overprovision communication resources relative to their modest computing capabilities. This occurs because the theoretically provisioned programmability for CGRAs often proves superfluous in practical implementations. In this paper, we propose Plaid , a novel CGRA architecture and compiler that aligns compute and communication capabilities, thereby significantly improving energy and area efficiency while preserving its generality and performance. We demonstrate that the dataflow graph, representing the target application, can be decomposed into smaller, recurring communication patterns called motifs . The primary contribution is the identification of these structural motifs within the dataflow graphs and the development of an efficient collective execution and routing strategy tailored to these motifs. The Plaid architecture employs a novel collective processing unit that can execute multiple operations of a motif and route related data dependencies together. The Plaid compiler can hierarchically map the dataflow graph and judiciously schedule the motifs. Our design achieves a 43% reduction in power consumption and 46% area savings compared to the baseline high-performance spatio-temporal CGRA, all while preserving its generality and performance levels. In comparison to the baseline energy-efficient spatial CGRA, Plaid offers a 1.4 × \times performance improvement and a 48% area savings, with almost the same power. † † cc-license: by 1. Introduction The surge in new applications like Machine Learning has led to the rapid development of accelerators tailored to specific domains or frequently used computational kernels ( dally2020domain ) . Although these specific accelerators excel in performance and power efficiency, edge devices cannot accommodate or utilize many accelerators due to strict power and area constraints ( hadi2011dark ; wall2019fuchs ) . Coarse-grained Reconfigurable Arrays (CGRAs) ( li2022coarse ; sustainable-cgras ) offer a balanced solution for performance, efficiency, and programmability, making them ideal for edge acceleration. Several academic ( mei2003adres ; karunaratne2017hycube ; nowatzki2017stream ; weng2020hybrid ; torng2021ultra ; tan2021arena ; tan2021aurora ; dadu2021polygraph ; gobieski2022riptide ; serafin2023pipestitch ; melchert2023apex ; feng2023amber ; tan2023vecpac ; voitsechov2018inter ; li2021chordmap ; li2022lisa ; tan2024micro ; wu2023flip ; wijerathne2019cascade ; wijerathne2021himap ; wijerathne2022panorama ; wijerathne2022morpher ; wijerathne2023accelerating ) and commercial ( kim2014ulp ; fleming2020processors ; fujii2018drp ; prabhakar2017plasticine ) CGRA architectures have been proposed over the years. A typical CGRA consists of an array of Processing Elements (PEs) connected by an on-chip network (NoC). Each PE comprises a computing unit (typically an ALU), registers to store the temporal data, a router for interconnections, and a configuration memory to store the instructions statically generated by the compiler for the above hardware modules. The compiler maps the target application, represented by a Dataflow Graph (DFG), onto the CGRA. Computing units execute the DFG nodes, while routers and registers handle the data dependency, i.e., the edges representing communication among these nodes. The existing landscape of CGRAs navigates trade-offs between performance, efficiency, and generality, where generality refers to the versatility of the scope of target applications or kernels that can be mapped onto the architecture. As shown in Table 1 , existing CGRAs fall into three main categories: spatio-temporal CGRAs, spatial CGRAs, and specialized CGRAs. CGRA Architecture Performance Energy Efficiency Generality Spatio-temporal High Low High UE-CGRA ( torng2021ultra ) , HyCUBE ( karunaratne2017hycube ) ADRES ( mei2003adres ) , MorphoSys ( singh2000morphosys ) Spatial Medium* or High High Medium SNAFU ( gobieski2021snafu ) , Riptide ( gobieski2022riptide ) Specialized High or Ultra-High High Low REVAMP ( revamp ) , REVEL ( weng2020hybrid ) VecPac ( tan2023vecpac ) , APEX ( melchert2023apex ) Ours (Plaid) High High High * Performance degrades when partitioning complex DFGs to be mapped spatially Table 1. Reconfigurable architecture landscape A spatio-temporal architecture allows each PE to reconfigure to a new instruction every cycle, offering higher flexibility. This means that the ALU in each PE can execute a new operation and send the data to a new neighbour every cycle. In contrast, a purely spatial architecture relies on spatial dataflow-based mapping for a code segment, maintaining a fixed configuration of compute and communication during the execution of that segment. Theoretically, a higher degree of reconfigurability enhances flexibility at the cost of higher power consumption. On the other hand, fully spatial mapping ensures extremely low power consumption but with possibly lower performance. Specialized CGRAs, in contrast to the prior ones, are optimized or tuned for a particular application suite or domain. These optimizations are only suitable for a relatively narrow scope of applications and can render the CGRA to be less efficient for others, thereby reducing their versatility. An ideal CGRA would achieve good performance and efficiency while still preserving generality. Existing works intrinsically facilitate effective execution at the granularity of a single DFG node on a PE. However, they lack insight into the alignment between communication and computation for the collective execution of the entire DFG. First, each PE pairs the ALU with a router designed with adequate degrees of freedom to allow each ALU to individually communicate with any other ALU around it through the NoC. Such highly powerful routers help PEs handle peak routing congestion. An unforeseen consequence is that total communication resources are largely overprovisioned compared to the compute capabilities of the CGRA. This is because such congestion is only faced intermittently throughout total execution. Second, as each PE typically executes one node at a time, the inherent individuality in execution renders the programmability less efficient. For example, even simple inter-PE communication, corresponding to a single edge between two DFG nodes, necessitates configuring at least two routers. This bloats the configuration memory, contributing to 48% of the overall power consumption as shown in Figure 2 (a). With the aforementioned resource over-provisioning, the programmability becomes extremely costly. Figure 1. Overview of Plaid co-designed architecture and compiler A straightforward approach to the realignment would be trimming communication resources to a bare minimum. While this strategy is conceptually simple, it can hinder reconfigurability in the architecture and degrade the performance. Therefore, a more nuanced solution should hypothetically involve redesigning the fundamental blocks of the CGRA architecture and the compiler. This redesign should collectively align compute and communication provisioning and improve efficiency while maintaining programmability, considering the inherent characteristics of DFGs and hardware. Goal and Approach: In this work, we propose a next-gen CGRA architecture and compiler, named Plaid , with a hierarchical execution paradigm to address the aforementioned limitation. Plaid 1 1 1 Despite the fundamental change in CGRA design, Plaid is still a spatio-temporal CGRA. When we refer to spatio-temporal CGRA in this paper, we refer to the typical design of spatio-temporal CGRAs. aims

Read the complete text