A Comparison of the Cerebras Wafer-Scale Integration Technology with Nvidia GPU-based Systems for Artificial Intelligence
Yudhishthira Kundu, Manroop Kaur, Tripty Wig, Kriti Kumar, Pushpanjali Kumari, Vivek Puri, Manish Arora · 2025
Read A Comparison of the Cerebras Wafer-Scale Integration Technology with Nvidia GPU-based Systems for Artificial Intelligence by Yudhishthira Kundu, Manroop Kaur, Tripty Wig, Kriti Kumar, Pushpanjali Kumari, Vivek Puri, Manish Arora (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-11698.txt.
Introduction
Yudhishthira Kundu and co-authors compare two kinds of AI hardware in 2025: Cerebras wafer-scale chips and Nvidia graphics processors. The Cerebras engine builds many cores on one whole wafer rather than cutting it into chips. That design targets the memory and speed limits that slow AI training. The team weighs the newest Cerebras system against Nvidia's H100 and B200 chips.
They find the wafer system strong on speed per watt and on memory growth. They also flag costs in making, cooling, and keeping such large chips reliable. Their verdict is that wafer-scale designs can beat standard ones on several measures. Cost and long-term value remain open questions for buyers.
Catalog record
| CREATOR | Yudhishthira Kundu, Manroop Kaur, Tripty Wig, Kriti Kumar, Pushpanjali Kumari, Vivek Puri, Manish Arora |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 34 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-11698
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Comparison of the Cerebras Wafer-Scale Integration Technology with Nvidia GPU-based Systems for Artificial Intelligence Yudhishthira Kundu, Manroop Kaur, Tripty Wig, Kriti Kumar, Pushpanjali Kumari, Vivek Puri, Manish Arora Abstract Cerebras’ wafer-scale engine (WSE) technology merges multiple dies on a single wafer. It addresses the challenges of memory bandwidth, latency, and scalability, making it suitable for artificial intelligence. This work evaluates the WSE-3 architecture and compares it with leading GPU-based AI accelerators, notably Nvidia’s H100 and B200. The work highlights the advantages of WSE-3 in performance per watt and memory scalability and provides insights into the challenges in manufacturing, thermal management, and reliability. The results suggest that wafer-scale integration can surpass conventional architectures in several metrics, though work is required to address cost-effectiveness and long-term viability. Keywords: Wafer Scale Integration, WSE, GPU Hardware, AI Training, AI Inference 1 Introduction The growing complexity of artificial intelligence (AI) and machine learning (ML) workloads has necessitated advancements in computational hardware capable of addressing memory bandwidth, latency, and scalability challenges. Traditional multichip architectures have shown interchip communication bandwidth bottlenecks and added latencies, leading to the "Memory Wall" [ 24 ] [ 43 ] and prompting the exploration of novel architectures. To address these challenges, Nvidia has launched a series of GPU-based AI accelerators, such as the Hopper H100 [ 10 ] and the Blackwell B200 [ 37 ] . The H100 built in the TSMC 4nm process consists of 80 billion transistors. The H100 uses HBM3 memory with a capacity of 80 GB and 3 TB/s of bandwidth available. The integration of NVLink 4 supports up to 900 GB/s interconnect in multi-GPU systems. The B200 has 208 billion transistors fabricated in the TSMC 4 nm process, providing 20 PetaFLOPS of FP4 AI performance. It gives 8 TB/s Memory Bandwidth using 8-site HBM3e memories and 1.8 TB/s of bidirectional NVLink bandwidth. Another recent development by Nvidia is the integration of multiple dies within a single package to create a "Superchip." For example, the Nvidia GB200 Grace Blackwell superchip connects two B200 Tensor Core GPUs to the Grace CPU over a chip-to-chip interconnect [ 39 ] . This approach of integrating multiple-dies has existed for some time through the idea of "Wafer-Scale Integration (WSI)" [ 20 ] [ 30 ] . These systems integrate over a whole wafer, enabling much larger integration than a single die. For example, in 1980, Trilogy Systems [ 42 ] attempted to build an IBM-compatible mainframe using wafer-scale integration, producing a single chip that was 2.5 inches on one side. More recently, Cerebras Systems has made significant advancements by developing commercially viable [ 19 ] , large-scale wafer-scale processors specifically designed for AI applications. Cerebras’s "Wafer Scale Engine (WSE)" [ 21 ] [ 22 ] [ 23 ] is considered a leading example of the WSI technology. Approaches like the WSE interconnect dies on a wafer to reduce inter-chip communication delays and optimize power and performance. Die-2-die communication on a wafer inherently provides higher bandwidth and lower latency than off-die communication methods crossing transceivers and package boundaries, require additional power and introduce delays due to the physical separation between components. Cerebras first released a WSE product in 2019. The Wafer Scale Engine 1 (WSE-1) [ 8 ] was fabricated using TSMC’s 14nm technology and demonstrated the feasibility of WSI in AI processors. With a die size of 46,225 mm², the WSE-1 contained over 1.2 trillion transistors, 400,000 AI-optimized cores, and 18 GB of high-speed SRAM. It achieved a memory bandwidth of 9 petabytes per second, enabling it to handle large-scale AI workloads by minimizing inter-chip communication and associated latency and power costs. The next release, the Wafer Scale Engine 2 (WSE-2) [ 16 ] , was manufactured using TSMC’s 7nm technology and extended the capabilities of WSE-1. With 2.6 trillion transistors, 850,000 cores, and 40 GB of on-chip SRAM, the WSE-2 achieved a memory bandwidth of 20 petabytes per second and a fabric bandwidth of 220 petabits per second. The architecture retained the WSE-1’s single-wafer design while improving computational throughput and energy efficiency, making it suitable for replacing traditional GPU clusters in AI training and inference tasks. Most recently, the Wafer Scale Engine 3 (WSE-3) [ 9 ] was released in 2024. It was developed using the TSMC 5nm process and integrates 4 trillion transistors, 900,000 AI-optimized cores, and 44 GB of on-chip SRAM. It achieves a peak computing performance of 125 petaflops and a memory bandwidth of 21 petabytes per second. The WSE-3 is designed to support large language models with up to 24 trillion parameters, enabling its deployment in high-performance AI supercomputing systems. With increased attention around AI, WSI-based processors such as the Cerebras WSE offer a powerful alternative to Nvidia’s GPU-based systems [ 27 ] [ 38 ] . Hence it becomes important to evaluate these systems with each other and weigh their pros and cons. This paper thoroughly examines the CS-3 AI system [ 2 ] based on WSE-3 silicon. It focuses on its comparative study of architecture, computational performance, and key technological parameters with current SOTA (state-of-the-art) AI systems based on Nvidia GPUs. Please note that the Cerebras CS-3 is powered by the "Wafer Scale Engine 3" (WSE-3) chip, which is the core processing unit within the CS-3 system. In this paper, we may use the CS-3 and WSE-3 interchangeably. 2 Evaluation Framework The CS-3 product is designed for High-Performance AI training and inference. AI workloads bring their own set of unique bottlenecks and challenges for computing systems [ 32 ] [ 45 ] [ 46 ] . The main metrics impact performance are as follows. The section also explains why each of these metrics matters for AI workloads. We evaluate the metrics below to find out how WSE fares, and also what new challenges are being exposed by this approach. However, the evaluation must be done in the context of a system and not amongst un-equals, e.g., it is not fair to compare a WSE to a single GPU. This is because the goal of building a system is to pack more compute horsepower into a fixed physical footprint with lower power consumption and cooling costs. A typical AI Compute architecture is hierarchical, consisting of servers and racks. Typically, each server has 1 to 8 GPUs. Hence, each 42u data center rack has about 42 to 256 GPUs. The rack represents a fixed-size real estate to hold the compute capacity, and hence, to normalize the comparison we choose the rack as a point of granularity to make the evaluation i.e., a server rack designed with H100-based GPUs vs. a server rack built out of Cerebras WSE-3. In addition to making the comparison more meaningful, the ISO rack size performance is translated to performance per watt (perf/W) [ 28 ] . 2.1 Memory Bandwidth AI and deep learning workloads typically involve moving large volumes of data—whether it’s model weights, activation maps, or feature embeddings—between memory and compute units (CPUs, GPUs, or specialized accelerators) [ 15 ] . The rate at which data can be transferred (memory bandwidth) often becomes the bottleneck. Feeding the Compute Units : Even with powerful processors, if data cannot be supplied quickly enough, many cycles are spent idle waiting on data (a