CiMBA: Accelerating Genome Sequencing through On-Device Basecalling via Compute-in-Memory

William Andrew Simon {}^{\hrefhttps://orcid.org/0000-0001-7357-7204}, Irem Boybat {}^{\hrefhttps://orcid.org/0000-0002-4255-8622}, Riselda Kodra {}^{\hrefhttps://orcid.org/0009-0001-6998-0698}, Elena Ferro {}^{\hrefhttps://orcid.org/0000-0002-8618-8643} · 2025

Read CiMBA: Accelerating Genome Sequencing through On-Device Basecalling via Compute-in-Memory by William Andrew Simon {}^{\hrefhttps://orcid.org/0000-0001-7357-7204}, Irem Boybat {}^{\hrefhttps://orcid.org/0000-0002-4255-8622}, Riselda Kodra {}^{\hrefhttps://orcid.org/0009-0001-6998-0698}, Elena Ferro {}^{\hrefhttps://orcid.org/0000-0002-8618-8643} (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-07298.txt.

Introduction

William Andrew Simon and co-authors present CiMBA, a 2025 chip design that reads DNA bases right on the sequencing device. Sequencers pour out up to half a gigabyte per minute, and the base-reading step eats over 40 percent of analysis time. Sending that data elsewhere adds cost and delay.

CiMBA computes inside memory, a design that keeps data still while math happens around it. A new family of analog-tuned reading networks pairs with the chip. The pair reads 4.77 million bases per second, far past the real-time need. It beats the best past embedded reader on energy and area by wide margins, at accuracy near top software readers. On-device reading could carry sequencing into clinics and field sites with ease.

Catalog record

CREATORWilliam Andrew Simon {}^{\hrefhttps://orcid.org/0000-0001-7357-7204}, Irem Boybat {}^{\hrefhttps://orcid.org/0000-0002-4255-8622}, Riselda Kodra {}^{\hrefhttps://orcid.org/0009-0001-6998-0698}, Elena Ferro {}^{\hrefhttps://orcid.org/0000-0002-8618-8643}
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE70 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-07298

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

CiMBA: Accelerating Genome Sequencing through On-Device Basecalling via Compute-in-Memory Thanks: This work was supported by European Union’s Horizon Europe Research and Innovation Program (BioPIM, Grant 101047160), and Swiss State Secretariat for Education, Research and Innovation (SERI) (Grant 22.00076). All authors except G. Singh are IEEE Members. R. Kodra and E. Ferro are Student Members. WA. Simon, I. Boybat, E. Ferro, S. Jain, H. Tsai, G. Burr, and A. Sebastian are affiliated with International Business Machines (IBM). R. Kodra was affiliated with IBM at time of writing and is currently affiliated with the Swiss Federal Institute of Technology, Lausanne. G. Singh is associated Advanced Micro Devices (AMD). M. Alser is associated with Georgia State University. Onur Mutlu is affiliated with the ETH, Zurich. William Andrew Simon {}^{\hrefhttps://orcid.org/0000-0001-7357-7204}, Irem Boybat {}^{\hrefhttps://orcid.org/0000-0002-4255-8622}, Riselda Kodra {}^{\hrefhttps://orcid.org/0009-0001-6998-0698}, Elena Ferro {}^{\hrefhttps://orcid.org/0000-0002-8618-8643} Abstract As genome sequencing is finding utility in a wide variety of domains beyond the confines of traditional medical settings, its computational pipeline faces two significant challenges. First, the creation of up to 0.5 GB of data per minute imposes substantial communication and storage overheads. Second, the sequencing pipeline is bottlenecked at the basecalling step, consuming >40% of genome analysis time. A range of proposals have attempted to address these challenges, with limited success. We propose to address these challenges with a Compute-in-Memory Basecalling Accelerator (CiMBA), the first embedded ( ∼ 25 \sim 25 mm 2 ) accelerator capable of real-time, on-device basecalling, coupled with AnaLog (AL)-Dorado, a new family of analog focused basecalling DNNs. Our resulting hardware/software co-design greatly reduces data communication overhead, is capable of a throughput of 4.77 million bases per second, 24 × \times that required for real-time operation, and achieves 17 × \times /27 × \times power/area efficiency over the best prior basecalling embedded accelerator while maintaining a high accuracy comparable to state-of-the-art software basecallers. I Introduction Advances such as rapid genetic disease diagnosis [ 1 ] , individually tailored precision therapies [ 2 ] , and preventive medicine [ 3 ] have all been realized in part due to plummeting costs as sequencing devices and applications mature [ 4 ] . As cost barriers to entry have disappeared, personalized genomics has seen rapid uptake in both urban areas [ 5 ] and rural communities [ 6 ] , and across a wide range of life science applications such as forensics [ 7 , 8 ] , and crop improvement [ 9 ] , with research occurring in increasingly remote areas, such as disused coalmines [ 10 ] and outer space [ 11 ] . As the application range increases, genome sequencing’s current limitations become more acute. In particular, Oxford Nanopore Technology’s (ONT’s) portable sequencing device, the MinION [ 12 ] , is capable of producing up to 0.46 GB of sequencing data per minute [ 13 ] . Transducing raw signal data into base nucleotide (e.g., A, C, G, or T) sequences involves a computationally expensive step called ”basecalling”. Modern basecalling algorithms incorporate Deep Neural Networks (DNNs), which improve accuracy yet can consume between 40% [ 14 ] (Tesla T4 GPU) and 86% [ 15 ] (24 CPU threads) of the total execution time of genome analysis. The MinION, ONT’s most portable device, lacks sufficient computational power to perform basecalling, necessitating constant connectivity to off-device storage and compute. The MinION Mk1C, with its integrated Jetson TX2 GPU, greatly increases sequencing portability. However, its compute power is barely sufficient for real-time basecalling [ 13 ] , and thus risks being overwhelmed by expected improvements in flow cell technology [ 16 ] . In general, advances in sequencing capability have far outpaced available computational power [ 17 ] . Introducing more compute in the form of CPUs/GPUs can only partially solve the problem, given the time and energy needed to move such massive amounts of data over to this compute [ 18 , 19 ] . Cloud computing faces its own unique challenges in terms of privacy [ 20 , 21 ] and security [ 22 ] . There is a need to process the raw data into nucleotide sequences in real-time, at the point of data generation, with high energy- and area efficiency. Many proposed solutions attempt to address basecalling computational complexity [ 23 , 24 , 25 , 26 , 27 , 14 , 28 , 29 ] , reduce its memory footprint [ 30 , 31 ] , further accelerate it via GPU [ 32 , 26 , 33 , 34 , 35 , 36 , 37 ] , FPGA [ 23 , 25 ] , TPU [ 38 ] , or spatial architectures such as AMD-Xilinx’s Versal AI Engine [ 26 ] or in-memory computing [ 27 , 14 , 39 , 40 ] . Other works have focused on utilizing ONT’s ”read-until” feature, which allows ”unwanted” reads to be terminated mid-sequence [ 41 , 42 , 43 , 44 , 45 , 46 ] . Yet other works propose eliminating basecalling entirely, extracting insights relevant for certain tasks directly from raw data [ 47 ] . While these works address some challenges facing modern genomics, each leaves aspects unresolved. Works utilizing traditional accelerators (e.g. GPUs) improve throughput yet fail to address data movement overhead, and require energy-hungry, non-portable, and expensive hardware. Similarly, energy-inefficient FPGA proposals have been applied only on older algorithms that lack DNN basecallers’ improved accuracies while falling severely short of the throughput requirements for real-time basecalling [ 13 ] . Finally, ”read until” and basecall-free approaches have limited applicability; in contrast, real-time basecalling accelerates every genome analysis pipeline. Thus, this work seeks to address the challenges brought about by large sequencing data, by tightly coupling real-time basecalling with sequencing on the same edge device. To this end, we introduce a Compute-in-Memory Basecalling Accelerator ( CiMBA ), the most energy and area efficient basecalling accelerator demonstrated thus yet, capable of real-time basecalling within a small area/power envelope. CiMBA processes raw sequencing data via a deeply-pipelined dataflow architecture, while flexibly supporting a wide range of basecalling DNNs. Through the use of Non-Volatile Memory (NVM) crossbar arrays, CiMBA achieves SotA energy and area efficiency by eliminating all DNN weight motion and enabling highly parallel (up to 262K per tile) MAC operations, enabling basecalling exceeding the rate of data generation. CiMBA uses a 2D mesh to efficiently transport data-vectors between NVM-arrays that store weight values and perform Vector-Matrix Multiplications (VMMs) and digital processing units for activation functions. With a capacity of 2.9M weights, CiMBA can easily handle a range of networks, including Dorado-Fast (0.47M weights), ONT’s SotA lightweight basecaller. CiMBA is also equipped with a LookAround Decoder, implementing a novel hardware/latency-conservative decoding strategy that enables high throughput. Sufficient DNN accuracy can be maintained despite analog induced noise through careful preparation [ 48 ] and programming [ 49 , 50 ] of DNN weights. CiMBA provides four significant advantages over existing works: (1) greatly reduced power (1.17W) and (2) area ( 25 mm 2 ) requirements, (3) >40 \times less device-to-workstation communication overhead, and (4) real-time, on-chip DNN-based basecalling. As a result, this accelerator enables a wide variety of applications, ranging from partial basecalling (using ”read-until”) [ 46 ] to full basecalling, including metagenomics [ 51 ] ,

Read the complete text