Precomputed 1D-CNNs for Atrial Fibrillation Detection on Tiny Smart Sensor Systems
2026
Read Precomputed 1D-CNNs for Atrial Fibrillation Detection on Tiny Smart Sensor Systems (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-29994.txt.
Introduction
Lukas Einhaus, Natalie Maman, Julian Hoever, Andreas Erbslöh, and Gregor Schiele speed tiny nets by precomputing layer outputs into FPGA lookup tables. Lookup-table precomputation gives light nets with ultra-low latency but scales poorly, and depthwise-separable convolutions only partly fix scaling. The team generalizes to wider grouped convolutions, adds a new block, and guides block hyperparameters with an algorithm. On MIT-BIH heart data, the accelerators fit an AMD Spartan 7 S15, hitting up to ninety-five percent F1 with few thousand tables and no DSP or BRAM.
Catalog record
| YEAR | 2026 |
|---|---|
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 38796 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.29994
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Precomputed 1D-CNNs for Atrial Fibrillation Detection on Tiny Smart Sensor Systems Abstract 1D-CNNs play a crucial role for time-series analysis on tiny smart sensor systems, e.g. for biosignal analysis, predictive maintenance, or structural health monitoring. LUT-based precomputation has emerged as an interesting optimization technique to implement such neural networks on FPGAs. The core idea is to precompute all possible outputs of a neural network layer and store them directly in the lookup tables of the FPGAs. This enables highly resource-efficient networks with ultra-low latency but suffers from poor scalability. Previous work has explored using depthwise-separable convolutions to improve scalability. In this paper, we generalize this approach to consider additional forms of grouped convolutions. Based on this, we propose a novel type of convolutional block and an algorithm to guide the choice of hyper parameters for this block. We evaluate our approach on a medical time-series dataset for predicting atrial fibrillation using the MIT-BIH database (ECG recordings). The resulting hardware accelerators are small enough to be deployed on an AMD Spartan-7 S15. They achieve a F1-score of up to 95.6% while only requiring 2,844 LUTs and no DSPs or BRAM. I Introduction Smart sensor systems combine sensing technology with on-device machine learning to process sensor data locally. This enhances privacy, reaction time, and offline availability. One dimensional convolutional neural networks (1D-CNNs) have been shown to be a well suited machine learning approach for this, usable in a diverse set of application fields, such as structural health monitoring [ 6 ] , predictive maintenance [ 15 , 11 ] and various medical applications [ 17 , 18 , 22 , 20 ] . While transformer architectures gained a lot of traction in recent years, 1D-CNNs can still provide a more suitable trade-off between performance and resource requirements. Especially in very small sensor systems, transformer architectures can quickly exceed time or energy constraints [ 19 ] . To speed up the computation of 1D-CNNs, our work uses small-scale Field Programmable Gate Arrays (FPGAs) like the Spartan 7 S15 to implement efficient hardware accelerators [ 23 ] . FPGAs contain thousands of lookup tables (LUTs) that can implement small Boolean functions, e.g., a function with 4 or 6 inputs (each 1 bit) and an 1 bit output, depending on the selected FPGA. Together, these can emulate arbitrary hardware circuits, ranging, e.g., from adders and multipliers to whole CPUs. Our work goes one step further, making use of the fact that LUTs can reduce arbitrarily complex functions to a value lookup of constant time complexity. Using this, we precompute neural network components, such as a filter in a convolutional layer or a neuron in a linear layer and represent them as truth tables that can be stored in the FPGA’s LUTs. This is especially useful for ultra-low latency applications. The main challenge with this approach is to limit the exponential growth of the precomputed truth tables, which depends on the number of input bits to the implemented function. We will refer to this number as fan in. For a function with I inputs with a bitwidth of b , the resulting truth table is made up of 2^{b{\cdot}I} entries. Therefore, it is crucial to minimize fan in for each network component as much as possible. Previous work has resorted to random sparsity [ 34 , 3 ] or lossy function representations for dense neural networks [ 26 ] . For 1D-CNNs, previous work has used depthwise separable convolutions to reduce the fan in for precomputed convolutions [ 10 ] . This works well for small kernels but does not scale for more complex architectures. Therefore, it is necessary to explore more possibilities for replacing conventional convolutions. In this paper, we propose to use the more general concept of grouped convolutions [ 1 ] instead of depthwise separable convolutions. This can lead to extreme cost reductions while achieving similar accuracy. More specifically, we make the following contributions: • We propose a configurable grouped convolutional block to replace conventional dense convolutions. Such blocks can be used to split a convolution into a sequence of two convolutions that can be precomputed and represented with a small number of LUTs on FPGAs. • We introduce a score to rate the above-mentioned configurations wrt. network performance vs. resource consumption to help selecting favourable configurations without having to try out all possible configurations. • We provide an open source tool to generate synthesize-able hardware designs based on our approach and evaluate their performance on real hardware. The remainder of our paper is structured as follows. After a discussion of related work in Section II , we present our approach for precomputing 1D-CNNs on FPGAs in Section III . We evaluate our approach in Section IV using the MIT-BIH dataset [ 24 ] and conclude the paper in Section V . II Related Work In the following section, we discuss related work for LUT-based precomputation approaches in deep neural networks. A number of approaches tries to reduce the fan in of network components. LogicNets [ 34 ] shows an approach for networks composed of linear layers. The authors reduce area consumption by initializing neurons with random sparsity. PolyLUT [ 3 ] presents a generalization of LogicNets, replacing all computations between the input and output of a neuron by a single LUT. They consider not only linear transformations of the input data, but also polynomial ones, thus taking advantage of the fact that a LUT can represent arbitrary Boolean functions. The resulting model has a higher flexibility to fit the data, potentially needing fewer layers to represent the same function. The increase in LUT size is thus compensated by the layer savings which at the same time improves latency. Similarly, NeuraLUT [ 4 ] represents whole sub-networks by a single LUT. These sub-networks are composed of multiple fully-connected layers that use floating-point precision inside sub-nets, while keeping the cost low by using quantization and sparsity between sub-nets. Another set of approaches focusses on compressing truth tables of precomputed functions. Khatei et al. [ 16 ] decompose truth tables and combine the results during runtime using simple primitives. Others additionally record which input values can actually be observed during training and inject don’t care for everything else to increase the potential for compression [ 9 , 26 , 7 ] . Petersen et al. make networks composed of primitive binary logic gates (LGNs) differentiable, leading to ultra-sparse low complexity neural networks [ 28 ] and apply that approach to 2D-CNNs maintaining 80.17\text{\,}\% accuracy on CIFAR-10, while decreasing inference times by a factor of 160 [ 29 ] . Weightless neural networks (WNNs) [ 2 ] use RAM-Nodes (essentially truth tables) as building blocks for neural networks also during training. Consequently, they are typically not trained with gradient descent. Bacellar et al. extend the approach for differentiable logic gates from Petersen and apply it to WNNs to obtain differentiable WNNs (DWNs), improving accuracy compared to NeuraLUT, while reducing resource consumption roughly by a factor of up to 200. Nag et al. present a vision transformer (ViT) architecture incorporating DWNs [ 25 ] . While this improves accuracy from 57.5\text{\,}\% to 95.5\text{\,}\% on CIFAR-10 compared to Bacellar et al., it drastically increases the number of LUTs