An Improved Template for Approximate Computing

Morteza Rezaalipour, Francesco Costa, Marco Biasion · 2025

Read An Improved Template for Approximate Computing by Morteza Rezaalipour, Francesco Costa, Marco Biasion (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-06162.txt.

Introduction

Smaller arithmetic circuits for neural networks, bought with a sliver of accuracy, are the goal of an improved approximate computing method in a 2025 paper led by Morteza Rezaalipour with five co-authors. Edge devices must balance inference energy against classification accuracy, and approximate computing trades a little of the second for a lot of the first. The team improves a Boolean rewriting technique called XPAT.

Their change is a new tunable template based on product sharing, designed so template parameters track the area of the built circuit closely. Experiments show the method converges better toward low-area solutions and finds stronger approximations than the original XPAT and two other leading approaches, at the same accuracy loss. The target operators are the small adders and multipliers neural networks use everywhere.

Catalog record

CREATORMorteza Rezaalipour, Francesco Costa, Marco Biasion
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE15 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-06162

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

An Improved Template for Approximate Computing Thanks: Morteza Rezaalipour, Francesco Costa, Marco Biasion, Rodrigo Otoni, and Laura Pozzi are all with the Faculty of Informatics, Università della Svizzera italiana, Lugano, Switzerland (e-mail: [email protected]; [email protected]; [email protected]; [email protected]; [email protected]). Thanks: George A. Constantinides is with the Faculty of Engineering, Imperial College London, London, UK (e-mail: [email protected]). Thanks: This work was partially supported by the Swiss National Science Foundation via grant 200020_188613. Morteza Rezaalipour, Francesco Costa, Marco Biasion Abstract Deploying neural networks on edge devices entails a careful balance between the energy required for inference and the accuracy of the resulting classification. One technique for navigating this tradeoff is approximate computing: the process of reducing energy consumption by slightly reducing the accuracy of arithmetic operators. In this context, we propose a methodology to reduce the area of the small arithmetic operators used in neural networks – i.e., adders and multipliers – via a small loss in accuracy, and show that we improve area savings for the same accuracy loss w.r.t. the state of the art. To achieve our goal, we improve on a boolean rewriting technique recently proposed, called XPAT, where the use of a parametrisable template to rewrite circuits has proved to be highly beneficial. In particular, XPAT was able to produce smaller circuits than comparable approaches while utilising a naive sum of products template structure. In this work, we show that template parameters can act as proxies for chosen metrics and we propose a novel template based on parametrisable product sharing that acts as a close proxy to synthesised area. We demonstrate experimentally that our methodology converges better to low-area solutions and that it can find better approximations than both the original XPAT and two other state-of-the-art approaches. I Introduction The deployment of nn on edge devices entails a careful balance between the energy required for inference and the accuracy of the resulting classification. Small-bitwidth operators are often employed in nn in order to limit required energy, e.g., 4-bit multipliers are used in [ 1 ] , and the capability to further reduce energy consumption by approximating such operators while minimally reducing their accuracy is critical. Approximate computing is a design paradigm which helps navigating this tradeoff, dictating that inexact hardware should be used whenever a loss in accuracy can be tolerated, in order to achieve improvements in metrics such as circuit area and energy consumption. In the context of nn , efficient approximation of the employed arithmetic circuits, notably multipliers, is key to achieving good-enough inference results while keeping energy consumption at bay [ 2 ] . The process of deriving an approximate circuit from an exact circuit and a tolerated maximum et ( et ) is termed als ( als ). Extensive work has been done in the last decade towards improving als [ 3 , 4 , 5 , 6 , 7 , 8 , 9 ] , but effectively exploiting the full flexibility allowed by the given et is still a challenge. The recently proposed Boolean rewriting algorithm XPAT [ 10 ] was shown to be able to find valid high-quality optimisation candidates for a variety of arithmetic circuits. XPAT makes use of a parametrisable template to represent the design space of potential optimisations and employs a smt ( smt ) solver to traverse this large design space. The template proposed consisted of a sum of products, with the role of the solver being to identify, for every circuit output, which products of which input literals must be included in the synthesised circuit. The choice of template has a significant effect on optimisation quality, since its parameters essentially guide XPAT ’s design space traversal. Thus, a good template structure is crucial. In particular, a template whose parameters act as a close proxy for the metric of interest is likely to yield the best results. In light of this, we propose a novel parametrisable template for als which is capable of sharing products’ outputs among many sums as a means of avoiding low-quality optimisations during the search . Our template’s parameters regulate the inclusion and sharing of products and allow for fine-grained control of solver-based synthesis. We implemented our methodology and compared it against the original version of XPAT and the state-of-the-art methods MUSCAT [ 8 ] and MECALS [ 9 ] . The results indicate that our shared template acts as a better proxy for circuit area than the original template, and that it yields better adder and multiplier approximations than all compared approaches. To summarise, our contributions are the following: (1) A novel parametrisable sum of products template for als based on the sharing of products outputs. (2) A study showing that templates’ parameters can act as proxies for metrics of interest such as circuit area. (3) An open-source implementation of the proposed methodology instrumented with our novel template. (4) An evaluation showcasing that our novel template acts as a good proxy for circuit area and yields better approximations than state-of-the-art approaches. II Templates We introduce the background needed by providing a summary of XPAT , followed by details of its original template. Then, we present the shared template proposed in this paper. II-A XPAT Algorithm The algorithm frames the design space exploration in terms of smt formulas, whose solving leads to the setting of the template’s parameters in such a way that the approximate circuit respects the given et . Concretely, an error miter is used, which consists of the exact circuit, the parametrisable template for approximation, two functions used for error estimation, and a query, as illustrated in Fig. 1 . Function map does the mapping from the output of each circuit to an interpretation of the Boolean values and function dist does the measurement of the distance between the mapped outputs of the exact and approximate circuits. The query asks the solver if the template parameters can be instantiated in a way that, for all possible input combinations, the distance between the exact and approximate outputs does not exceed the et . A satisfiable result will be accompanied by an assignment to p that ensures that the approximate circuit always respects the et . Fig. 1 : Miter for XPAT [ 10 ] . II-B Nonshared Template The template originally used by XPAT consists of nonshared sums of products, with each sum dictating the value of one output and the parameters deciding which products of which inputs should be included in each sum, as illustrated in Fig. 2 . Formally, consider a given circuit with n inputs, in_{1},...,in_{n} , and m outputs, out_{1},...,out_{m} . The behaviour of each output out_{i} is formalised as follows: \displaystyle out_{i}=\bigvee_{k\in\{1...K\}}Prod_{k} (1) where K is the number of products included in each sum, Prod_{k} is a product of selected inputs, and 1\leq i\leq m . Each product Prod_{k} has n inputs, originating from n multiplexers. Each multiplexer decides, based on parameter p_{k}^{j} , if input in_{j} is used as is, is negated, or is replaced by the constant 1 , with 1\leq j\leq n ; the usage of constant 1 indicates that the respective input is ignored by the product 1 1 1 Note that the multiplexers are not a part of the generated circuit, since the selected

Read the complete text