MARCO: Hardware-Aware Neural Architecture Search for Edge Devices with Multi-Agent Reinforcement Learning and Conformal Prediction Filtering

Arya Fayyazi 1 , Mehdi Kamal 1 , Massoud Pedram 1 · 2025

Read MARCO: Hardware-Aware Neural Architecture Search for Edge Devices with Multi-Agent Reinforcement Learning and Conformal Prediction Filtering by Arya Fayyazi 1 , Mehdi Kamal 1 , Massoud Pedram 1 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-13755.txt.

Introduction

Arya Fayyazi, Mehdi Kamal, and Massoud Pedram speed the search for neural networks that fit small edge devices, in a 2025 paper. Hand-tuning a network for each chip is slow, and popular search methods first train a huge supernet, which costs dearly. Their frame, MARCO, skips the supernet and splits the search between two learning agents that share one reward.

One agent sets the broad design, and the other picks the bit width of each layer under strict memory and speed budgets. A stand-in model with calibrated error bars prunes weak designs early, before costly trial training or chip simulation. That filter, the authors say, cuts search time a lot while keeping accuracy under tight hardware limits.

Catalog record

CREATORArya Fayyazi 1 , Mehdi Kamal 1 , Massoud Pedram 1
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE45 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-13755

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

MARCO: Hardware-Aware Neural Architecture Search for Edge Devices with Multi-Agent Reinforcement Learning and Conformal Prediction Filtering Arya Fayyazi 1 , Mehdi Kamal 1 , Massoud Pedram 1 Abstract This paper introduces MARCO (Multi-Agent Reinforcement learning with Conformal Optimization), a novel hardware-aware framework for efficient neural architecture search (NAS) targeting resource-constrained edge devices. By significantly reducing search time and maintaining accuracy under strict hardware constraints, MARCO bridges the gap between automated DNN design and CAD for edge AI deployment. MARCO’s core technical contribution lies in its unique combination of multi-agent reinforcement learning (MARL) with Conformal Prediction (CP) to accelerate the hardware/software co-design process for deploying deep neural networks. Unlike conventional once-for-all (OFA) supernet approaches that require extensive pretraining, MARCO decomposes the NAS task into a hardware configuration agent (HCA) and a Quantization Agent (QA). The HCA optimizes high-level design parameters, while the QA determines per-layer bit-widths under strict memory and latency budgets using a shared reward signal within a centralized-critic, decentralized-execution (CTDE) paradigm. A key innovation is the integration of a calibrated CP surrogate model that provides statistical guarantees (with a user-defined miscoverage rate) to prune unpromising candidate architectures before incurring the high costs of partial training or hardware simulation. This early filtering drastically reduces the search space while ensuring that high-quality designs are retained with a high probability. Extensive experiments on MNIST, CIFAR-10, and CIFAR-100 demonstrate that MARCO achieves a 3–4× reduction in total search time compared to an OFA baseline while maintaining near-baseline accuracy (within 0.3%). Furthermore, MARCO also reduces inference latency. Validation on a MAX78000 evaluation board confirms that simulator trends hold in practice, with simulator estimates deviating from measured values by less than 5%. I Introduction Edge computing has shifted a substantial fraction of inference workloads from data centers to resource‑constrained devices (microcontrollers, low‑power DSPs, and emerging TinyML accelerators) where on‑chip memory rarely exceeds a few hundred kilobytes and energy budgets restrict inference latency to tens of milliseconds. Early solutions relied on expert‑driven pruning and architecture slimming, leading to streamlined networks such as SqueezeNet [ 23 ] , MobileNet [ 24 ] , and ShuffleNet [ 25 ] . As edge applications diversified, designers turned to hardware‑aware neural‑architecture search (HWNAS) to automate this process, allowing algorithms, rather than humans, to navigate the vast combinatorial design space while respecting device constraints. Representative milestones include MnasNet’s single agent reinforcement learning approach that embeds latency penalties in the reward function [ 3 ] , FBNet’s differentiable relaxation that predicts latency through a proxy model [ 32 ] , and the Once‑for‑All (OFA) supernet paradigm that trains a universe of subnets in a single monolithic graph [ 1 ] . These paradigms delivered compelling efficiency gains on mobile CPUs and GPUs, but translating them to ultraconstrained edge hardware revealed new bottlenecks. Despite advances in HWNAS and their potential to reduce inference latency, several limitations hinder their effective deployment on edge devices. OFA‑style supernets demand days of GPU time for pre‑training [ 1 ] ; any change in the target memory or latency budget requires re-specialization, which is incompatible with the rapid iteration cycles typical of computer‑aided design (CAD) flows [ 17 ] . Furthermore, most previous searches entangle macro-architecture choices (e.g., layer depth, kernel size, channel width) with quantization policies within a single action space [ 1 , 32 ] ; the resultant explosion of dimensions hampers exploration of mixed precision designs that are crucial for squeezing models into sub-megabyte memory footprints [ 18 ] . Moreover, evaluation remains the dominant cost: each sampled sub‑network generally undergoes partial training to estimate accuracy and is then profiled on a hardware simulator [ 3 , 2 ] , yet a significant fraction ultimately violates resource limits, wasting compute on hopeless candidates. Accelerator‑specific heuristics [ 32 , 19 ] and proxy cost models [ 20 ] mitigate this burden, but do not offer statistical guarantees that near‑optimal architectures survive the pruning stage [ 5 ] . To address these challenges, we introduce MARCO ( Multi‑Agent Reinforcement learning with Conformal Optimization ), a hardware-aware NAS framework tailored to a multiplicity of devices with stringent memory and latency constraints. MARCO decomposes the design task into multiple cooperative agents operating under a centralized-critic, decentralized-execution paradigm: for example, a hardware‑configuration agent sets macro-level topology parameters, while a quantization agent assigns per-layer bitwidths, thereby enabling fine-grained mixed-precision implementation without incurring the combinatorial blow‑up of a flat search. Candidate networks produced by these agents are screened by a calibrated conformal prediction surrogate function that provides distribution‑free confidence upper bounds on reward; architectures whose bounds fall below a user‑defined threshold are rejected before any training or simulation. This principled pruning strategy removes roughly one quarter of the search space while guaranteeing, with probability at least 1-\delta , that high-quality designs are retained. Extensive experiments on vision benchmarks such as MNIST [ 16 ] , CIFAR10, and CIFAR100 [ 21 ] demonstrate that MARCO cuts the total search time by three to four times relative to the OFA baselines, while maintaining accuracy within 0.3% of the best previous methods. Because MARCO interfaces only with abstract latency and memory queries supplied by the target toolchain, it remains portable across a spectrum of microcontrollers and (low-end) edge accelerators. This work claims several key novelties: 1. It presents the first multi-agent hardware-aware NAS (HW-NAS) formulation that explicitly decouples architecture optimization and data quantization for edge devices. 2. It introduces a conformal prediction filter that offers provable coverage guarantees while drastically reducing the evaluation cost. 3. It delivers a modular hardware implementation that integrates seamlessly with standard TinyML toolchains by interfacing only with abstract latency and memory queries to achieve state‑of‑the‑art search efficiency on various FPGA devices. II Preliminaries and Related Work This section provides a comprehensive background on the key concepts and literature that form the foundation of our proposed MARCO ( MAR l + C onformal O ptimization) approach for HWNAS on microcontrollers. We first introduce the fundamentals of multi-agent reinforcement learning (MARL) and the centralized training–decentralized execution (CTDE) paradigm, which effectively decouples high-dimensional design decisions. We then present the principles of Conformal Prediction (CP), emphasizing its capability to provide rigorous coverage guarantees for resource-constrained applications. Finally, we review and compare related NAS and CAD-oriented techniques, including MCUNet, MnasNet, FBNet, ProxylessNAS, and AutoTVM, as well as complementary toolchains such as MaximAI and HLS4ML, highlighting how MARCO differs by integrating multi-agent RL with CP-based early filtering under strict hardware constraints. II-A Multi-Agent Reinforcement Learning (MARL) and CTDE Standard reinforcement learning (RL) typically involves a single agent that learns to maximize a cumulative reward by interacting with an environment [ 26 ] . However, complex design tasks (such as HWNAS) often entail managing both macro-level architectural decisions (e.g., layer counts, kernel sizes, channel widths) and micro-level parameters (e.g., bit-width quantization). In this context, a single agent must operate over an intractably large action space. Multi-agent reinforcement learning (MARL) alleviates this problem by decomposing the decision space among multiple agents, each responsible for a subset of the overall action space [ 27 , 28 ] . A widely adopted MARL framework is the paradigm centralized training–decentralized execution (CTDE) [ 29 , 30 , 31 ] . During training, a centralized critic observes the complete state of the

Read the complete text