Learning Quantized Continuous Controllers for Integer Hardware

Fabian Kresse, Christoph H. Lampert · 2025

Read Learning Quantized Continuous Controllers for Integer Hardware by Fabian Kresse, Christoph H. Lampert (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-07046.txt.

Description

Fabian Kresse and Christoph H Lampert shrink continuous-control reinforcement learning policies until they run on integer-only hardware. Embedded deployments face tight latency and power budgets that small FPGAs can meet, but only if floating-point pipelines are avoided. The authors study quantization-aware training for such policies and build a learning-to-hardware pipeline that automatically selects low-bit policies and synthesizes them onto an Artix-7 FPGA.

Across five MuJoCo control tasks, the selected networks stayed competitive with full-precision policies while using as few as three, or even two, bits per weight and activation. That holds provided input precision was chosen carefully. On the chip they answered in microseconds and consumed microjoules per action, beating a quantized reference design. Unexpectedly, the quantized policies also resisted input noise better than the floating-point baseline.

Catalog record

CREATORFabian Kresse, Christoph H. Lampert
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE37 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-07046

Browse the full library · About the Tower of Babel