Learning Quantized Continuous Controllers for Integer Hardware
Fabian Kresse, Christoph H. Lampert · 2025
Read Learning Quantized Continuous Controllers for Integer Hardware by Fabian Kresse, Christoph H. Lampert (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-07046.txt.
Description
Fabian Kresse and Christoph H Lampert shrink continuous-control reinforcement learning policies until they run on integer-only hardware. Embedded deployments face tight latency and power budgets that small FPGAs can meet, but only if floating-point pipelines are avoided. The authors study quantization-aware training for such policies and build a learning-to-hardware pipeline that automatically selects low-bit policies and synthesizes them onto an Artix-7 FPGA.
Across five MuJoCo control tasks, the selected networks stayed competitive with full-precision policies while using as few as three, or even two, bits per weight and activation. That holds provided input precision was chosen carefully. On the chip they answered in microseconds and consumed microjoules per action, beating a quantized reference design. Unexpectedly, the quantized policies also resisted input noise better than the floating-point baseline.
Catalog record
| CREATOR | Fabian Kresse, Christoph H. Lampert |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 37 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-07046