Amortized-Precision Quantization for Early-Exit Vision Transformers
Rui Fang, Hsi-Wen Chen, Ming-Syan Chen · 2026
Read Amortized-Precision Quantization for Early-Exit Vision Transformers by Rui Fang, Hsi-Wen Chen, Ming-Syan Chen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-07317.txt.
Description
Rui Fang, Hsi-Wen Chen, and Ming-Syan Chen make vision transformers cheaper to run by combining low-precision math with early exits. Quantization noise can upset exit choices and amplify errors along shifting paths, because existing methods assume the full network always runs. Their framing accounts for how often each layer actually faces that noise.
A two-level system then tunes exit thresholds and bit widths together under clear risk control. The result improves the accuracy-speed frontier, cutting the math load sharply while holding accuracy. Across sorting, spotting, and outlining tasks, it beat strong rivals by wide margins, offering a sturdier route to deploying such models on limited hardware.
Catalog record
| CREATOR | Rui Fang, Hsi-Wen Chen, Ming-Syan Chen |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 58 KB |
| LICENSE | http://creativecommons.org/licenses/by-sa/4.0/ |
| RIGHTS | CC BY SA |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.07317