Boundary-Protection W8A8 HiFloat8 Quantization for Large-Scale Text-to-Video Diffusion Transformers
Yiming Zhao · 2026
Read Boundary-Protection W8A8 HiFloat8 Quantization for Large-Scale Text-to-Video Diffusion Transformers by Yiming Zhao (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-00957.txt.
Description
Zhao squeezes a giant video model into low-precision numbers in this 2026 paper. The target is Wan2.1-T2V-14B, a 14-billion-parameter text-to-video diffusion transformer. His format is W8A8 HiFloat8, run on Ascend 910B chips. A block-by-block scan of all 40 attention blocks shows a split: edge blocks act unlike middle ones.
Uniform quantization would bruise those edge blocks. His fix protects the boundary: the first two and last three blocks stay in BF16. The other 35 blocks take the eight-bit format. On five VBench dimensions, the quantized model matches or edges its full-precision base, within a small five-prompt set. A four-way ablation backs the full protection as the best pick. He also tests quantization-aware training as a second stage. On single-card hardware it fails to beat plain post-training quantization, he reports.
Catalog record
| CREATOR | Yiming Zhao |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 16 KB |
| LICENSE | http://creativecommons.org/licenses/by-sa/4.0/ |
| RIGHTS | CC BY SA |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.00957