GRAIL : Post-hoc Compensation by Linear Reconstruction for Compressed Networks
Wenwu Tang, Dong Wang, Lothar Thiele, Olga Saukh · 2026
Read GRAIL : Post-hoc Compensation by Linear Reconstruction for Compressed Networks by Wenwu Tang, Dong Wang, Lothar Thiele, Olga Saukh (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-23795.txt.
Description
Wenwu Tang and three co-authors present GRAIL, a post-hoc fix that restores accuracy after a neural network has been compressed. The 2026 paper targets aggressive pruning and folding, where accuracy loss usually forces retraining that may be costly or impossible without labeled data.
GRAIL needs no retraining and no labels. It runs a small calibration set through the network, sums hidden activations into a Gram matrix, and uses ridge regression to rebuild the original hidden signal from the compressed one. The rebuild map folds into later weights, so inference cost stays low. Across image and language models, GRAIL beats data-free and data-aware baselines in practical compression ranges, with modest overhead and no backpropagation.
Catalog record
| CREATOR | Wenwu Tang, Dong Wang, Lothar Thiele, Olga Saukh |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 37 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-23795