Attention Consistency Regularization for Interpretable Early-Exit Neural Networks

Yanhua Zhao · 2026

Read Attention Consistency Regularization for Interpretable Early-Exit Neural Networks by Yanhua Zhao (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-08891.txt.

Description

Yanhua Zhao works on nets that can give a fast reply from a mid layer, not just the last layer. Such early exit nets save time and power. But a mid reply may rest on odd cues that a deep reply would not use. Users then can not trust or grasp the fast reply, even when it is right.

Zhao gives a train method called EGT. It adds a rule that keeps the focus of each layer in line. If a mid layer looks at the same cues as deep layers, its reply is more easy to trust. The method trains for true marks and for firm focus at the same time. A reader who needs fast nets gets both speed and a clear view of the choice.

Catalog record

CREATORYanhua Zhao
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE9 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-08891

Browse the full library · About the Tower of Babel