Lost and Found in Translation: Variational Diagnostics for Neural Codebook Channels

Yusuke Hayashi · 2026

Read Lost and Found in Translation: Variational Diagnostics for Neural Codebook Channels by Yusuke Hayashi (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-18846.txt.

Introduction

Yusuke Hayashi diagnoses a quiet failure in variational autoencoders, where the decoder may read latent codes not as the encoder wrote them. Standard checks confirm only that a code is used, never that both halves agree on its meaning. His codebook channel measures that agreement, backed by a bound on disagreement drawn from the variational gap. Audits on small datasets, a two-dimensional model, MNIST and a quantized model show the bound holding, exposing mismatches that simple counts cannot reveal.

Catalog record

CREATORYusuke Hayashi
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE123189
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.18846

Browse the full library · About the Tower of Babel