Shannon weights for binary dynamical recurrent sources of zero entropy
Ali Akhavi, Eda Cesaratto, Frédédric Paccaut, Pablo Rotondo and Brigitte Vallée · 2025
Read Shannon weights for binary dynamical recurrent sources of zero entropy by Ali Akhavi, Eda Cesaratto, Frédédric Paccaut, Pablo Rotondo and Brigitte Vallée (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-03538.txt.
Description
Some information sources remember everything: the odds of the next symbol can depend on the whole endless past. Ali Akhavi, Eda Cesaratto, Frédéric Paccaut, Pablo Rotondo, and Brigitte Vallée study such sources when they carry zero entropy. Entropy measures surprise per symbol, so zero entropy means the stream is, on average, fully predictable in the long run.
They track a finer measure, the Shannon weight: the total information in a prefix of a given length. For zero-entropy sources this grows slower than the length itself, at rates one can prescribe. The authors build examples with chosen growth rates, using tools from combinatorics and from dynamical systems. Their sources arise as coded paths of interval maps with a lazy fixed point, including the classic Farey source.
Catalog record
| CREATOR | Ali Akhavi, Eda Cesaratto, Frédédric Paccaut, Pablo Rotondo and Brigitte Vallée |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 162 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-03538