Hierarchical Maximum Entropy via the Renormalization Group
Amir R. Asadi · 2025
Read Hierarchical Maximum Entropy via the Renormalization Group by Amir R. Asadi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-01424.txt.
Description
Maximum entropy is a classic rule for choosing the least biased probability distribution that fits known averages, and it yields the Gibbs-Boltzmann form. Amir R. Asadi extends that rule to hierarchical systems, models with many levels, common in physics and machine learning. The new framework is called hierarchical maximum entropy.
Asadi shows that distributions which are Pareto optimal, best across all levels at once, arise from renormalization group procedures borrowed from theoretical physics. Multilevel versions of two variational principles support the construction. Special settings with hierarchical invariances make the computation much simpler, including quadratic, logarithmic, and nearest-neighbor losses. A notion of parameter flows carries out the simplification. The work links a core idea of statistical inference with tools built for scale in physics.
Catalog record
| CREATOR | Amir R. Asadi |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 54 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-01424