Reconsideration of Information-Theoretic Principles—Perspective from the Dual Probability Distribution

Yoshikazu Ohtaki, Tomomi Nakamura, Hiroshi-H. Hasegawa, Tatsuaki Wada · 2026

Read Reconsideration of Information-Theoretic Principles—Perspective from the Dual Probability Distribution by Yoshikazu Ohtaki, Tomomi Nakamura, Hiroshi-H. Hasegawa, Tatsuaki Wada (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/pmc-13297851.txt.

Description

Yoshikazu Ohtaki and colleagues rethink core rules of information theory through a mirror concept called the dual probability distribution, in a 2026 paper. The rules in question include the maximum entropy principle, which picks the least-biased distribution fitting known facts. The dual distribution arises naturally when data are sampled from a multinomial scheme, through a classic lemma of Sanov.

Viewed through the mirror, a key quantity called the Massieu potential becomes a plain distance measure between two dual distributions. Its partner quantity becomes a generating function taken against the dual reference. The correspondence sharpens as samples grow large. The authors expect the mirror view to matter for everyday data analysis, where sampling is the starting point.

Catalog record

CREATORYoshikazu Ohtaki, Tomomi Nakamura, Hiroshi-H. Hasegawa, Tatsuaki Wada
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE23 KB
VERSION1.0
LICENSECC BY 4.0
RIGHTSCC BY
SOURCEEurope PMC

Source: https://europepmc.org/articles/PMC13297851

Browse the full library · About the Tower of Babel