The Entropic Signature of Class Speciation in Diffusion Models
Florian Handke, Dejan Stančević, Felix Koulischer, Thomas Demeester, Luca Ambrogioni · 2026
Read The Entropic Signature of Class Speciation in Diffusion Models by Florian Handke, Dejan Stančević, Felix Koulischer, Thomas Demeester, Luca Ambrogioni (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-09651.txt.
Description
Spread models do not recover meaning structure evenly over time: samples shift from meaning doubt to class choice within a narrow regime. Florian Handke and four co-authors note that theory links the shift to moving wobbles along class-splitting ways, but usable ways to find and use these windows remain limited. Their 2026 paper tracks the class-given entropy of a latent meaning variable given the noisy state as a reliable mark of these shifts.
Cutting entropy to meaning groups further settles meaning choices at varied levels. Work in many-dim Gaussian mixture models shows the entropy rate bunching on the same log time scale as the splitting mirror wobble before found in variance-keeping spread. Tests on two trained models show class-given entropy picking out the noise regimes key for meaning structure building, and the design measures how guidance shifts meaning information over time.
Catalog record
| CREATOR | Florian Handke, Dejan Stančević, Felix Koulischer, Thomas Demeester, Luca Ambrogioni |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 53 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-09651