Information-Maximized Soft Variable Discretization for Self-Supervised Image Representation Learning
Chuang Niu, Wenjun Xia, Hongming Shan, and Ge Wang · 2025
Read Information-Maximized Soft Variable Discretization for Self-Supervised Image Representation Learning by Chuang Niu, Wenjun Xia, Hongming Shan, and Ge Wang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-03469.txt.
Description
Chuang Niu, Wenjun Xia, Hongming Shan, and Ge Wang teach image codes by a soft split of each hid trait, paid for in bits. Self-taught ways power big sight models, but their goals do not speak in bits first. Here each hid trait gets a soft spread over bins, gauged batch to batch. Bit counts can then steer the learn.
Their goal, set by a multiview take, calls for traits that stay fixed when the image shifts, hold real facts, and do not repeat each other. A joint loss in bits comes next. Proofs claim an edge over past ways at cuts in waste. One odd point stands out: the plan shuns head-to-head pairs on its face, yet proves to do that same work in stats garb. Tests on tasks show gains in scores and speed. The codes tell their tale, trait by trait. Code is free.
Catalog record
| CREATOR | Chuang Niu, Wenjun Xia, Hongming Shan, and Ge Wang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 50 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-03469