A Fiber Criterion for Representation Identifiability in Supervised Learning
Vasileios Sevetlidis · 2026
Read A Fiber Criterion for Representation Identifiability in Supervised Learning by Vasileios Sevetlidis (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-01092.txt.
Description
Sevetlidis asks when a trait of a model's inner representation can be known from its behavior in this 2026 paper. A predictor is often a head composed with a representation map. Supervised evidence pins down the composed map. It need not pin down how the work splits between the two parts. Many representation traits hang on that split.
His answer is a fiber criterion. A trait is identifiable from the predictor exactly when it stays constant on each fiber of the projection. The fibers group all pairs that compose to the same predictor. One construction shows the gap at its sharpest. Extra information can be appended to a representation while the head ignores it. The predictor stands unchanged, yet traits like minimality or invariance shift. Finite sample checks with exact witnesses and matched Waterbirds models picture the criterion. The paper parts identifiability from optimization and estimation noise.
Catalog record
| CREATOR | Vasileios Sevetlidis |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 102 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.01092