Supervised Dimensionality Reduction Revisited: Why LDA on Frozen CNN Features Deserves a Second Look

Indar Kumar, Girish Karhana, Sai Krishna Jasti, and Ankit Hemant Lade · 2026

Read Supervised Dimensionality Reduction Revisited: Why LDA on Frozen CNN Features Deserves a Second Look by Indar Kumar, Girish Karhana, Sai Krishna Jasti, and Ankit Hemant Lade (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-03928.txt.

Description

Indar Kumar and colleagues revisited Linear Discriminant Analysis on frozen image features, a classical step often skipped in transfer learning. Across six backbones and three datasets, LDA beat full features in 11 of 12 coarse-grained setups, gaining up to 4.5 percentage points while shrinking features by 48 to 87 percent. On fine-grained CUB-200, however, full features won everywhere, since LDA drops subtle cues. Plain LDA thus offers the best accuracy-cost tradeoff for coarse tasks, while fancier supervised methods rarely justify their cost.

Catalog record

CREATORIndar Kumar, Girish Karhana, Sai Krishna Jasti, and Ankit Hemant Lade
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE44616
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.03928

Browse the full library · About the Tower of Babel