FoCUS : Bridging Fine-Grained Recognition and Open-World Discovery across Domains
Vaibhav Rathore, Divyam Gupta, Moloud Abdar, Subhasis Chaudhuri, Biplab Banerjee · 2026
Read FoCUS : Bridging Fine-Grained Recognition and Open-World Discovery across Domains by Vaibhav Rathore, Divyam Gupta, Moloud Abdar, Subhasis Chaudhuri, Biplab Banerjee (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-14240.txt.
Introduction
Rathore and co-authors open a new task: fine-grained category discovery in unseen domains. Models learn from labeled source data, then must spot known classes and find new ones in unlabeled target data with a shifted style. Fine-grained classes differ subtly, which makes the shift harder. The team builds painting and sketch test domains for birds, cars, and aircraft data. Their FoCUS method pairs stable part discovery with uncertainty-guided feature changes. It beats strong baselines across the three test groups.
Catalog record
| CREATOR | Vaibhav Rathore, Divyam Gupta, Moloud Abdar, Subhasis Chaudhuri, Biplab Banerjee |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 101985 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.14240
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
FoCUS : Bridging Fine-Grained Recognition and Open-World Discovery across Domains Vaibhav Rathore, Divyam Gupta, Moloud Abdar, Subhasis Chaudhuri, Biplab Banerjee Abstract We introduce the first unified framework for Fine-Grained Domain-Generalized Generalized Category Discovery (FG-DG-GCD), bringing open-world recognition closer to real-world deployment under domain shift. Unlike conventional GCD, which assumes labeled and unlabeled data come from the same distribution, DG-GCD learns only from labeled source data and must both recognize known classes and discover novel ones in unseen, unlabeled target domains. This problem is especially challenging in fine-grained settings, where subtle inter-class differences and large intra-class variation make domain generalization significantly harder. To support systematic evaluation, we establish the first FG-DG-GCD benchmarks by creating identity-preserving painting and sketch domains for CUB-200-2011, Stanford Cars, and FGVC-Aircraft using controlled diffusion-adapter stylization. On top of this ,we propose FoCUS , a single-stage framework that combines Domain-Consistent Parts Discovery (DCPD) for geometry-stable part reasoning with Uncertainty-Aware Feature Augmentation (UFA) for confidence-calibrated feature regularization through uncertainty-guided perturbations. Extensive experiments show that FoCUS outperforms strong GCD, FG-GCD, and DG-GCD baselines by 3.28% , 9.68% , and 2.07% , respectively, in clustering accuracy on the proposed benchmarks. It also remains competitive on coarse-grained DG-GCD tasks while achieving nearly 3 × \times higher computational efficiency than the current state of the art. 1 1 1 Code and datasets will be released upon acceptance. keywords Domain Generalization , Generalized Category Discovery , Fine-Grained Visual Categorization, Open-World Learning, Representation Learning 1 Introduction Deep visual recognition models 1 ; 13 have achieved remarkable success in closed-world settings 53 ; 25 ; 77 , where the label space is fixed and training and test samples are drawn from the same distribution. Real-world deployment, however, rarely satisfies either assumption. Practical systems must operate in open-world environments 16 ; 69 ; 64 , where unseen categories can emerge after training and data distributions may shift substantially across domains. This problem is particularly acute in fine-grained recognition 68 ; 71 , where categories differ through subtle, localized attributes rather than coarse semantic cues. Under such conditions, even modest changes in texture, illumination, abstraction, or viewpoint can suppress the very evidence needed for discrimination, causing severe feature drift and unreliable transfer across domains. Applications such as biodiversity monitoring 5 , industrial inspection 30 ; 72 , and surveillance or transportation analytics 51 therefore demand recognition systems that can generalize across domains while also discovering previously unseen fine-grained categories . We define the former as Fine-Grained Domain Generalization (FG-DG) , focusing on robust known-class recognition under shift, and the latter as Generalized Category Discovery (GCD) . Figure 1 : FG-DG-GCD extends DG-GCD 46 to the fine-grained regime, where a model trained on labeled source classes must simultaneously recognize known and discover novel categories in unseen, distribution-shifted domains. Compared with coarse-grained DG-GCD 46 ; 47 , this setting is substantially harder due to subtle inter-class cues, high intra-class similarity, and stronger sensitivity to domain-induced appearance changes. FoCUS addresses this challenge through part-consistent representation learning and uncertainty-aware open-space regularization, outperforming existing GCD, FG-GCD, and DG-GCD baselines on the proposed benchmarks (Table 4 ). Recent work on Domain-Generalized Generalized Category Discovery (DG-GCD) 46 ; 47 moves toward this goal by combining Domain Generalization (DG) 86 ; 61 , which addresses distribution shift, with Generalized Category Discovery (GCD) 54 ; 43 ; 80 , which jointly handles known and novel classes. In DG-GCD, a model is trained only on labeled source data, and must infer both seen and unseen categories in an unlabeled target domain whose distribution differs from the source. Existing DG-GCD methods rely on strategies such as diffusion-based domain synthesis, episodic meta-learning, or hyperbolic regularization 46 ; 47 . While these mechanisms are effective on coarse-grained benchmarks such as PACS 31 , Office-Home 55 , and DomainNet 41 , they are not designed for fine-grained transfer. In fine-grained settings, preserving local structure is critical: small parts, contours, and relative geometry often determine class identity (see Fig. 1 ). Yet synthetic stylization can distort these cues, and global geometric regularization can suppress the localized evidence required for category discovery. Conversely, fine-grained generalized category discovery (FG-GCD) methods 58 ; 45 ; 9 ; 44 improve recognition by leveraging part discovery, token selection, or region-aware transformers. However, these methods typically assume that labeled and unlabeled data share the same distribution, and thus do not address domain shift. Many also entangle part localization with clustering or rely on target-domain access during training, which violates the DG-GCD setting. More fundamentally, they often exploit appearance-dependent cues such as color and texture, which are highly domain-variant, while lacking mechanisms to isolate geometry-stable evidence or calibrate predictions in open-set regions. As a result, existing coarse-grained DG-GCD methods do not preserve fine-grained locality, and existing fine-grained GCD methods do not generalize across domains. Method Fine- Domain Novel Class Design Choice Part- Grained Shift Discovery Synthetic-Free Episodic-Free Aware DG 88 ; 64 ; 73 ✗ ✓ ✗ ✓ ✓ ✗ FG-DG 74 ; 66 ✓ ✓ ✗ ✓ ✓ ✓ (FG)GCD 54 ; 43 ; 80 ✓ ✗ ✓ ✓ ✓ ✗ DG-GCD 46 ; 47 ✗ ✓ ✓ ✗ ✗ ✗ FoCUS (Ours) ✓ ✓ ✓ ✓ ✓ ✓ Table 1 : FoCUS is the first framework to jointly address fine-grained recognition , domain generalization , and novel class discovery within a single formulation. Unlike prior DG-GCD methods 46 ; 47 , it is synthetic-free and episodic-free , reducing training FLOPs by 3 \times and 300 \times compared with HiDISC 47 and DG 2 CD-Net 46 , respectively, while delivering stronger generalization and discovery performance. These limitations expose a clear research gap, summarized in Table 1 : there is currently no framework that jointly addresses fine-grained discrimination, domain generalization, and open-world novel class discovery . We formalize this missing setting as Fine-Grained Domain-Generalized Generalized Category Discovery (FG-DG-GCD) . Importantly, FG-DG-GCD is not a simple combination of FG-DG and GCD. It introduces a new dual challenge. First, the representation must remain sufficiently precise to distinguish known fine-grained categories under domain shift. Second, it must avoid collapsing novel target samples into the known-class manifold, thereby preserving the structural flexibility required for discovery. This makes FG-DG-GCD fundamentally harder than closed-set fine-grained DG, since the model must learn invariances that remove domain-specific variation without erasing the subtle category-defining cues needed to separate both seen and unseen classes. A second major bottleneck is the absence of suitable benchmarks. Standard fine-grained datasets such as CUB-200-2011 57 , Stanford Cars 28 , and FGVC-Aircraft 36 contain only natural-image domains and therefore cannot evaluate domain-generalized discovery. Although diffusion- or GAN-based stylization 75 ; 15 can generate auxiliary domains, naïve style transfer often alters shape, erases discriminative parts, or introduces artifacts that corrupt category identity. To enable rigorous study of FG-DG-GCD, we construct the first dedicated benchmarks by generating identity-preserving painting and sketch domains using a controlled SDXL-adapter pipeline 42 . By conditioning the stylization process on structure and contour cues, we retain semantic identity and part geometry while inducing substantial shifts in texture, tone, and abstraction. This yields a reproducible evaluation protocol that stresses both domain robustness and fine-grained novel-category discovery. Our Approach. To address FG-DG-GCD, we propose FoCUS ( F ine-grained O pen-world C ategory discovery