Bridge: Basis-Driven Causal Inference Marries VFMs for Domain Generalization
Mingbo Hong, Feng Liu, Caroline Gevaert, George Vosselman, Hao Cheng, [0.5em] University of Twente · 2026
Read Bridge: Basis-Driven Causal Inference Marries VFMs for Domain Generalization by Mingbo Hong, Feng Liu, Caroline Gevaert, George Vosselman, Hao Cheng, [0.5em] University of Twente (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-26820.txt.
Introduction
Hong and four colleagues propose Bridge, a method that helps object detectors work in new settings despite shifts in lighting, style, and surroundings. It learns low-rank bases, compact mathematical summaries, for front-door adjustment, a causal technique that blocks misleading cues from the training domain while trimming redundant detail. Bridge plugs into both discriminative and generative vision foundation models, large pretrained vision systems. Across camera, weather, artistic, and drone benchmarks it beats previous leading methods.
Catalog record
| CREATOR | Mingbo Hong, Feng Liu, Caroline Gevaert, George Vosselman, Hao Cheng, [0.5em] University of Twente |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 40834 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.26820
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Bridge: Basis-Driven Causal Inference Marries VFMs for Domain Generalization Mingbo Hong, Feng Liu, Caroline Gevaert, George Vosselman, Hao Cheng, [0.5em] University of Twente Abstract Detectors often suffer from degraded performance, primarily due to the distributional gap between the source and target domains. This issue is especially evident in single-source domains with limited data, as models tend to rely on confounders (e.g., illumination, co-occurrence, and style) from the source domain, leading to spurious correlations that hinder generalization. To this end, this paper proposes a novel Basis-driven framework for domain generalization, namely Bridge , that incorporates causal inference into object detection. By learning the low-rank bases for front-door adjustment, Bridge blocks confounders’ effects to mitigate spurious correlations, while simultaneously refining representations by filtering redundant and task-irrelevant components. Bridge can be seamlessly integrated with both discriminative (e.g., DINOv2/3, SAM) and generative (e.g., Stable Diffusion) Vision Foundation Models (VFMs). Extensive experiments across multiple domain generalization object detection datasets, i.e., Cross-Camera, Adverse Weather, Real-to-Artistic, Diverse Weather Datasets, and Diverse Weather DroneVehicle (our newly augmented real-world UAV-based benchmark), underscore the superiority of our proposed method over previous state-of-the-art approaches. The project page is available at: https://mingbohong.github.io/Bridge/ . 1 Introduction Despite recent advances, data-driven object detection models often inherit or amplify dataset biases, limiting their cross-domain transferability 42 . They frequently perform poorly across diverse viewpoints and imaging conditions from ground-level scenes to aerial imagery, which hinders generalization. Figure 1 : (a) The baseline model, using a frozen DINOv2 44 backbone, misclassifies the object due to spurious correlations caused by the confounder: co-occurrence of a bicycle with nearby pedestrians. (b) Our method correctly identifies the bicycle by blocking these spurious correlations. (c) Models may rely on spurious correlations between the input \mathcal{X} and the label \mathcal{Y} induced by the confounder \mathcal{Z} . (d) In contrast, our method uses a front-door adjustment mechanism, where the mediating variable \mathcal{M} mitigates spurious correlations induced by \mathcal{Z} and enables the model to focus on the features that truly determine \mathcal{Y} . To address these limitations, domain generalization (DG) 3 has emerged as a particularly promising paradigm, aiming to train models on one or multiple source domains to generalize effectively to unseen out-of-distribution (OOD) target domains. Existing DG approaches primarily focus on learning domain-invariant representations 30 ; 48 ; 1 ; 11 , expanding source distributions through data augmentation 60 ; 47 ; 73 ; 82 , or leveraging the strong prior knowledge embedded in Vision Foundation Models (VFMs) 68 ; 78 ; 17 ; 16 . However, many DG approaches often neglect the confounding effects that arise from limited single-domain datasets. These confounders (denoted as \mathcal{Z} ), including variations in illumination, co-occurrence patterns, or stylistic discrepancies, can bias the learned representations ( \mathcal{X} ) and create spurious correlations with object labels ( \mathcal{Y} ), see Fig. 1 . Such biases distort the causal link between visual features and labels 67 ; 80 ; 79 ; 55 , degrading out-of-distribution generalization. For instance, a detector with a frozen DINOv2 44 backbone pretrained on 142M images but fine-tuned on only 3,000 Cityscapes samples 9 may misclassify a bicycle near a person as a rider (57%) or even as a person (20%) due to spatial correlations (Fig. 1 (a)). The backbone offers substantial representational strength, yet overlooking spurious correlations in downstream tasks risks wasting much of this capacity. Hence, to mitigate these effects, it is crucial to uncover and model the causal mechanisms behind the data, guiding the model to focus on causally relevant features rather than spurious correlations. In this paper, we introduce Bridge , a B asis-d ri ven framework for D omain Ge neralization that incorporates causal inference 45 ; 43 into object detection. By blocking the adverse effects of confounders, Bridge enables the model to mitigate the influence of confounders. Specifically, we propose a novel Causal Basis Block (CBB) that is designed in accordance with the front-door adjustment 46 , formulated from a basis-learning perspective to mitigate the adverse effects of confounders. Unlike prior works 66 ; 33 ; 80 ; 79 that depend on external confounder dictionaries or involve elaborate post-processing mechanisms (e.g., clustering 79 , momentum updates 33 ) with limited flexibility and scalability, our CBB is proposed as an end-to-end, plug-and-play module tailored for VFMs-based object detection frameworks, allowing seamless integration while maintaining high flexibility and scalability. In our design, we build the Domain Generalization Object Detection (DGOD) framework upon frozen VFMs by integrating the CBB to perform causal modeling, avoiding costly fine-tuning the whole network. By blocking spurious correlations (Fig. 1 (d)), the framework allows the model to focus on inherent causality, yielding more robust and generalizable representations for downstream tasks and improving performance (Fig. 1 (b)). Furthermore, we note that commonly used DGOD benchmarks 9 ; 76 ; 54 ; 13 ; 23 ; 69 lack diverse aerial viewpoints and imaging conditions. For a more comprehensive evaluation, we extend the DroneVehicle dataset 59 by annotating weather conditions and organizing the images into four scenarios: Clear, Dark, Foggy, and Extreme Dark. We summarize our main contributions as follows: • We propose Bridge , a novel framework that can be seamlessly integrated with both discriminative (e.g., DINOv2 44 , DINOv3 57 , SAM 25 ) and generative (e.g., Stable Diffusion 52 ) Vision Foundation Models (VFMs), aiming to mitigate spurious correlations in downstream domain generalization object detection. • We introduce a novel Causal Basis Block that constructs front-door adjustments from a basis-learning perspective, which can be trained end-to-end and improves model generalization by producing robust representations. • We conduct extensive experiments on five DGOD benchmarks. Bridge surpasses the previous runner-up across all the benchmarks by \mathbf{+3.8} , \mathbf{+2.9} , \mathbf{+2.4} , \mathbf{+0.4} , and \mathbf{+1.5} in mAP, and consistently improves the VFMs (SAM, DINOv2, DINOv3) with average gains of \mathbf{+2.7} , \mathbf{+4.5} , \mathbf{+3.1} , \mathbf{+1.8} , and \mathbf{+1.8} in mAP, respectively. • We enrich an existing UAV object detection dataset with manually annotated weather condition labels, establishing a much-needed benchmark for evaluating domain generalization under diverse weather scenarios in the remote sensing community. 2 Related Work Domain Generalization for Visual Perception. Domain generalization 3 has been widely studied in various visual perception tasks, including image classification 27 ; 31 , object detection 41 ; 21 , medical imaging 37 ; 36 , semantic segmentation 77 ; 64 , and beyond. To tackle the DG problem, a wide range of approaches have been proposed from different perspectives, including data augmentation 64 ; 56 , adversarial training 30 ; 48 ; 1 , disentangled representation learning 27 ; 24 , meta-learning 28 ; 2 , and more. More recently, several works have explored the potential of Vision Foundation Models (VFMs) 5 ; 25 in various DG tasks 17 ; 68 ; 78 . Building on VFMs, our Bridge aims to mitigate spurious correlations that may arise in the process of leveraging frozen VFMs for downstream training, especially when trained on a single, data-scarce source domain. Vision Foundation Models (VFMs). VFMs have rapidly emerged in recent years, driven by large-scale training data in self-supervised or semi-supervised settings. ViT 12 pioneered the use of large-scale transformer architectures for image classification, demonstrating the scalability of transformer-based models on visual tasks. Building