C-DOG: Multi-View Multi-instance Feature Association Using Connected δ \delta -Overlap Graphs
Yung-Hong Sun, Ting-Hung Lin, Jiangang Chen, Hongrui Jiang, Yu Hen HuDepartment of Electrical and Computer EngineeringUniversity of Wisconsin - Madison, WI 53705, USA · 2025
Read C-DOG: Multi-View Multi-instance Feature Association Using Connected δ \delta -Overlap Graphs by Yung-Hong Sun, Ting-Hung Lin, Jiangang Chen, Hongrui Jiang, Yu Hen HuDepartment of Electrical and Computer EngineeringUniversity of Wisconsin - Madison, WI 53705, USA (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-14095.txt.
Introduction
Sun and co-authors solve a matching puzzle central to 3D reconstruction: deciding which dots in camera views are the same point. When a scene holds identical objects, appearance matching fails. Their algorithm, C-DOG, ignores appearance and uses geometry alone, linking points across views when their epipolar distance is small. Each link becomes an edge in a graph, weighted by that distance.
Noise makes true links imperfect, so the method keeps edges under a threshold using an overlap coefficient, then clusters the graph and prunes unreliable points with a statistical rule. On synthetic test scenes, C-DOG beat the geometry-based rivals and stayed robust amid crowded scenes, featureless objects, and cameras that barely overlap. The authors pitch it as a scalable front end for reconstruction pipelines. For robotics and mapping teams, the draw is reliability without needing the objects to look distinctive.
Catalog record
| CREATOR | Yung-Hong Sun, Ting-Hung Lin, Jiangang Chen, Hongrui Jiang, Yu Hen HuDepartment of Electrical and Computer EngineeringUniversity of Wisconsin - Madison, WI 53705, USA |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 66 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-14095
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
C-DOG: Multi-View Multi-instance Feature Association Using Connected δ \delta -Overlap Graphs Thanks: Code available at GitHub: https://github.com/Yunghong/C-DOG Yung-Hong Sun, Ting-Hung Lin, Jiangang Chen, Hongrui Jiang, Yu Hen HuDepartment of Electrical and Computer EngineeringUniversity of Wisconsin - Madison, WI 53705, USA Abstract Multi-view multi-instance feature association constitutes a crucial step in 3D reconstruction, facilitating the consistent grouping of object instances across various camera perspectives. The presence of multiple identical objects within a scene often leads to ambiguities for appearance-based feature matching algorithms. Our work circumvents this challenge by exclusively employing geometrical constraints, specifically epipolar geometry, for feature association. We introduce C-DOG (Connected δ \delta -Overlap Graph), an algorithm designed for robust geometrical feature association, even in the presence of noisy feature detections. In a C-DOG graph, two nodes representing 2D feature points from distinct views are connected by an edge if they correspond to the same 3D point. Each edge is weighted by its epipolar distance . Ideally, true associations yield a zero distance; however, noisy feature detections can result in non-zero values. To robustly retain edges where the epipolar distance is less than a threshold δ \delta , we employ a Szymkiewicz–Simpson coefficient. This process leads to a δ \delta -neighbor-overlap clustering of 2D nodes. Furthermore, unreliable nodes are pruned from these clusters using an Inter-quartile Range (IQR)-based criterion. Our extensive experiments on synthetic benchmarks demonstrate that C-DOG not only outperforms geometry-based baseline algorithms but also remains remarkably robust under demanding conditions. This includes scenes with high object density, no visual features, and restricted camera overlap, positioning C-DOG as an excellent solution for scalable 3D reconstruction in practical applications. I Introduction Multi-view 3D reconstruction in computer vision [ 1 , 2 ] is the process of generating a three-dimensional model of a scene or object from a collection of two-dimensional images captured from different viewpoints. This capability forms the technical foundation for a wide array of applications, including autonomous driving [ 3 ] , surgery [ 4 ] , and robotics [ 5 ] , among others. The classical multi-view 3D reconstruction pipeline typically involves several stages: extraction of feature points from 2D images, associating these 2D feature points from different camera views to corresponding 3D points, constructing an approximated 3D surface based on the estimated 3D point cloud, and finally, reconstructing stereo views by rendering the estimated 3D surface with color/texture information observed from the multi-view images. Among these steps, feature association [ 6 ] presents the most complex challenge, as it seeks to accurately match hundreds or thousands of 2D points to their corresponding 3D locations. Traditionally, this problem is addressed by first matching the visual appearance surrounding each feature point (using feature descriptors) and then imposing geometric constraints, such as homography [ 7 ] , to simplify computation. It is generally preferable to extract visually distinct features, as this significantly reduces the complexity of feature matching. Recent trends, however, have shifted towards learning-based methods that leverage neural networks to associate objects across views [ 8 , 3 , 9 , 10 , 11 , 12 , 13 , 14 , 15 ] . These approaches often integrate appearance cues—such as texture, color, or shape—with spatial and temporal information to robustly resolve correspondence. Fig. 1: Demonstration of C-DOG applied to 130 3D points within a multi-camera system from our benchmark. (a) Multiple visually indistinguishable 3D points are observed within a multi-camera setup. (b) Each camera captures 2D projections of these 3D points, which can be obtained using object detectors or keypoint estimators. (c) C-DOG is employed to establish correspondences across views by associating multi-view multi-object observations. (d) The resulting correspondences are then utilized to perform 3D reconstruction. Fig. 2: Example of multi-view multi-object association with two views and two nearby object instances under (a) noise-free and (b) noisy observations. Each node represents a 2D observation in one view. (a) In the ideal case, the association scores between corresponding points (same object across views) are zero, while those between different objects are significantly higher. (b) Under noisy observations, the score distribution becomes ambiguous, making correct correspondence more difficult to establish. While effective in visually rich and structured environments, existing feature matching approaches often struggle in more challenging scenarios where appearance cues are ambiguous, degraded, or entirely absent. Specifically, scenes containing multiple visually identical instances (multi-instance scenes) pose a fundamental challenge: in such settings, even temporal dynamics may be insufficient to disambiguate object identities across views. To address these limitations, some approaches abandon appearance features, relying instead solely on multi-view geometric constraints [ 16 , 17 , 18 , 19 , 20 , 21 , 22 , 23 , 24 ] . These methods leverage known camera poses—which encode the relative position and orientation of each camera—to infer associations between 2D observations across views. Such geometric relationships are frequently encoded as pairwise affinity scores, indicating the likelihood of correspondence between detections from different views. A common formulation treats each object detection as a graph node, with weighted edges representing the strength of geometric consistency between views. However, these geometry-only methods are highly sensitive to observation noise and scale poorly with increasing instance counts. As illustrated in Figure 2 , a noise-free observation in a simple case of two views and two nearby objects yields a distinct association pattern where correct correspondences have zero or near-zero scores. In contrast, under noisy conditions, correct and incorrect associations become nearly indistinguishable. This ambiguity intensifies as the number of objects increases. Although graph-based approaches incorporating epipolar constraints or back-projection errors have been proposed, their performance degrades significantly in the presence of noise and a higher number of objects, thus limiting their reliability in real-world applications. To overcome these challenges, we propose a novel multi-view, multi-instance feature association method that integrates connected \delta -overlap graph ( C-DOG ) structures with epipolar geometric constraints. This method utilizes a predefined threshold \delta to assess the likelihood of correctness for any association pair, leveraging mutual neighbor connections. Designed to be lightweight and easily integrable, C-DOG functions as a plug-and-play module that bridges object detection or pose estimation with 3D reconstruction, as depicted in Figure 1 . Inspired by existing geometry-based multi-view association algorithms, we model each 2D observation from a camera view as an independent node in a graph. Cross-view edges are initially established based on epipolar consistency. We then apply a \delta -neighbor-overlap clustering [ 25 ] and filtering procedure to construct a graph that captures object correspondences as connected subgraphs, while tolerating missing or noisy edges. This stage filters out erroneous associations based on structural consistency rather than raw epipolar scores, yielding clusters that represent geometrically consistent observations of the same object across views. To further refine these clusters, we apply an additional filtering step based on the Interquartile Range (IQR) [ 26 ] of edge consistency scores and the 3D back-projection error, which quantifies the triangulation error of matched points. Our approach demonstrates robustness to appearance ambiguity and limited view overlap, and significantly increases the feasible number of objects that can be accurately associated under challenging multi-camera conditions. Our contributions are summarized as follows: • We propose C-DOG , a novel multi-view multi-object association framework that integrates connected \delta -overlap graph modeling with epipolar geometric