BINO: Encoder Centric Self Supervised Stereo With Native Pair Input
Haokun Zhou · 2026
Read BINO: Encoder Centric Self Supervised Stereo With Native Pair Input by Haokun Zhou (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-27904.txt.
Introduction
Zhou builds stereo vision into a compact encoder called BINO. Stereo needs fine cross-view matches, not just semantic likeness. BINO fuses the rectified pair right at input. Stereo micro-cell tokens carry the paired signal. Row-aware phase encoding marks patch positions. Training masks one view and distills token matches. Occlusion and appearance gaps add training signals. Frozen descriptors top low-resource tests. A small encoder nears CroCo v2 quality.
Catalog record
| CREATOR | Haokun Zhou |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 74761 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.27904
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
BINO: Encoder Centric Self Supervised Stereo With Native Pair Input Haokun Zhou Abstract Stereo needs features that preserve fine cross view correspondence rather than only semantic similarity. Recent self supervised vision models transfer well, but they are not built for this goal, and geometry focused methods often rely on a binocular decoder or another explicit linkage module during pretraining. BINO asks whether strong binocular structure can instead be learned inside a compact encoder. It does this by fusing the rectified pair at the input stage, forming stereo micro cell tokens, and using a row aware patch phase positional encoding. Training uses one view masked token only distillation together with occlusion and view specific appearance mismatch. In a strict low resource setting with pretraining only on KITTI object, BINO gives the best frozen descriptor results under a no linkage probe among all compared baselines on proxy dense stereo, hard negative retrieval, and KITTI Stereo 2012 disparity. With the same lightweight stereo head for every encoder, it stays near CroCo v2 while using a much smaller encoder. Supplementary transfer experiments on KITTI Stereo 2015 show the same qualitative trend. These results suggest that much of the cross view reasoning often assigned to a separate linkage module can be learned inside a compact and reusable encoder. a]Imperial College London † † authorinfo: Correspondence: Haokun Zhou, E-mail: [email protected] 1 Introduction Dense geometric tasks require feature representations that are not only robust to appearance change but also sensitive to view dependent spatial structure. This requirement is especially sharp in stereo, where the encoder must preserve correspondence cues under occlusion, photometric mismatch, and limited baseline. In recent years, self supervised vision models have become extremely strong as generic feature extractors. Methods based on masked image modeling and self distillation, such as MAE, iBOT, DINOv2, and DINOv3, produce robust features for recognition, dense prediction, and transfer [ 1 , 2 , 3 , 4 ] . However, these methods are not explicitly designed to learn dual view geometry. Their objectives are driven mainly by semantic reconstruction or global invariance rather than by the need to resolve spatial ambiguity between two synchronized viewpoints. Cross view completion provides a more direct route toward geometric representation learning. CroCo formulates self supervision as predicting masked content in one view from visible content and a second viewpoint of the same scene [ 5 ] . CroCo v2 strengthens this idea and shows that cross view completion can be scaled to stereo matching and optical flow by using a monocular encoder and a binocular decoder [ 6 ] . These results establish a strong category of geometry oriented self supervision. At the same time, they leave open a central question. Is a dedicated binocular linkage module actually necessary during representation learning, or can sufficiently strong dual view spatial understanding emerge from an encoder alone? This question matters for both scientific and practical reasons. Scientifically, linkage modules conflate two sources of performance, namely the quality of the representation itself and the power of the matcher layered on top of it. Practically, linkage modules increase training complexity, inference cost, and parameter count. A stereo oriented encoder that already captures useful binocular structure could be used in frozen form, paired with a lightweight downstream matcher, or reused in settings where a heavy binocular head is undesirable. In this paper we study a binocular encoder whose central design principle is to push cross view structure into the encoder itself. The model fuses left and right images at the input level through pixel interleaving, uses stereo micro cell tokens, and is trained with cross view masked token distillation. The encoder does not rely on a binocular decoder, a cost volume, or another separate learned linkage module during pretraining. The same encoder can be queried in a deterministic duplicate view mode for descriptor extraction without introducing test time augmentation or an alternative inference path. The core question of the paper is therefore whether such an encoder can simultaneously satisfy three criteria: strong dual view spatial understanding, no reliance on a linkage network, and meaningful single image compatibility. We answer this question in two stages. First, we construct a controlled benchmark that isolates dual view spatial understanding through encoder only correspondence metrics. This benchmark lets us ablate the architecture, the objective, and the training data distribution. Second, we evaluate on real stereo data in a strict low resource setting, where all encoders are pretrained from scratch on KITTI object and compared under a frozen no linkage protocol as well as under a shared lightweight stereo head. In the no linkage regime, our method is the strongest among all compared baselines on proxy dense stereo, hard negative retrieval, and real KITTI Stereo 2012 disparity. Under the shared head protocol, our model remains one of the two strongest encoders while using far fewer encoder parameters than CroCo v2. Supplementary KITTI Stereo 2015 transfer experiments show the same qualitative trend in both the frozen no linkage and shared head settings, which suggests that the learned binocular latent is not specific to a single benchmark. These results support a clear conclusion: strong dual view spatial encoders can be learned without a heavy linkage network, and the quality of the encoder itself remains visible even when a shared downstream matcher is introduced. 2 Related Work Single-view self-supervised visual pretraining. Recent large-scale self-supervised vision models have established strong generic visual features without labels. MAE showed that masked image reconstruction with an asymmetric encoder–decoder is highly effective for scalable representation learning [ 1 ] . iBOT introduced masked token prediction through self-distillation and highlighted the importance of patch-level supervision [ 2 ] . DINOv2 demonstrated that carefully scaled self-distillation can produce robust general-purpose visual features without supervision [ 3 ] , while DINOv3 further pushed this line toward stronger dense features and larger-scale foundation models [ 4 ] . These methods are highly relevant baselines because they define the modern standard for self-supervised visual pretraining. At the same time, they are fundamentally single-view objectives. They do not directly force the encoder to resolve ambiguity between synchronized viewpoints, which is the central challenge in stereo geometry. Self-supervised stereo and binocular depth learning. A substantial line of work learns stereo or depth directly from unlabeled binocular or multiview data through photometric consistency, epipolar structure, and mutual supervision. Flow2Stereo jointly learns optical flow and stereo by exploiting the geometric relation between the two tasks in stereoscopic videos [ 7 ] . H-Net incorporates mutual epipolar attention inside a Siamese autoencoder for unsupervised stereo depth estimation [ 8 ] . Stereo Matching by Self-supervision of Multiscopic Vision further extends self-supervision beyond binocular pairs by using aligned multi-camera capture together with cross-photometric and uncertainty-aware mutual-supervision losses [ 9 ] . These methods are important precedents because they show that binocular self-supervision can produce strong geometric signals without dense labels. However, their main target is still end-to-end disparity or depth prediction. Our goal is different: rather than optimizing a dedicated stereo estimator, we ask whether a compact frozen encoder can acquire a reusable binocular spatial latent that remains strong across multiple readout protocols. Monocular–binocular transfer and unified self-supervised depth models. Another line of work studies the reciprocal relation between monocular and stereo self-supervision.