Are We Recognizing the Jaguar or Its Background? A Diagnostic Framework for Jaguar Re-Identification
Antonio Rueda-Toicen 1,2 , Abigail Allen Martin 3,4 , Daniil Morozov 5,8 , Matin Mahmood 8 , Alexandra Schild 1 , Shahabeddin Dayani 6 , Davide Panza 7 , Gerard de Melo 1 · 2026
Read Are We Recognizing the Jaguar or Its Background? A Diagnostic Framework for Jaguar Re-Identification by Antonio Rueda-Toicen 1,2 , Abigail Allen Martin 3,4 , Daniil Morozov 5,8 , Matin Mahmood 8 , Alexandra Schild 1 , Shahabeddin Dayani 6 , Davide Panza 7 , Gerard de Melo 1 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-09690.txt.
Introduction
Rueda-Toicen and seven colleagues diagnose jaguar re-identification, where strong scores can rest on background or silhouette, not coat pattern. Their framework adds two axes: a context ratio from background-only and foreground-only images, and a laterality diagnostic from cross-flank retrieval and mirror self-similarity. A curated Pantanal benchmark with per-pixel masks makes both axes measurable. Three mitigation families serve as case studies: ArcFace tuning, anti-symmetry regularization, and Lorentz hyperbolic embeddings.
Catalog record
| CREATOR | Antonio Rueda-Toicen 1,2 , Abigail Allen Martin 3,4 , Daniil Morozov 5,8 , Matin Mahmood 8 , Alexandra Schild 1 , Shahabeddin Dayani 6 , Davide Panza 7 , Gerard de Melo 1 |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 82889 |
| LICENSE | http://creativecommons.org/licenses/by-sa/4.0/ |
| RIGHTS | CC BY SA |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.09690
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Are We Recognizing the Jaguar or Its Background? A Diagnostic Framework for Jaguar Re-Identification Antonio Rueda-Toicen 1,2 , Abigail Allen Martin 3,4 , Daniil Morozov 5,8 , Matin Mahmood 8 , Alexandra Schild 1 , Shahabeddin Dayani 6 , Davide Panza 7 , Gerard de Melo 1 Abstract Jaguar re-identification (re-ID) from citizen-science imagery can look strong on standard retrieval metrics while still relying on the wrong evidence, such as background context or silhouette shape, instead of the coat pattern that defines identity. We introduce a diagnostic framework for wildlife re-ID with two axes: a leakage-controlled context ratio, background/foreground , computed from inpainted background-only versus foreground-only images, and a laterality diagnostic based on cross-flank retrieval and mirror self-similarity. To make these diagnostics measurable, we curate a Pantanal jaguar benchmark with per-pixel segmentation masks and an identity-balanced evaluation protocol. We then use representative mitigation families, ArcFace fine-tuning, anti-symmetry regularization, and Lorentz hyperbolic embeddings, as case studies under the same evaluation lens. The goal is not only to ask which model ranks best, but also what visual evidence it uses to do so. Keywords: Wildlife re-identification, shortcut learning, metric learning 1 Introduction Figure 1: Six diagnostic image variants derived from a single citizen-science photograph using its SAM-3 alpha mask. (A1) Original full_rgb input. (A2) Binary silhouette (alpha channel). (B1) bg_silhouette : foreground replaced by a black silhouette, retaining background context and shape cues. (B2) inpainted : foreground removed by FLUX.1-Fill generative inpainting, eliminating the silhouette-shaped hole used for leakage-controlled BG/FG evaluation ( Section 3.2 ). (C1) foreground cutout (background removed), isolating coat pattern. (C2) Horizontally flipped mirror cutout, used for laterality analysis ( Section 3.3 ). Jaguar rosette patterns are individually unique [ 17 ] ; the left flank differs from the right, so a mirrored image depicts an individual that does not exist. Citizen scientists and camera-trap networks now produce millions of wildlife images per year. These data enable non-invasive population monitoring at large scale. Individual re-identification (re-ID), the task of recognising specific animals across sightings, is the foundation of mark-recapture studies, movement ecology, and conservation management. Deep learning has brought high ranking accuracy to this task, yet accuracy alone can be misleading: a model may achieve high scores by memorising the habitat rather than the animal . Geirhos et al. [ 14 ] formalised this pathology as shortcut learning , and Beery et al. [ 4 ] demonstrated that camera-trap classifiers exploit background context so much that they fail when deployed at new sites. Existing benchmarks for wildlife re-ID [ 9 , 8 , 26 ] rank models by accuracy-based metrics such as mean Average Precision (mAP) and Cumulative Matching Characteristic (CMC), but few probe which visual features drive the match. For species with unique bilateral coat patterns, jaguars ( Panthera onca ), leopards, whale sharks, an additional failure mode exists. Recent sea-turtle work shows that opposite-side visual similarity can sometimes be exploited to improve animal photo-identification, suggesting that laterality effects are species-dependent rather than uniform across taxa [ 1 ] . The true coat pattern of these species is asymmetric : the rosette layout on the left flank differs from that on the right [ 10 ] . Models trained with horizontal flip augmentation learn representations that collapse left and right flanks into nearly identical embeddings. More broadly, neural networks often learn transformed copies of features under common image transformations, including flips, making this kind of left-right equivalence a plausible representational tendency rather than a jaguar-specific artifact [ 25 ] . Yet a controlled experiment ( Section 4.5 ) shows that flips do not improve cross-flank retrieval and reduce within-flank accuracy. The relevant question is whether a model can match the same individual across viewpoints; we call this the laterality axis and measure it via cross-flank retrieval and mirror self-similarity. These two failure modes, background shortcut and laterality shortcut, need not move together. Across our frozen baseline suite we do not see a clear monotonic association between context reliance ( BG/FG ) and mean mirror similarity (Axis 2; Sec. 3.3.1 ), motivating a multi-axis diagnostic and mitigation framework. This paper is about how to evaluate wildlife re-ID systems when shortcut cues can dominate retrieval; the benchmark and mitigation families are included to make that evaluation concrete. Our contributions are as follows: 1. Diagnostic Framework (C1). We propose two diagnostic axes for wildlife re-ID with segmentation masks: BG/FG , a leakage-controlled measure of context reliance, and Mirror Similarity, a laterality diagnostic for bilaterally asymmetric species defined on foreground-only cutouts with each model’s native retrieval score. We also analyse how the two axes relate in Sec. 3.3.1 . 2. Jaguar Benchmark with Segmentation Masks (C2). We release a citizen-science Pantanal jaguar dataset with 1,895 RGBA images, per-pixel segmentation masks, and 31 identified individuals, and establish a reproducible evaluation protocol via two public Kaggle challenges: ( Round 1 ) and ( Round 2 ), with identity-balanced mAP as the official metric. Through these two public leaderboards, we explore the performance difference between models that use full RGB images and models that use foreground-only cutouts. The dataset is publicly available on Hugging Face ( dataset ) and is sourced from the Jaguar ID Project, a citizen-science initiative that collects and curates jaguar sightings across the Brazilian Pantanal; more information about the project and the dataset can be found on the Jaguar ID Project website ( Jaguar ID Project website ). 3. Empirical Audit of Mitigation Families (C3). We use representative mitigation families, ArcFace fine-tuning, anti-symmetry regularization, and Lorentz hyperbolic embeddings, as case studies under the two-axis diagnostic framework, and report their accuracy–robustness trade-offs. 2 Related Work 2.1 Animal Re-Identification Classical wildlife re-ID relies on local keypoint descriptors. HotSpotter [ 10 ] matches SIFT keypoints on patterned species (e.g. zebras, jaguars) by verifying spatial correspondences. Deep global descriptors have become the dominant approach. MiewID [ 26 ] trains a multi-species re-ID model on a large community-curated dataset, producing embeddings tailored to wildlife. The WildlifeDatasets toolkit [ 9 ] standardises data loading and evaluation across dozens of species, while WildFusion [ 8 ] fuses multiple similarity scores with calibrated confidence weighting. Recent work on sea turtles studies the cross-side problem directly, showing that left and right facial profiles retain exploitable identity signal and that searching across both sides can improve retrieval in that setting [ 1 ] . Foundation models pre-trained on large-scale data, including DINOv3 [ 29 ] , EVA-02 [ 13 ] , EfficientNetV2 [ 31 ] , I-JEPA [ 2 ] , ConvNeXtV2 [ 32 ] , C-RADIO [ 27 ] , and ResNet [ 15 ] , are now used as frozen or fine-tuned backbones. None of these works, however, probe which image regions drive the re-ID decision. 2.2 Shortcut Learning and Spurious Correlations Geirhos et al. [ 14 ] provide a taxonomy of shortcut learning in deep networks, showing that models exploit texture, context, or other spurious cues instead of the intended discriminative features. In the camera-trap domain, Beery et al. [ 4 ] showed that species classifiers memorise background scenes so well that accuracy drops at unseen sites, a finding we extend to the re-identification setting. Sagawa et al. [ 28 ] propose distribution-robust optimisation to improve worst-group performance