Lessons and Open Questions from a Unified Study of Camera-Trap Species Recognition Over Time
Sooyoung Jeon, Hongjie Tian, Lemeng Wang, Zheda Mai, Vidhi Bakshi, Jiacheng Hou, Ping Zhang, Arpita Chowdhury, Jianyang Gu, Wei-Lun Chao, [0.5em] The Ohio State University · 2026
Read Lessons and Open Questions from a Unified Study of Camera-Trap Species Recognition Over Time by Sooyoung Jeon, Hongjie Tian, Lemeng Wang, Zheda Mai, Vidhi Bakshi, Jiacheng Hou, Ping Zhang, Arpita Chowdhury, Jianyang Gu, Wei-Lun Chao, [0.5em] The Ohio State University (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-20509.txt.
Introduction
Jeon and co-authors present a unified study of camera-trap species recognition over time. Camera traps power large-scale biodiversity monitoring worldwide. Most research treats the challenge as cross-domain generalization. Practitioners instead need stable accuracy at one fixed site over time. Their benchmark covers 546 traps with a chronological streaming protocol. Biological foundation models underperformed at many sites from the start. Naive adaptation on past data sometimes fell below zero-shot results. Severe class imbalance and temporal shift drive much of the difficulty.
Catalog record
| CREATOR | Sooyoung Jeon, Hongjie Tian, Lemeng Wang, Zheda Mai, Vidhi Bakshi, Jiacheng Hou, Ping Zhang, Arpita Chowdhury, Jianyang Gu, Wei-Lun Chao, [0.5em] The Ohio State University |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 95074 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.20509
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Lessons and Open Questions from a Unified Study of Camera-Trap Species Recognition Over Time Sooyoung Jeon, Hongjie Tian, Lemeng Wang, Zheda Mai, Vidhi Bakshi, Jiacheng Hou, Ping Zhang, Arpita Chowdhury, Jianyang Gu, Wei-Lun Chao, [0.5em] The Ohio State University Abstract Camera traps are crucial for large-scale biodiversity monitoring, yet accurate automated analysis remains challenging due to diverse deployment environments. While the computer vision community has predominantly framed this challenge as cross-domain ( e.g . , cross-site) generalization, this perspective overlooks a primary challenge faced by ecological practitioners: maintaining reliable recognition at the fixed site over time , where the dynamic nature of ecosystems introduces profound temporal shifts in both background and animal distributions. To bridge this gap, we present the first unified study of camera-trap species recognition over time . We introduce a realistic, large-scale benchmark comprising 546 camera traps with a streaming protocol that evaluates models over chronologically ordered intervals. Our end-user-centric study yields four key findings. (1) Biological foundation models ( e.g . , BioCLIP 2) underperform at numerous sites even in initial intervals, underscoring the necessity of site-specific adaptation. (2) Adaptation is challenging under realistic evaluation: when models are updated using past data and evaluated on future intervals (mirrors real deployment lifecycles), naive adaptation can even degrade below zero-shot performance. (3) We identify two main drivers of this difficulty: severe class imbalance and pronounced temporal shift in both species distribution and backgrounds between consecutive intervals. (4) We find that effective integration of model-update and post-processing techniques can largely improve accuracy, though a gap from the upper bounds remains. Finally, we highlight critical open questions, such as predicting when zero-shot models will succeed at a new site and determining whether/when model updates are necessary. Together, our benchmark and analysis provide actionable deployment guidelines for ecological practitioners while establishing new directions for future research in vision and machine learning. Training code and dataset are available at: https://jeonso0907.github.io/stream-trap/ 1 Introduction Camera traps are vital tools for ecology and conservation: they non-invasively capture large volumes of time-stamped images in natural habitats, supporting biodiversity monitoring, behavior analysis, and conservation planning 36 ; 50 . Yet ecosystems are inherently non-stationary: seasonal shifts, weather changes, vegetation growth, and animal migration constantly reshape backgrounds and animal distributions ( a). Such dynamic conditions introduce substantial visual variability, posing unique challenges for vision models 25 ; 3 . Prior studies often frame the problem as domain adaptation or generalization, aiming to transfer models trained on source domains ( e.g . , specific cameras or time periods) to unseen target domains 41 ; 61 . While this perspective casts camera trap data as a crucial testbed for machine learning robustness, it diverges from the practical needs of end-users ( e.g . , ecologists and conservation practitioners). Their dominant interest is not a model’s ranking on cross-domain leaderboards, but its ability to maintain high accuracy at a specific deployment site as dynamically changing data arrives . Recognizing that this practical problem remains largely underexplored, we conduct a unified and comprehensive study of camera trap species recognition over time , reformulating the evaluation to faithfully mirror the temporal lifecycle of real-world deployments. To facilitate this study, we introduce a realistic camera trap benchmark StreamTrap with a streaming evaluation protocol where models are evaluated as new data arrives and are incrementally updated thereafter. For each camera trap, the image stream is partitioned into consecutive time intervals for evaluating models chronologically. Concretely, at each interval j , a model can access cumulative, labeled training data from all intervals up to the j -th interval, undergo parameter updates, and evaluate on the unseen test data from the subsequent (j+1) -th interval. To construct StreamTrap , we curate data from the LILA BC repository 26 , identifying 546 camera traps from 17 datasets, each with sufficient data spanning at least 6 months. Also, we provide a modular, reproducible data pipeline that adheres to FAIR principles (Findable, Accessible, Interoperable, and Reusable), enabling practitioners to seamlessly convert their raw ecological data into standardized temporal benchmarks. Building on StreamTrap , we conduct a unified end-user-centric study aiming to answer common questions faced by ecological practitioners, and distill actionable guidelines for maintaining accurate models in dynamic environments. We summarize our key analyses as follows: Adaptation is required even with biological foundation models. End-users often face this question before deployment, especially when biological vision foundation models 18 ; 45 already achieve state-of-the-art zero-shot accuracy across various biodiversity datasets, including subsets of the LILA BC repository. We observe significant variability in BioCLIP 2’s zero-shot accuracy across 546 camera traps in StreamTrap : while 161 exceed 90% accuracy, demonstrating the immense promise of these models, another 162 fall in the 50–80% range, indicating a persistent, critical need for site-specific adaptation. Adaptation is challenging in the real world. When off-the-shelf foundation models underperform, fine-tuning is a natural first adaptation choice. However, adaptation becomes more challenging than standard in-domain fine-tuning in the realistic streaming evaluation of StreamTrap where a model updated on data up to the current interval is evaluated on the future interval. Surprisingly, we find that naively supervised fine-tuning of a model (we term the accumulated model ) using all data observed so far can degrade performance, often causing it to fall below the baseline zero-shot accuracy. Our investigation identifies two primary drivers behind this adaptation failure. First, because camera traps acquire images passively and must “wait” for animals to appear, some species may not be observed within an interval. Thus, the training data available for an interval is often extremely low-shot and severely imbalanced, causing poor generalization during naive adaptation 49 . Second, due to the inherent non-stationarity of ecosystems, both the background context and the animal population distributions undergo profound shifts between consecutive intervals. As a result, a model that achieves high accuracy on current and past intervals is not guaranteed to maintain that performance when faced with the shifted distributions of future intervals. Practical recipes for robust adaptation. To combat the low-shot and imbalance issues, we evaluate a suite of practical techniques and find that combining parameter-efficient fine-tuning 31 and class-imbalance losses 38 ; 56 is a robust solution to improve generalization in camera trap vision model adaptation. However, even with this optimized recipe, the continually adapted models still exhibit a non-negligible performance gap ( b) compared to an upper bound ( oracle \star model fine-tuned with all training data across all time intervals at a site). To address the inter-interval distribution shifts and close this gap, we identify three post-processing techniques: post-hoc logit calibration 28 , weight interpolation 54 , and interval model selection. More practical considerations. Accurate real-world deployment involves more than choosing an adaptation algorithm. Through discussions with end-users, we identify critical, practical questions frequently overlooked by the vision community: How can practitioners predict if a foundation model’s zero-shot performance will be sufficient at a new, unseen site? If not, must we update at every interval to remain accurate, or is there an effective mechanism to determine when adapting at a given interval is actually necessary? As these questions are largely underexplored, we provide preliminary analyses and baseline solutions. Contributions. We present the first unified study of camera trap species recognition over time that reflects