CHIRP dataset: towards long-term, individual-level, behavioral monitoring of bird populations in the wild

Alex Hoi Hang Chan, Neha Singhal, Onur Kocahan, Andrea Meltzer, Saverio Lubrano, Miyako H. Warrington, Michael Griesser, Fumihiro Kano, Hemal Naik, [2ex] Centre for the Advanced Study of Collective Behaviour, University of Konstanz, [1ex] shared senior authorship. {hoi-hang.chan, andrea.meltzer, saverio.lubrano, michael.griesser, fumihiro.kano}@uni-konstanz.de{onurkocahan, neha.singhal.blr}@gmail.com, [email protected], [email protected] · 2026

Read CHIRP dataset: towards long-term, individual-level, behavioral monitoring of bird populations in the wild by Alex Hoi Hang Chan, Neha Singhal, Onur Kocahan, Andrea Meltzer, Saverio Lubrano, Miyako H. Warrington, Michael Griesser, Fumihiro Kano, Hemal Naik, [2ex] Centre for the Advanced Study of Collective Behaviour, University of Konstanz, [1ex] shared senior authorship. {hoi-hang.chan, andrea.meltzer, saverio.lubrano, michael.griesser, fumihiro.kano}@uni-konstanz.de{onurkocahan, neha.singhal.blr}@gmail.com, [email protected], [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-25524.txt.

Introduction

Chan and co-authors release CHIRP, a dataset for tracking wild birds as individuals over years. It follows Siberian jays in Swedish Lapland, a population studied long term. The set supports five vision jobs: re-identification, action naming, pose keypoints, detection, and segmentation. Scores also use biology-grade measures like feeding and co-presence rates. Their CORVID pipeline names birds by the color rings on their legs. It beats top re-identification methods on the real-use scores. The pair offers a template for field datasets.

Catalog record

CREATORAlex Hoi Hang Chan, Neha Singhal, Onur Kocahan, Andrea Meltzer, Saverio Lubrano, Miyako H. Warrington, Michael Griesser, Fumihiro Kano, Hemal Naik, [2ex] Centre for the Advanced Study of Collective Behaviour, University of Konstanz, [1ex] shared senior authorship. {hoi-hang.chan, andrea.meltzer, saverio.lubrano, michael.griesser, fumihiro.kano}@uni-konstanz.de{onurkocahan, neha.singhal.blr}@gmail.com, [email protected], [email protected]
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE39426
LICENSEhttp://creativecommons.org/licenses/by-sa/4.0/
RIGHTSCC BY SA
SOURCEarXiv

Source: https://arxiv.org/abs/2603.25524

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

CHIRP dataset: towards long-term, individual-level, behavioral monitoring of bird populations in the wild Alex Hoi Hang Chan, Neha Singhal, Onur Kocahan, Andrea Meltzer, Saverio Lubrano, Miyako H. Warrington, Michael Griesser, Fumihiro Kano, Hemal Naik, [2ex] Centre for the Advanced Study of Collective Behaviour, University of Konstanz, [1ex] shared senior authorship. {hoi-hang.chan, andrea.meltzer, saverio.lubrano, michael.griesser, fumihiro.kano}@uni-konstanz.de{onurkocahan, neha.singhal.blr}@gmail.com, [email protected], [email protected] Abstract Long-term behavioral monitoring of individual animals is crucial for studying behavioral changes that occurs over different time scales, especially for conservation and evolutionary biology. Computer vision methods have proven to benefit biodiversity monitoring, but automated behavior monitoring in wild populations remains challenging. This stems from the lack of datasets that cover a range of computer vision tasks necessary to extract biologically meaningful measurements of individual animals. Here, we introduce such a dataset (CHIRP) with a new method (CORVID) for individual re-identification of wild birds. The CHIRP ( C ombining be H aviour, I ndividual R e-identification and P ostures) dataset is curated from a long-term population of wild Siberian jays studied in Swedish Lapland, supporting re-identification (re-id), action recognition, 2D keypoint estimation, object detection, and instance segmentation. In addition to traditional task-specific benchmarking, we introduce application-specific benchmarking with biologically relevant metrics (feeding rates, co-occurrence rates) to evaluate the performance of models in real-world use cases. Finally, we present CORVID ( CO lou R -based V ideo re- ID ), a novel pipeline for individual identification of birds based on the segmentation and classification of colored leg rings, a widespread approach for visual identification of individual birds. CORVID offers a probability-based id tracking method by matching the detected combination of color rings with a database. We use application-specific benchmarking to show that CORVID outperforms state of the art re-id methods. We hope this work offers the community a blueprint for curating real-world datasets from ethically approved biological studies to bridge the gap between computer vision research and biological applications. Figure 1 : CHIRP dataset summary. A) Solving the problem of who, with video re-identification datset of individuals. B) Solving the problem of what, with action recognition dataset and 2D keypoint estimation. C) Additional annotations to support the main tasks, including segmentation (yellow) of color rings, bounding box (green box) and segmentation (yellow) of birds. D) Application specific benchmark, 12 independent test videos with per frame annotation for bounding box, identities and behaviors, with novel metrics on errors related to biological measures like individual feeding rates and paired co-occurrence rates. 1 Introduction Behavior is often the first response of animals when adapting to environmental changes 56 ; 54 . Measuring changes in behavior over time is hence crucial for conducting research in behavioral ecology and conservation. In recent years, rapid developments in technologies have opened new avenues for measuring behavior of wild animals, one of which is the application of computer vision to replace manual observation from images and videos. Recent developments in computer vision have shown impressive applications for collecting behavior data in field conditions (outdoor), from 2D 64 ; 25 ; 33 ; 61 ; 17 and 3D posture estimation 58 ; 13 ; 31 to action recognition 10 ; 3 ; 23 ; 57 and individual re-identification 53 ; 34 ; 21 . However, large-scale or long-term deployment of these applications is still limited mainly due to two problems. Firstly, computer vision research focuses on solving specific tasks such as object detection, re-id or keypoint estimation, whereas long-term monitoring often requires multiple computer vision tasks to be solved simultaneously. In long-term monitoring, biologists are generally interested in identifying who did what behavior. To achieve automated monitoring, re-identification and behavioral recognition tasks have to be solved together, either directly or using supporting sub-tasks like detection, tracking and keypoint estimation. Therefore, the classic strategy of developing task-specific methods is not suitable for behavioral monitoring because often it is difficult to readily combine and deploy novel algorithms directly for data collection. This challenge can be alleviated by curating large datasets with annotations to solve multiple tasks using the same real-world data. Secondly, traditional benchmarking processes lack additional metrics to support deployment for biological applications. While some recently published datasets provide annotations for solving a larger range of computer vision tasks (See supplementary; 46 ; 37 ; 18 ; 48 ; 47 ; 36 ), benchmarking is often done for each individual task in isolation. This creates ambiguity for users while selecting methods for deployment, because task specific benchmarking does not reflect the impact of choosing a specific method on the final biological measurements. The unpredictable nature of error propagation is demonstrated with recent case studies 49 ; 9 , and a possible solution is to include a benchmarking mechanism that allows tasks to be combined and tested. In this paper, we address these problems and introduce computer vision solutions for long-term, individual-level behavioral monitoring in the wild. Firstly, we present the CHIRP dataset ( C ombining be H aviour I ndividual R e-identification and P ostures), the first dataset focusing on social behaviors in a wild bird population, the Siberian jay ( Perisoreus infaustus ), a group living corvid. Secondly, we present the application-specific benchmark, a novel evaluation paradigm that makes use of application-specific metrics like feeding rate and co-occurrence rates of individuals. Our benchmarking allows novel methods to be directly tested for their impact on the final biological measurement, encouraging method optimizations for downstream applications instead of individual tasks. Thirdly, we introduce CORVID ( CO lou R -based V ideo re- ID entification), a novel automatic re-id framework as a baseline for the application specific benchmark, by identifying birds via individual color rings. While color leg rings are widely used to mark individuals in wild bird populations 2 ; 7 , to the best of our knowledge, we present the first computer vision framework to automatically identify individual birds using color rings. We hope this work can illustrate how datasets and evaluation procedures can be designed with clear deployment objectives, to allow novel computer vision methods to be better applied for downstream biological understanding. Figure 2 : Summary of leg color ring definitions and naming convention of the Siberian jays. A) Sample image of an individual, and a list of the different color rings . Ring positions are defined as top/bottom left/ right from the bird’s perspective. B) Class distribution of ring masks provided in the ring segmentation dataset. C) Naming convention, each bird is named in the order of top left, bottom left, top right, bottom right ring. The color combination of bird in the picture is oaor: orange (o), aluminium (a), orange (o), red (r). 2 Related Works Over the last decade, the popularity of animal-specific datasets has increased significantly. Initial datasets included task-specific data to tackle computer vision problems such as detection and tracking 66 ; 59 , 2D and 3D keypoint estimation 31 ; 17 ; 39 ; 65 ; 35 , action recognition 4 ; 5 ; 11 ; 24 ; 32 and re-identification (see 8 ). These datasets have contributed to bringing computer vision innovations to animal studies, allow biodiversity monitoring to be scaled and automated 55 . However, it is widely acknowledged that long-term studies involve solving multiple computer vision tasks together. In response, recent

Read the complete text