SmartWilds: Multimodal Wildlife Monitoring Dataset
Jenna Kline, Anirudh Potlapally, Bharath Pillai, Tanishka Wani, Vedant Patil, Penelope Covey, Rugved Katole, Hari Subramoni, Tanya Berger-Wolf, Christopher Stewart · 2025
Read SmartWilds: Multimodal Wildlife Monitoring Dataset by Jenna Kline, Anirudh Potlapally, Bharath Pillai, Tanishka Wani, Vedant Patil, Penelope Covey, Rugved Katole, Hari Subramoni, Tanya Berger-Wolf, Christopher Stewart (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-18894.txt.
Introduction
Watching wildlife with one sensor type leaves blind spots; drones miss sound, and traps miss the wide view. Jenna Kline and nine co-authors present SmartWilds, a synchronized multi-sensor data set, in this 2025 paper. It was gathered over four days in summer 2025 at a safari park in Ohio. A 220-acre pasture hosts deer, takin, and wild horses, plus native species.
Drone imagery, camera trap photos and video, and sound recordings were captured in sync. The team compares what each mode does best. The modes complement each other across land use, species detection, behavior, and habitat checks. Standard protocols make the setup repeatable at other sites. Future releases will add GPS tracks from tagged animals, citizen science data, and more seasons. The authors offer the set as open fuel for conservation AI. It targets endangered species research and habitat management.
Catalog record
| CREATOR | Jenna Kline, Anirudh Potlapally, Bharath Pillai, Tanishka Wani, Vedant Patil, Penelope Covey, Rugved Katole, Hari Subramoni, Tanya Berger-Wolf, Christopher Stewart |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 17 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-18894
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
SmartWilds: Multimodal Wildlife Monitoring Dataset Jenna Kline, Anirudh Potlapally, Bharath Pillai, Tanishka Wani, Vedant Patil, Penelope Covey, Rugved Katole, Hari Subramoni, Tanya Berger-Wolf, Christopher Stewart Abstract We present the first release of SmartWilds, a multimodal wildlife monitoring dataset. SmartWilds is a synchronized collection of drone imagery, camera trap photographs and videos, and bioacoustic recordings collected during summer 2025 at The Wilds safari park in Ohio. This dataset supports multimodal AI research for comprehensive environmental monitoring, addressing critical needs in endangered species research, conservation ecology, and habitat management. Our pilot deployment captured four days of synchronized monitoring across three modalities in a 220-acre pasture containing Pere David’s deer, Sichuan takin, Przewalski’s horses, as well as species native to Ohio, including bald eagles, white-tailed deer, and coyotes. We provide a comparative analysis of sensor modality performance, demonstrating complementary strengths for landuse patterns, species detection, behavioral analysis, and habitat monitoring. This work establishes reproducible protocols for multimodal wildlife monitoring while contributing open datasets to advance conservation computer vision research. Future releases will include synchronized GPS tracking data from tagged individuals, citizen science data, and expanded temporal coverage across multiple seasons. 1 Introduction Conservation biology requires comprehensive ecosystem monitoring to inform evidence-based management decisions, yet traditional approaches provide fragmented views of wildlife activity and habitat use. The integration of multiple sensing modalities, powered by edge AI and computer vision approaches offers transformative opportunities for automated environmental monitoring at unprecedented scales ( Besson et al., 2022 ; Tuia et al., 2022 ; Pringle et al., 2025 ; Kline et al., 2025 ) . Our research advances multimodal AI for wildlife monitoring by creating datasets and models that enable object detection and tracking across environmental conditions, support fine-grained species classification from multi-sensor data, and facilitate behavioral analysis from long video sequences. We present a multimodal dataset from sensor deployments at The Wilds Conservation Center ( The Wilds, 2025 ) 1 1 1 https://imageomics.github.io/naturelab/ . Our dataset was curated to evaluate multi-sensor fusion techniques and benchmark machine learning approaches for conservation applications across visual, acoustic, and environmental data streams. This dataset poses challenges to existing computer vision methods through its combination of rare species detection, variable conditions, and the need for behavioral state recognition over extended time periods. This work supports research areas including endangered species monitoring, conservation and restoration ecology, and habitat assessment for both exotic endangered species and native biodiversity conservation. Our contributions include: (1) a synchronized multimodal ecological dataset with comprehensive metadata, (2) reproducible protocols for environmental monitoring sensor networks, and (3) support for sensor fusion to advance multimodal learning research in environmental contexts. The rest of the paper is organized as follows: Section 2 reviews related works on multi-modal sensor fusion for ecological research; Section 3 describes the study site and sensor network design; Section 4 details the dataset, including camera trap, bioacoustic, drone, and metadata. Section 5 includes field observation, discusses the strengths and weaknesses of the sensing modalities and how the pilot study informed additional data collection; Section 6 includes details about future data releases and work in progress. Figure 1: Representative images and data study design. GPS and time-stamp metadata allow for cross-referencing between modalities. (a) Diagram of dataset modalities, citizen science images, GPS tags, acoutic data, camera trap and drone images, joined via location and time-stamp metadata. (b) Example of multi-modal data cross-referencing using metadata. Camera trap view (TW02) of Pere David’s deer synchronized with drone image of Pere David’s deer wading in lake. 2 Related Work Recent advances have introduced multimodal wildlife monitoring datasets addressing diverse conservation challenges ( Smith and Pinter-Wollman, 2021 ; Buxton et al., 2018 ; Besson et al., 2022 ) . MammAlps ( Gabeff et al., 2025 ) combines multi-view video with synchronized audio data to analyze wild mammal behaviors in alpine environments, demonstrating the power of multimodal approaches for detailed behavioral analysis. BuckTales ( Naik et al., 2024 ) provides multi-UAV tracking data for wild antelope identification and re-identification, advancing techniques for individual animal monitoring. The PanAf-FGBG dataset ( Brookes et al., 2025 ) explores how environmental backgrounds impact wildlife behavior recognition, while YOLO-Behaviour ( Chan et al., 2025 ) demonstrates automated behavior quantification frameworks. KABR ( Kholiavchenko et al., 2024 ) focuses on Kenyan wildlife behavior recognition from drone footage, contributing to conservation AI in African ecosystems. However, most existing datasets focus on specific taxonomic groups or behavioral tasks rather than comprehensive ecosystem monitoring. Our work contributes synchronized multi-sensor data collection protocols designed specifically for conservation digital twin development, with planned integration of GPS tracking data for individual-level behavioral analysis. 3 Field Deployment and Data Collection 3.1 Study Site The Wilds is a 10,000-acre conservation center in southeastern Ohio, home to endangered species conservation programs and native wildlife restoration efforts ( The Wilds, 2025 ) . Our pilot deployment focused on a single 220-acre enclosure containing a breeding population of GPS-tagged Pere David’s deer ( Elaphurus davidianus ), chosen specifically to enable future integration with individual tracking data. Sensor sites were selected chronologically based on observed wildlife activity patterns and strategic coverage of diverse habitat types within the study pasture, illustrated in Fig. 2 and described in Table 3 . Camera trap sites prioritized high deer activity areas, particularly around water sources, while bioacoustic monitors targeted diverse acoustic environments from open grasslands to woodland edges. Where possible, existing structures were utilized for sensor mounting to minimize environmental impact and maximize equipment protection. 3.2 Sensor Network Design The multimodal sensor network consisted of three complementary sensing technologies deployed for four days of continuous monitoring (June 30 - July 3 2025). Four camera traps, including GardePro T5NG and comparable trail camera models, were strategically positioned around lakes and wildlife congregation areas using motion-triggered photo/video hybrid mode to capture animal activity at key locations. See Table 3 for details on site selection. Four bioacoustic monitors (Song Meter Mini devices) recorded high-quality 48kHz, 16-bit mono audios. Multiple drone missions using Parrot ANAFI quadcopters provided flexible aerial coverage through systematic surveys and opportunistic behavioral tracking, with dedicated synchronization flights conducted within view of camera traps to enable precise cross-modal timestamp calibration. This integrated sensor array enabled comprehensive multimodal data collection across fixed monitoring locations and dynamic aerial observations. Figure 2: Map of sensor placements created with Google Earth. Camera trap locations in orange, bioacoustics sensors in blue, drone flight paths in red. See Table 3 for site details. 4 Dataset The multi-modal dataset is summarized in Table 4 . The initial dataset release totals 101GB and over 20K files. The dataset is organized by sensor type and deployment location, with standardized metadata for each component. 4.1 Camera trap data Camera trap data consists of motion-triggered images and videos organized by deployment site (TW01-TW04), providing comprehensive visual documentation specifically structured for object detection, tracking, and fine-grained classification of wildlife species. The systematic capture of animal behaviors and interactions across multiple camera locations enables localization and recognition tasks in naturalistic settings with varying environmental conditions and species compositions. 4.2 Bioacoustic data Bioacoustic recordings from continuous and scheduled monitoring (TW05-TW08) were collected to enable multi-sensor fusion research that combines acoustic representations with visual data streams. Half of the monitors were configured to record 5 minutes every hour to capture ungulate