Compact Hypercube Embeddings for Fast Text-based Wildlife Observation Retrieval
Ilyass Moummad, Marius Miron, David Robinson, Kawtar Zaher, Hervé Goëau, Olivier Pietquin, Pierre Bonnet, Emmanuel Chemla, Matthieu Geist, Alexis Joly · 2026
Read Compact Hypercube Embeddings for Fast Text-based Wildlife Observation Retrieval by Ilyass Moummad, Marius Miron, David Robinson, Kawtar Zaher, Hervé Goëau, Olivier Pietquin, Pierre Bonnet, Emmanuel Chemla, Matthieu Geist, Alexis Joly (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-22783.txt.
Introduction
Ilyass Moummad and a team speed wildlife record search by packing text codes into compact hypercubes. Biodiversity platforms hold vast archives of sightings, sounds, and notes. Their 2026 preprint notes that rich foundation-model codes make search slow at that scale, due to high-dimensional matching.
Compact codes cut the cost of finding like records. Fast retrieval helps trackers spot trends and rare events in time. The work serves field science with a systems fix. It keeps meaning while shrinking size. That trade is the whole game at archive scale. The gain grows as the archive grows.
Catalog record
| CREATOR | Ilyass Moummad, Marius Miron, David Robinson, Kawtar Zaher, Hervé Goëau, Olivier Pietquin, Pierre Bonnet, Emmanuel Chemla, Matthieu Geist, Alexis Joly |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 24 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-22783
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Compact Hypercube Embeddings for Fast Text-based Wildlife Observation Retrieval Ilyass Moummad, Marius Miron, David Robinson, Kawtar Zaher, Hervé Goëau, Olivier Pietquin, Pierre Bonnet, Emmanuel Chemla, Matthieu Geist, Alexis Joly Abstract Large-scale biodiversity monitoring platforms increasingly rely on multimodal wildlife observations. While recent foundation models enable rich semantic representations across vision, audio, and language, retrieving relevant observations from massive archives remains challenging due to the computational cost of high-dimensional similarity search. In this work, we introduce compact hypercube embeddings for fast text-based wildlife observation retrieval , a framework that enables efficient text-based search over large-scale wildlife image and audio databases using compact binary representations. Building on the cross-view code alignment hashing framework, we extend lightweight hashing beyond single-modality setup to align natural language descriptions with visual or acoustic observations in a shared Hamming space. Our approach leverages pretrained wildlife foundation models, including BioCLIP, and BioLingual, and adapts them efficiently for hashing using parameter-efficient fine-tuning. We evaluate our method on large-scale benchmarks, including iNaturalist2024 for text-to-image retrieval and iNatSounds2024 for text-to-audio retrieval, as well as multiple soundscape datasets to assess robustness under domain shift. Results show that retrieval using the discrete hypercube embeddings achieves competitive—and in several cases superior—performance compared to the continuous embeddings, while drastically reducing memory and search cost. Moreover, we observe that the hashing objective consistently improves the underlying encoder representations, leading to stronger retrieval and zero-shot generalization. These results demonstrate that binary, language-based retrieval enables scalable and efficient search over large wildlife archives for biodiversity monitoring systems. 1 1 1 Our code will be publicly available after review. I Introduction Global biodiversity monitoring increasingly relies on massive collections of wildlife observations, including images and audio recordings, from camera traps [ 23 ] , passive acoustic monitoring [ 1 ] , citizen science observation databases [ 6 ] . Platforms such as iNaturalist [ 25 ] , eBird [ 22 ] , and Pl@ntNet [ 7 ] now host tens to hundreds of millions of observations spanning thousands of species, with new data continuously added. Beyond their sheer scale, these collections are inherently multimodal, combining visual, acoustic, and textual information. As a result, retrieving relevant observations from large and heterogeneous biodiversity archives has become a central challenge. Most existing systems address biodiversity data through species classification , predicting a single taxonomic label for an image or an audio recording [ 7 , 13 ] . While classification-based pipelines have achieved impressive accuracy, they are insufficient for many real-world biodiversity workflows. Ecologists may wish to retrieve all observations corresponding to a species using its scientific or common name, conservation practitioners may explore visually or acoustically similar observations, and citizen scientists may issue natural language queries describing organisms or behaviors rather than exact taxonomic labels [ 27 ] . These use cases call for retrieval-oriented systems that support flexible, text-based querying over large multimodal wildlife data. Several deployed tools, such as BirdNET [ 13 ] for birds and Pl@ntNet [ 7 ] for plants, demonstrate that accurate species identification can be achieved on resource-constrained devices. However, these systems are designed for closed-set classification rather than general-purpose retrieval. On the retrieval side, recent benchmarks have begun to emphasize retrieval as a more realistic paradigm for biodiversity monitoring. BIRB [ 9 ] introduces an audio-to-audio retrieval task in bioacoustics, while INQUIRE [ 27 ] targets text-to-image retrieval for nature imagery. Although these efforts highlight the importance of retrieval, they rely on high-dimensional continuous embeddings and do not explicitly address the representation and storage constraints encountered in large-scale biodiversity platforms [ 5 ] . Scalability is a fundamental concern in biodiversity applications [ 24 ] . Wildlife datasets are not only large, but are often accessed on mobile devices [ 7 ] or processed by embedded sensors deployed in the field [ 5 ] . Modern vision–language and audio–language foundation models produce highly expressive continuous embeddings, but storing and comparing such representations at scale remains challenging. As biodiversity archives continue to grow, representation choices become increasingly important for enabling practical retrieval systems. Hashing provides a principled alternative by mapping continuous representations into compact binary codes that preserve semantic similarity [ 15 ] . Binary representations enable retrieval using Hamming distance and allow similarity search to be implemented using simple bitwise operations. Hashing has been extensively studied in computer vision and cross-modal retrieval, yet it has received little attention in the context of biodiversity monitoring, despite its natural fit for large-scale and multimodal wildlife data. In this work, we introduce a unified framework for text-based retrieval of wildlife observations in hypercube embeddings . Building on the Cross-View Code Alignment (CroVCA) hashing framework [ 16 ] , we extend lightweight hashing beyond single-modality settings to align natural language descriptions with visual or acoustic observations in a shared Hamming space. Our approach leverages pretrained wildlife foundation models, including BioCLIP and BioLingual, and adapts them to binary retrieval using parameter-efficient fine-tuning. This design enables language-driven retrieval over large collections of wildlife images and sounds while preserving the semantic structure learned by pretrained multimodal encoders. This work makes the following contributions: • We introduce the first framework for text-based wildlife retrieval using binary hypercube embeddings , enabling language-driven search over large-scale image and audio biodiversity datasets. • We extend cross-view code alignment to a cross-modal setting, aligning textual descriptions with visual and acoustic observations in a shared Hamming space using lightweight hashing heads. • We empirically show that training with a cross-modal hashing objective can improve representation quality , leading to stronger retrieval performance and improved zero-shot generalization under domain shift. II Related Work Early work in computational biodiversity has primarily focused on species classification, where models predict a single taxonomic label for an image or audio recording [ 7 , 13 ] . While effective for identification, classification-centric approaches are limited in their ability to support exploratory analysis, open-ended search, and interaction with large biodiversity archives. As a result, recent work has increasingly emphasized retrieval as a complementary paradigm for biodiversity monitoring [ 9 , 27 ] . In bioacoustics, the BIRB benchmark [ 9 ] introduced a retrieval-oriented evaluation protocol by measuring a system’s ability to retrieve acoustically similar bird vocalizations rather than performing closed-set classification. This formulation better reflects ecological workflows such as validating detections and analyzing call variation, but focuses exclusively on audio-to-audio retrieval and relies on continuous embeddings. Beyond audio, INQUIRE [ 27 ] proposes a benchmark for text-to-image retrieval in the natural world, highlighting the potential of language-based interfaces for biodiversity exploration. However, retrieval is again performed using high-dimensional continuous representations, and scalability or representation constraints are not explicitly addressed. Existing benchmarks therefore either focus on a single modality or do not consider the representation challenges inherent to large-scale biodiversity platforms [ 5 ] . In particular, text-to-audio retrieval for wildlife monitoring remains largely unexplored. Recent advances in foundation models have significantly improved representation learning for biodiversity data [ 19 , 21 , 8 , 20 ] . Vision–language models such as BioCLIP [ 21 ] and BioCLIP-2 [ 8 ] learn semantically rich embeddings from large-scale image–text supervision, while audio–language models such as BioLingual [ 19 ] align bioacoustic recordings with textual descriptions, enabling zero-shot classification and retrieval. Although these models support