SuoiAI: Building a Dataset for Aquatic Invertebrates in Vietnam
Tue Vo, Lakshay Sharma, Tuan Dinh, Khuong Dinh, Trang Nguyen, Trung Phan, Minh Do, Duong Vu · 2025
Read SuoiAI: Building a Dataset for Aquatic Invertebrates in Vietnam by Tue Vo, Lakshay Sharma, Tuan Dinh, Khuong Dinh, Trang Nguyen, Trung Phan, Minh Do, Duong Vu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-15252.txt.
Introduction
Tue Vo and seven co-authors build a data pipeline for water invertebrates in Vietnam in a 2025 arXiv paper. Small water creatures are fine gauges of river and lake health. Yet photo data for naming them in Vietnam is scarce, and hand labeling is slow.
Their pipeline, SuoiAI, covers the full path from field collection to a trained naming model. It leans on partial self teaching to cut the labeling load: a model trained on a small checked set helps tag the rest. Off the shelf tools spot each creature in a photo and sort it by kind. The team aims at hard cases too, such as telling near twin species apart and working in mixed field settings. The set is meant to back watch programs for Vietnam's waters.
Catalog record
| CREATOR | Tue Vo, Lakshay Sharma, Tuan Dinh, Khuong Dinh, Trang Nguyen, Trung Phan, Minh Do, Duong Vu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 10 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-15252
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
SuoiAI: Building a Dataset for Aquatic Invertebrates in Vietnam Tue Vo, Lakshay Sharma, Tuan Dinh, Khuong Dinh, Trang Nguyen, Trung Phan, Minh Do, Duong Vu Abstract Understanding and monitoring aquatic biodiversity is critical for ecological health and conservation efforts. This paper proposes SuoiAI, an end-to-end pipeline for building a dataset of aquatic invertebrates in Vietnam and employing machine learning (ML) techniques for species classification. We outline the methods for data collection, annotation, and model training, focusing on reducing annotation effort through semi-supervised learning and leveraging state-of-the-art object detection and classification models. Our approach aims to overcome challenges such as data scarcity, fine-grained classification, and deployment in diverse environmental conditions. 1 Introduction Aquatic invertebrates play a vital role in aquatic ecosystems and serve as indicators of water quality. For instance, streams are relatively small running surface water systems, yet they support an exceptionally high invertebrate biodiversity relative to their size. Stream invertebrates form a highly diverse group, encompassing insects, crustaceans, annelids, mollusks, and bivalves. These organisms play crucial roles in aquatic biogeochemical cycling and facilitate interactions between aquatic and terrestrial ecosystems. The lack of comprehensive datasets for these species, especially in biodiverse regions like Vietnam, poses significant challenges for ecological research and conservation. This paper proposes SuoiAI, a pipeline to build a robust dataset for aquatic invertebrates and leverage ML techniques for efficient species classification (Suoi means streams in Vietnamese). By addressing the data collection and annotation challenges, our work aims to facilitate scalable and accurate aquatic biodiversity monitoring in global hotspots like Vietnam. 1.1 Problem Description Vietnam’s aquatic ecosystems remain underrepresented in global biodiversity databases. Of over 100,000 freshwater invertebrate species described globally, only 2,000 have been identified in Vietnam, with 800 aquatic species lacking systematic documentation ( Thuaire et al. 2021 ). This significant gap limits our ability to assess aquatic health and understand climate change’s impact on biodiversity. Without a comprehensive database, conservation efforts and policy decisions remain uninformed. Building Vietnam’s first aquatic/ invertebrate database would address this foundational gap, enabling scalable and accurate biodiversity assessments. SuoiAI aims to leverage modern AI/ML techniques to overcome traditional field collection’s limitations, delivering a transformative tool for biodiversity conservation and supporting global sustainability goals. 1.2 Related Works There are a few datasets for aquatic invertebrates, most notably the iNaturalist Species Classification and Detection Dataset ( Horn et al. 2018 ), the Benthic Macroinvertebrate Database from the Stroud Water Research Center 1 1 1 https://stroudcenter.org/macros/ , and the Freshwater Biological Traits Database from the Environmental Protection Agency (EPA) 2 2 2 https://www.epa.gov/risk/freshwater-biological-traits-database-traits . However, many of these projects focus on American or European species and contain very little information for species from the tropical aquatic environment in Southeast Asia. There have been a number of projects that aim to use automatic camera capture to study aquatic and marine invertebrates ( Heuschele et al. 2019 , Albini et al. 2024 ). In late 2024, Microsoft’s AI for Good Lab also announced Project SPARROW (Solar-Powered Acoustic and Remote Recording Observation Watch) 3 3 3 https://blogs.microsoft.com/on-the-issues/2024/12/18/announcing-sparrow-a-breakthrough-ai-tool-to-measure-and-protect-earths-biodiversity-in-the-most-remote-places/ , which is an AI-powered edge computing solution designed to operate autonomously in remote corners of the planet to collect and process biodiversity data from sensors with edge GPUs and transmit via low-Earth orbit satellites directly to the cloud. SuoiAI can collaborate with Project SPARROW and other related projects to develop solar-powered aquatic cameras that can operate autonomously in the rainforests of Vietnam and Southeast Asia. 2 Dataset Collection Setup 2.1 Data Acquisition Our solution proposes deploying underwater cameras in key aquatic ecosystems across Vietnam, including rivers, lakes, and coastal areas. The resolution of the cameras will be set to 1080p to balance image quality and storage requirements. Specimen density in the images will range between 1 to 5 specimens per image, minimizing occlusion and ensuring clear captures. Size of each invertebrate is about 10-50mm. Sampling will be conducted across various ecosystems to ensure diversity and generalizability of the dataset. Our initial field test sites include two important biological reserves of Vietnam: Cat Tiên national park and Cuc Phuong national park. The system’s geographic coverage can expand to 135 sites nationwide, across latitudinal, altitudinal, and anthropogenic intensity gradients. Our automated systems are designed to generate around three million data points per site annually. 2.2 Annotation Strategy To create a labeled dataset, we will begin with the manual labeling of a few hundred high-quality images for genus and species identification. Annotation tools like LabelImg and VIA will be utilized for bounding box and segmentation mask creation. Our annotators include biologists and scientists who are familiar with Vietnamese species. We will also look to include existing datasets of regional invertebrates to create the initial dataset. Given the high cost of manual annotation, we propose several strategies to minimize effort. Initially, a teacher model, similar to Chen et al. 2023 , will be trained on manually labeled data to label additional images, which will then be used to iteratively train student models. This bootstrap labeling process reduces reliance on manual annotations. Few-shot and zero-shot learning have been explored to utilize pre-trained models like CLIP and Segment Anything Model ( Ravi et al. 2024 ) for classification and segmentation of unseen insect and vertebrate species ( Feuer et al. 2024 , Blair et al. 2022 , Lu et al. 2024 , Villon et al. 2021 ). Alternative approaches such as computing clustering with vision embeddings will also help to group similar images to streamline targeted annotation (such as MorphoCluster by Schröder et al. 2020 ). Figure 1: An end-to-end diagram of our pipeline 3 Modeling Techniques 3.1 Baseline Object Detection We propose using conventional neural networks for object detection. Models like YOLO ( Redmon et al. 2016 ) or Faster R-CNN ( Ren et al. 2016 ) variants are older but small enough to be deployable on-device and therefore can serve as a reliable baseline. Models like SwinTransformer ( Liu et al. 2021 ) and DETR ( Carion et al. 2020 ) are newer and more accurate, but have more parameters and may be operable only in the cloud. However, these methods depend on large labeled datasets and require retraining for new species, which can be time-intensive. 3.2 Training-Free and Semi-supervised Methods To complement supervised methods, training-free and semi-supervised approaches will be employed. Segment Anything Model (SAM) will be used for prompt-based segmentation with bounding boxes or points. While SAM is scalable and training-free, it may have limitations in accuracy for novel species. Semi-supervised learning will employ teacher-student paradigms to refine model predictions iteratively on unlabeled data, in a setup similar to Chen et al. 2023 . 3.3 Fine-grained Image Classification To address high intra-class similarity, fine-grained image classification techniques, similar to Pham et al. 2024 , will be utilized. Classification will be conducted at the genus and species levels (the later being more challenging), with approximately 20-50 genus-level classes and 100-200 species-level classes, with about 1000 labeled samples per class. These techniques will handle long-tail distributions and improve performance on rare classes (such as unknown species or genus). Other techniques to classify taxonomy classes with unknown species and genus include deep hierarchical Bayesian learning (such as Badirli et al. 2023 ). 4 Practical Considerations Deployment challenges will be addressed through a dual-pronged