3 rd Workshop on Maritime Computer Vision (MaCVi) 2025: Challenge Results
Benjamin Kiefer, Lojze Žust, Jon Muhovič, Matej Kristan, Janez Perš, Matija Teršek, Uma Mudenagudi, Chaitra Desai, Arnold Wiliem, Marten Kreis, Nikhil Akalwadi, Yitong Quan, Zhiqiang Zhong, Zhe Zhang, Sujie Liu, Xuran Chen, Yang Yang, Matej Fabijanić, Fausto Ferreira, Seongju Lee, Junseok Lee, Kyoob · 2025
Read 3 rd Workshop on Maritime Computer Vision (MaCVi) 2025: Challenge Results by Benjamin Kiefer, Lojze Žust, Jon Muhovič, Matej Kristan, Janez Perš, Matija Teršek, Uma Mudenagudi, Chaitra Desai, Arnold Wiliem, Marten Kreis, Nikhil Akalwadi, Yitong Quan, Zhiqiang Zhong, Zhe Zhang, Sujie Liu, Xuran Chen, Yang Yang, Matej Fabijanić, Fausto Ferreira, Seongju Lee, Junseok Lee, Kyoob (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-10343.txt.
Introduction
Benjamin Kiefer and co-authors report, in a 2025 paper, the results of the third Maritime Computer Vision workshop challenges. The contests target vision systems for unmanned surface vehicles and underwater craft. Sea settings are hard for cameras: glare, spray, small distant objects, and shifting light. The report gives a full overview of what the competing teams built and how they scored.
More than seven hundred entries came in across the challenges. The authors review the results with both hard numbers and close reading of sample outputs, tracing trends in the methods used. All the data sets, scoring code, and the live leaderboard are public. The report serves as a snapshot of where sea-going machine vision stands and what still trips it up.
Catalog record
| CREATOR | Benjamin Kiefer, Lojze Žust, Jon Muhovič, Matej Kristan, Janez Perš, Matija Teršek, Uma Mudenagudi, Chaitra Desai, Arnold Wiliem, Marten Kreis, Nikhil Akalwadi, Yitong Quan, Zhiqiang Zhong, Zhe Zhang, Sujie Liu, Xuran Chen, Yang Yang, Matej Fabijanić, Fausto Ferreira, Seongju Lee, Junseok Lee, Kyoob |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 86 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-10343
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
3 rd Workshop on Maritime Computer Vision (MaCVi) 2025: Challenge Results Benjamin Kiefer, Lojze Žust, Jon Muhovič, Matej Kristan, Janez Perš, Matija Teršek, Uma Mudenagudi, Chaitra Desai, Arnold Wiliem, Marten Kreis, Nikhil Akalwadi, Yitong Quan, Zhiqiang Zhong, Zhe Zhang, Sujie Liu, Xuran Chen, Yang Yang, Matej Fabijanić, Fausto Ferreira, Seongju Lee, Junseok Lee, Kyoobin Lee, Shanliang Yao, Runwei Guan, Xiaoyu Huang, Yi Ni, Himanshu Kumar, Yuan Feng, Yi-Ching Cheng, Tzu-Yu Lin, Chia-Ming Lee, Chih-Chung Hsu, Jannik Sheikh, Andreas Michel, Wolfgang Gross, Martin Weinmann, Josip Šarić, Yipeng Lin, Xiang Yang, Nan Jiang, Yutang Lu, Fei Feng, Ali Awad, Evan Lucas, Ashraf Saleem, Ching-Heng Cheng, Yu-Fan Lin, Tzu-Yu Lin, Chih-Chung Hsu, KLE Technological University, Nanjing University of Science, Technology, of Science, Technology (GIST), University of Liverpool, Hong Kong, University of Science, Technology (Guangzhou), Xi’an Jiaotong-Liverpool University Abstract The 3 rd {}^{\text{rd}} Workshop on Maritime Computer Vision (MaCVi) 2025 addresses maritime computer vision for Unmanned Surface Vehicles (USV) and underwater. This report offers a comprehensive overview of the findings from the challenges. We provide both statistical and qualitative analyses, evaluating trends from over 700 submissions. All datasets, evaluation code, and the leaderboard are available to the public at https://macvi.org/workshop/macvi25 . 1 Introduction (a) Distance Estimation (b) Obstacle Segmentation (c) Panoptic Segmentation (d) Image Restoration Figure 1 : Overview of MaCVi2025 challenges. Challenges include USV-based (a) Distance Estimation, (b) Regular and Embedded Obstacle Segmentation, (c) Panoptic Segmentation, and UUV-based (d) Image Restoration. Maritime environments, with their unique challenges such as dynamic lighting, reflections, and cluttered scenes, demand specialized computer vision techniques [ 65 , 54 , 31 , 24 , 33 ] . Autonomous systems like Unmanned Surface Vehicles (USVs) and Underwater Vehicles (UUVs) rely heavily on robust vision algorithms to navigate, detect, and interpret complex surroundings [ 84 , 5 , 34 ] . Addressing these challenges requires not only cutting-edge algorithms but also standardized benchmarks and a collaborative research ecosystem [ 38 , 6 , 18 , 4 ] . The 3 rd Workshop on Maritime Computer Vision (MaCVi 2025) builds on the momentum of the previous two iterations [ 32 , 35 ] to foster innovation in maritime computer vision. This year, the workshop presented a suite of challenges, including distance estimation, (embedded) semantic & panoptic segmentation, and image restoration. These tasks reflect advancements in dataset availability and evaluation protocols while emphasizing real-world deployment, including embedded hardware. This report highlights the methodologies, results, and insights from the MaCVi 2025 challenges. The rest of the paper is structured as follows: Section 2 details the general challenge protocols while Sections 3 and 4 discuss the outcomes of individual tracks. All datasets, evaluation tools, and leaderboards are available at https://macvi.org/workshop/macvi25 . 2 Challenge Participation Protocol As for the first two challenge iterations, all challenges followed a superset of rules and protocols outlined in this section while challenge specific rules are described in the respective subsections. 2.1 Submission Process Participants could get the challenge rules and resources on the workshop webpages. There, we provided links to evaluation code, datasets and starter kits. Then, participants submitted their models and predictions through the official evaluation server. General submission requirements included: • Predictions formatted according to standardized task-specific formats. • Compliance with model submission guidelines, including export to ONNX format where applicable. • A limit of 1-3 submission per day per challenge track. 2.2 Evaluation Server and Leaderboard An online evaluation server provided automated scoring for all submissions. Test set evaluations were conducted on the server, with results displayed on public leaderboards. The leaderboards were frozen (results of each method visible only to its authors) a week prior to the results announcement to encourage competition and submissions without relying on the results from other teams. 2.3 Timeline The timeline for all MaCVi 2025 challenges was: • Submissions open: 13th Sep 2024 • Leaderboards frozen: 12th Dec 2024 • Submissions closed: 19th Dec 2024 2.4 Recognition and Rewards After additional manual review of the submissions, the top team(s) in each challenge were determined by the challenge-specific metrics and whether the performance was above the provided baselines. They then were invited to submit a short technical report detailing their methods. These reports will are included in the appendix below. Winners were also acknowledged during the workshop and featured on the official website. Additionally, there were prizes for some of the competitions as described on the workshop website. 3 USV-based Perception Challenges 3.1 Approximate Supervised Distance Estimation Distance estimation using monocular vision is a complex problem that has gained considerable attention in recent years due to its key role in fields such as autonomous driving and robotics [ 51 ] . This approach is equally crucial for maritime applications, where it can support essential tasks such as navigation and path planning for unmanned surface vehicles (USVs). State-of-the-art monocular depth estimation frameworks, such as MiDAS [ 57 ] and SPI-Depth [ 39 ] , show significant limitations for this type of application, particularly in terms of real-time performance and accuracy for smaller, distant objects. In addition, many of these approaches generate depth maps with values normalized between 0 and 1, rather than providing the metric distances required for practical use. In the context of this challenge, participants are required to develop novel methods for estimating distances to maritime navigational aids while simultaneously detecting them in images. To facilitate this, we provide a dataset comprising approximately 3,000 labeled training samples, including single-class normalized bounding-box coordinates and the metric distance between the camera and the object. The ground truth distance is calculated using the Haversine formula, which computes the distance between the GNSS coordinates of the ship, where the camera is mounted, and the corresponding navigational buoys as mapped on a nautical chart. Additionally, participants are provided with a modified version of the YOLOv7 object detector [ 67 ] , similar to an approach developed by Vajgl et al. [ 64 ] , where the predicted tensor for each anchor consisting of [ c_{x} , c_{y} , w , h , p_{obj} , p_{class\_1} , …, p_{class\_n} ] is extended by a distance estimate. Figure 2 : Distribution of samples in the training ( ) and test ( ) splits with respect to the ground truth distance The complete dataset includes 2,940 annotated images in the training split and 2,268 in the test split. A detailed distribution of individual objects in both splits, categorized by ground truth distance, is depicted in Figure 2 . We chose to include challenging scenarios where buoys are distant and barely visible, aiming to assess the limits of the object detection models. Maritime navigational aids exhibit significant variation in size and appearance. Figure 3 highlights the most common buoy types, predominantly comprising red and green channel markers. 3.1.1 Evaluation Protocol To evaluate the methods submitted by participants, we utilize metrics that assess both object detection performance and distance estimation accuracy. For object detection performance, we employ well-established metrics, specifically AP_{50} and AP_{50:95} . The AP_{50} metric calculates the average precision across varying confidence thresholds with an IoU threshold of 50\% . In contrast, AP_{50:95} averages the precision over a range of IoU thresholds from 50\% to 95\% in increments of 5\% . To evaluate the deviation of distance estimates