IAMAP: Unlocking Deep Learning in QGIS for non-coders and limited computing resources
Paul Tresson, Pierre Le Coz, Hadrien Tulet, Anthony Malkassian, Maxime Réjou-Méchain · 2025
Read IAMAP: Unlocking Deep Learning in QGIS for non-coders and limited computing resources by Paul Tresson, Pierre Le Coz, Hadrien Tulet, Anthony Malkassian, Maxime Réjou-Méchain (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-00627.txt.
Introduction
Deep learning inside a common GIS can be opened to non-coders, Paul Tresson and co-authors present in a 2025 paper. Their tool is a QGIS plugin called IAMAP. Remote sensing has entered an AI era, yet deep learning use stayed restricted to specialists. It often requires large reference data sets, substantial computing resources, and strong coding skills, all barriers for field practitioners.
IAMAP builds on self-supervised foundation models that provide robust feature extractors. Such models can often be used reliably in few-shot or zero-shot scenarios, with little or no fine-tuning. The interface streamlines key steps in image analysis, including feature extraction with a wide range of architectures and dimensionality reduction. Readers get a practical route to modern remote sensing without writing code.
Catalog record
| CREATOR | Paul Tresson, Pierre Le Coz, Hadrien Tulet, Anthony Malkassian, Maxime Réjou-Méchain |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 24 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-00627
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
IAMAP: Unlocking Deep Learning in QGIS for non-coders and limited computing resources Paul Tresson, Pierre Le Coz, Hadrien Tulet, Anthony Malkassian, Maxime Réjou-Méchain Abstract 1. Remote sensing has entered a new era with the rapid development of artificial intelligence approaches. However, the implementation of deep learning has largely remained restricted to specialists and has been impractical because it often requires (i) large reference datasets for model training and validation; (ii) substantial computing resources; and (iii) strong coding skills. 2. Here, we introduce IAMAP, a user-friendly QGIS plugin that addresses these three challenges in an easy yet flexible way. IAMAP builds on recent advancements in self-supervised learning strategies, which now provide robust feature extractors, often referred to as foundation models. These generalist models can often be reliably used in few-shot or zero-shot scenarios ( i.e. , with little to no fine-tuning). 3. IAMAP’s interface allows users to streamline several key steps in remote sensing image analysis: (i) extracting image features using a wide range of deep learning architectures; (ii) reducing dimensionality with built-in algorithms; (iii) performing clustering on features or their reduced representations; (iv) generating feature similarity maps; and (v) calibrating and validating supervised machine learning models for prediction. 4. By enabling non-AI specialists to leverage the high-quality features provided by recent deep learning approaches without requiring GPU capacity or extensive reference datasets, IAMAP contributes to the democratization of computationally efficient and energy-conscious deep learning methods. Keywords: Remote sensing, Self-supervised learning, Foundation models, Machine learning, Artificial Intelligence, Consumer hardware. 1 Introduction The integration of remote sensing data with deep learning approaches is currently revolutionizing Earth observation sciences, leading to significant qualitative and quantitative improvements in large-scale predictions ( Zhu et al. 2017 ; Yuan et al. 2020 ; Yasir et al. 2023 ) . However, this revolution comes with a number of challenges. First, over the past decade, most deep learning applications have been highly data-demanding, requiring extensive manual labeling with typically more than one hundred thousands labeled points ( Safonova et al. 2023 ) . In most ecological and environmental science studies, constructing such a large reference dataset, through e.g. , ground observations or photo-interpretation, remains a major barrier to the implementation of deep learning approaches. Second, a common obstacle to the adoption of deep learning is the computing power required to train a model. Training a deep learning model is indeed highly resource-intensive, primarily due to the backpropagation step ( Goodfellow 2016 , see) . As a result, modern deep learning architectures are virtually impossible to train without substantial local Graphics Processing Unit (GPU) capacity or access to high-end computing clusters. Last but not least, implementing deep learning approaches typically requires at least basic coding skills, which has so far restricted their use to users with a minimal background in computer science. The recent development of self-supervised learning (SSL) approaches is a game-changer in the deep learning domain, as exemplified by the success of models like BERT and ChatGPT in natural language processing ( Devlin 2018 ; Achiam et al. 2023 ) . In SSL, the model starts by learning features describing a dataset via a pretext task that does not require a label. In computer vision, several SSL strategies have been proposed, typically belonging to two main categories: contrastive or generative learning. In contrastive learning, several networks view transformed versions of the same data and have to learn to produce robust representation of this data ( e.g. DINOv2 Oquab et al. 2023 or VicReg Bardes et al. 2021 ). In generative learning, a network sees a degraded version of the data (typically, a masked version) and has to learn to generate a non-degraded version ( e.g. , MAE, He et al. 2022 ) ( Shwartz Ziv and LeCun 2024 , for an overview of main SSL approaches, see ) . Once pre-trained on a large set of images, which remains very data- and resource-intensive, the resulting backbone can be referred to as a "foundation model". Like any pre-trained model, this foundation model can then be fine-tuned with a limited number of manually labeled examples to learn a specific downstream task ( e.g. land cover classification or change detection in remote sensing) ( Ericsson et al. 2021 ) . The main difference between a pre-trained self-supervised learning (SSL) model and a pre-trained supervised model lies in their training objectives: SSL models are not constrained by predefined labels and are therefore free to explore and encode the intrinsic structure and diversity of the data, often resulting in more general and transferable representations. In contrast, supervised models are explicitly optimized to perform a specific user-defined task, which can lead to highly specialized representations that may overlook other meaningful features in the data. As such, SSL foundation models can perform well even in low-shot or zero-shot tasks, i.e. using the model as is, with few or no training data. Consequently, SSL models are considered particularly promising for remote sensing tasks, as demonstrated by recent works and initiatives ( Jakubik et al. 2023 ; Cong et al. 2023 ; Xiong et al. 2024 ; Marsocci et al. 2024 ) . In parallel, to the development of SSL, Vision Transformers (ViT) ( Dosovitskiy et al. 2020 ) and their derivatives (such as EVA ( Fang et al. 2023 ) or Hiera ( Ryali et al. 2023 ) ) have changed the state of the art of computer vision. In a ViT, an image is analyzed by patches (usually 16\times 16 or 14\times 14 pixels). Each patch is projected in an embedding space and the embedding spaces of the different patches update each-others through the self-attention mechanism ( Vaswani 2017 , see ) . These architectures present the advantage that the features produced at patch level can be analyzed spatially within an image, which is relevant in remote sensing especially when working at high resolution, (see Marsocci et al. 2024 ) (see the plugin documentation for a more detailed overview of the functioning of a ViT). With the democratization of deep learning, some developers have already worked on the integration of deep learning models in geographic information systems such as the open-source and widely used QGIS software QGIS Development Team 2025 . However, at the time of writing, these solutions mostly focus on fine-tuning models or using a model in inference only ( Aszkowski et al. 2023 ; Zhao et al. 2023 , e.g. see ) . Then, they are only usable by users with access to high-end computing power, extensive dataset, on interested in a task for which a specific model was already trained. In this paper, we introduce a new plugin for QGIS designed to streamline remote sensing image analysis using advanced pre-trained deep learning models without the need for coding or extensive computing resources. As demonstrated in this paper, users can apply a pre-trained model to generate high-quality features at the patch level. The plugin then allows users to manipulate these features using various projections, clustering, similarity, and supervised machine learning (ML) algorithms. 2 Plugin description The IAMAP plugin integrated into QGIS consists of five main modules, which can be used individually or sequentially on a georeferenced raster image (Fig. 1 ). We here below describe the functionality of each module. Figure