Enabling Training-Free Text-Based Remote Sensing Segmentation

Jose Sosa, Danila Rukhovich, Anis Kacem, Djamila Aouada · 2026

Read Enabling Training-Free Text-Based Remote Sensing Segmentation by Jose Sosa, Danila Rukhovich, Anis Kacem, Djamila Aouada (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-17799.txt.

Description

Jose Sosa and team ask how far training-free text-based remote sensing segmentation can go with existing foundation models alone. Most current approaches still rely on added trainable components, limiting generalization and practical use. Their approach integrates contrastive and generative vision-language models with the Segment Anything Model, enabling a fully training-free or lightweight LoRA-tuned pipeline.

The contrastive route uses CLIP as mask selector for SAM's grid-based proposals, reaching state-of-the-art open-vocabulary semantic segmentation in a fully zero-shot setting. The generative route enables reasoning and referring segmentation by generating click prompts for SAM with GPT-5 in a zero-shot setting and a LoRA-tuned Qwen-VL model, with the latter scoring best. Tests across nineteen remote sensing benchmarks, spanning open-vocabulary, referring and reasoning tasks, demonstrate strong capabilities, with code slated for release.

Catalog record

CREATORJose Sosa, Danila Rukhovich, Anis Kacem, Djamila Aouada
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE56 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-17799

Browse the full library · About the Tower of Babel