Brewing Stronger Features: Dual-Teacher Distillation for Multispectral Earth Observation
Filip Wolf, Blaž Rolih, Luka Čehovin Zajc, University of Ljubljana, Faculty of Computer, Information Science, Slovenia · 2026
Read Brewing Stronger Features: Dual-Teacher Distillation for Multispectral Earth Observation by Filip Wolf, Blaž Rolih, Luka Čehovin Zajc, University of Ljubljana, Faculty of Computer, Information Science, Slovenia (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-19863.txt.
Description
Earth observation spans many sensors and modalities, so no single foundation model can cover them all, and knowledge must move between specialized models. A 2026 arXiv paper by Filip Wolf and two co-authors proposes dual-teacher contrast-based distillation for multispectral imagery.
Most Earth observation pretraining leans on masked image modelling, which stresses local reconstruction over global meaning structure. The new framework pairs a teacher for new sensor data with an optical vision foundation model teacher, aligning the student's objective with modern contrast-based self-distillation. Tests across optical and multispectral benchmarks show the model adapts to new sensor data without losing optical performance, leading prior methods in both settings. The work offers a sound route to scalable learning across varied Earth data.
Catalog record
| CREATOR | Filip Wolf, Blaž Rolih, Luka Čehovin Zajc, University of Ljubljana, Faculty of Computer, Information Science, Slovenia |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 48 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-19863