Spatio-Temporal Transformers for Long-Term NDVI Forecasting Ido Faran 1 , Nathan S. Netanyahu 1,2 , and Maxim Shoshany 3 1 Dept. of Computer Science, Bar-Ilan University, Ramat Gan 5290002, Israel 2 Dept. of Computer Science, College of Law and Business, Ramat Gan 5257346 , Israel 3 Faculty of Civil and Environmental Engineering, Technion Israel Institute of Technology, Haifa 3200003, Israel Abstract Long-term satellite image time series (SITS) analysis in heterogeneous landscapes faces significant challenges, particularly in Mediterranean regions where complex spatial patterns, seasonal variations, and multi-decade environmental changes interact across different scales. This paper presents the Spatio-Temporal Transformer for Long Term Forecasting (STT-LTF ), an extended framework that advances beyond purely temporal analysis to integrate spatial context modeling with temporal sequence prediction. STT-LTF processes multi-scale spatial patches alongside temporal sequences (up to 20 years) through a unified transformer architecture, capturing both local neighborhood relationships and regional climate influences. The framework employs comprehensive self-supervised learning with spatial masking, temporal masking, and horizon sampling strategies, enabling robust model training from 40 years of unlabeled Landsat imagery. Unlike autoregressive approaches, STT-LTF directly predicts arbitrary future time points without error accumulation, incorporating spatial patch embeddings, cyclical temporal encoding, and geographic coordinates to learn complex dependencies across heterogeneous Mediterranean ecosystems. Experimental evaluation on Landsat data (1984-2024) demonstrates that STT-LTF achieves a Mean Absolute Error (MAE) of 0.0328 and R² of 0.8412 for next-year predictions, outperforming traditional statistical methods, CNN-based approaches, LSTM networks, and standard transformers. The framework’s ability to handle irregular temporal sampling and variable prediction horizons makes it particularly suitable for analysis of heterogeneous landscapes experiencing rapid ecological transitions. 1 INTRODUCTION Forecasting future satellite imagery is a key challenge in computer vision and remote sensing [ 55 , 20 ] . Time-series forecasting aims to reveal temporal patterns that are often hidden in spatially complex landscapes where short-term, medium-term, and long-term processes occur and interact simultaneously across different spatial scales [ 41 ] . This task is particularly difficult for heterogeneous landscapes because daily, seasonal, and multi-decade changes overlap, making it hard to forecast the next state from past observations [ 16 ] . The complexity stems from the interplay of ecological, climatic, and human-driven factors, each contributing in distinct ways to the observed environmental conditions [ 53 ] . Effectively addressing these challenges requires models capable of extracting and integrating both temporal sequences and spatial contexts inherent in environmental data [ 24 ] . Traditional approaches often fall short due to their limited capacity to capture these multi-dimensional interactions, particularly when faced with extended temporal horizons and heterogeneous landscapes [ 18 ] . Recent advancements in transformer-based architectures [ 40 ] have introduced powerful tools for modeling such complex dependencies by leveraging attention mechanisms capable of learning intricate relationships within and between spatial and temporal dimensions. Self-supervised machine-learning techniques provide a significant advantage for addressing these challenges, as they operate without explicit labels and assumptions, enabling models to autonomously learn intrinsic representations from historical data. By training on extensive unlabeled satellite-image archives, these approaches inherently capture meaningful temporal and spatial relationships crucial for predicting future environmental conditions. Earth-observation satellites have become invaluable tools for analyzing dynamic environmental processes, collecting data on our planet’s surface and ecosystems for over half a century. The Landsat mission, operational since 1984, captures multispectral imagery globally every 16 days at a 30[m] spatial resolution. The resulting Satellite Image Time Series (SITS) adds a temporal dimension to Earth-observation data, supporting long-term monitoring of vegetation health, land-use change, and ecosystem dynamics [ 56 ] . These capabilities are particularly crucial in the Mediterranean basin, especially its southeastern region, which has been recognized as a climate-change hotspot since the 1980s. This region faces increasing frequencies of droughts, forest and shrubland fires, agricultural abandonment, and progressive urbanization - all expected to intensify over the next two decades. Long-term satellite imagery time series provide essential data for understanding and predicting these complex environmental transformations. In this study, we utilize the Normalized Difference Vegetation Index (NDVI), a spectral vegetation index calculated as \text{NDVI}=\frac{\text{Near Infrared Band}-\text{Red Band}}{\text{Near Infrared Band}+\text{Red Band}} (1) which effectively represents photosynthetic activity, vegetation cover, and biomass. In Mediterranean climates, characterized by a short rainy season followed by an extended hot and dry period, NDVI values closely correlate with seasonal and annual rainfall variability (see Figure 1 and Figure 2 ). Predicting spatio-temporal NDVI patterns years and decades into the future is essential to understanding how ecosystems respond to climatic and anthropogenic pressures; a critical concern in these regions is desertification, particularly the stability or shift of desert boundaries due to climate change [ 29 ] . (a) Study area (Google Earth) (b) Rainfall distribution (c) NDVI patterns Figure 1: Study area characteristics in the southeastern Mediterranean basin. One of the primary goals of time-series analysis in remote sensing is to accurately forecast future values based on historical observations. These capabilities support image prediction, gap filling caused by cloud cover or sensor issues, and integration of multiple data sources. However, the task faces unique challenges, including distinguishing climate-driven trends from natural variability, handling seasonality, and overcoming data gaps and inconsistencies [ 57 ] . Addressing these complexities is essential for robust environmental monitoring and predictive modeling over extended periods. While existing approaches have made significant progress in satellite image time series analysis, a critical limitation persists in their capacity to fully integrate extended temporal patterns with spatial dependencies and location-specific characteristics. Traditional methods typically focus on temporal sequences spanning up to one year and often fail to capture the complex interplay between multiple dimensions over longer periods [ 6 , 22 ] . This limitation becomes particularly pronounced in heterogeneous Mediterranean landscapes, where intricate seasonal patterns, anthropogenic disturbances, climatic variations, and location-dependent factors necessitate a comprehensive analytical framework operating across multiple spatial and temporal scales [ 26 , 47 ] . To address these challenges, we present an enhanced methodology called the Spatial Temporal Transformer for Long-Term Forecasting (STT-LTF), a framework that significantly extends our previous work [ 14 ] by incorporating spatial context modeling alongside temporal sequence analysis. While our earlier approach focused exclusively on temporal prediction using pixel-wise NDVI time series, this extended framework introduces a fundamental paradigm shift from purely temporal modeling to integrated spatio-temporal representation learning [ 10 , 28 ] . The enhanced architecture incorporates multi-scale spatial patch embeddings that capture local neighborhood relationships and broader landscape patterns, enabling the model to understand not only when changes occur temporally but also how they propagate spatially across heterogeneous Mediterranean landscapes [ 48 ] . This spatial-temporal integration addresses limitations of pixel-independent approaches by leveraging spatial correlations to improve prediction accuracy, particularly for regions with sparse temporal observations or irregular sampling patterns [ 21 ] . STT-LTF fuses spatial patch processing with temporal transformer architectures. Rather than treating pixels independently or separating spatial and temporal analyses, our framework processes N×N pixel patches throughout entire temporal sequences, capturing spatial relationships from single pixels up to 270[m] × 270[m] neighborhoods. We achieve this through self-supervised learning with extensive masking techniques, enabling the model to discover complex spatio-temporal patterns in unlabeled satellite data spanning multiple decades without manual annotation. A key distinguishing feature of our approach is the direct prediction capability for arbitrary future time points. While conventional methods rely on recursive predictions that accumulate errors over extended horizons, STT-LTF learns to map directly from historical spatio-temporal patterns to future vegetation states at any specified target time. This is achieved through a novel temporal embedding strategy that treats the target time as an input parameter, allowing the model to learn the complex non-linear relationships between past observations and future conditions across varying temporal distances. The transformer architecture, specifically optimized for remote sensing data, employs specialized attention mechanisms that capture both local vegetation dynamics and regional climate influences, providing a more comprehensive understanding of ecosystem evolution. Our framework addresses several fundamental challenges in long-term vegetation monitoring. First, it handles the inherent multi-scale nature of vegetation dynamics, where local disturbances interact with regional climate patterns over different temporal scales. Second, it provides a unified approach for analyzing heterogeneous landscapes without requiring separate models for different vegetation types or geographical regions. Third, it offers computational efficiency by eliminating the need for iterative predictions while maintaining high accuracy across extended forecast horizons. These innovations make STT-LTF particularly suitable for applications requiring reliable long-term vegetation predictions, such as climate impact assessment, agricultural planning, and ecosystem management in Mediterranean and similar complex environments. The main contributions of this work are as follows: 1. Advanced spatio-temporal embedding framework with direct prediction capability : We introduce a versatile embedding architecture that seamlessly integrates spatial patches (1×1 to 9×9 pixels), temporal sequences (2.5 to 20 years), and geographical location information through continuous representation spaces. The framework captures both periodic seasonal patterns and long-term directional trends, enabling direct prediction at any future time point without recursive error accumulation. This unified approach supports predictions across arbitrary spatial and temporal resolutions while maintaining accuracy over extended forecast horizons. 2. Self-supervised learning from unlabeled multi-decade data : We present a novel self-supervised training method specifically designed for long-term SITS analysis, capable of learning complex vegetation dynamics from 40 years of unlabeled Landsat imagery without requiring manual annotations. This approach leverages the temporal structure inherent in satellite data with comprehensive masking strategies to create a powerful predictive model from incomplete time series. 3. Transformer architecture for long-term spatio-temporal prediction : We design a specialized transformer that processes extended temporal sequences with spatial context through multi-scale attention mechanisms optimized for vegetation dynamics. The architecture features adaptive encodings for irregular satellite sampling patterns and non-autoregressive prediction heads that directly forecast future vegetation states at arbitrary time horizons, avoiding the error accumulation inherent in recursive approaches. 4. Comprehensive evaluation on Mediterranean ecosystems : We conduct systematic experiments on Landsat NDVI data from heterogeneous Mediterranean landscapes, analyzing the individual and combined impacts of spatial resolution, temporal sequence length, and forecast horizon on prediction accuracy. Our evaluation demonstrates the framework’s adaptability across diverse vegetation types and environmental conditions, achieving state-of-the-art performance in both short-term and long-term predictions. Figure 2: Time series of NDVI values (1985–2024) for three samples, illustrating seasonal variability and long-term trends. Source: [ 14 ] Figure 3: Self-supervised learning framework for NDVI time-series prediction. The model processes T historical satellite observations with spatial patches, each containing NDVI, month, and year and geographic context to predict future NDVI values at target time T+\Delta using MAE loss against ground truth NDVI from actual satellite observations. The remainder of this paper is organized as follows: Section 2 reviews related work covering traditional statistical methods, deep learning approaches, and self-supervised learning techniques for time-series analysis. Section 3 presents the proposed methodology, detailing the input sampling and masking strategy, spatio-temporal embedding framework, transformer encoder architecture, and regression decoder. Section 4 describes the experimental setup and evaluates model performance across different spatial resolutions and temporal horizons using Mediterranean Landsat data. Section 5 concludes with a summary of findings and future research directions. 2 RELATED WORK 2.1 Classical Statistical Approaches in Remote Sensing Time Series Classical statistical approaches have formed the backbone of remote sensing time series analysis, employing methods such as Random Forests, Cellular Automata Markov Chain models, and Autoregressive Integrated Moving Average (ARIMA) frameworks [ 18 ] . Seasonal patterns are captured through Seasonal ARIMA (SARIMA) and Facebook Prophet models [ 3 , 36 ] , which excel at handling cyclical behaviors in vegetation monitoring applications. Recent applications demonstrate the continued effectiveness of ARIMA-based methods. [ 37 ] successfully applied ARIMA models for drought forecasting using satellite-derived Vegetation Temperature Condition Index data, while [ 34 ] achieved high accuracy in solar radiation prediction using SARIMA models with NASA’s satellite data archive. These studies highlight the robustness of statistical methods for multi-decade environmental datasets. Hybrid approaches combining statistical foundations with machine learning have emerged as promising alternatives. SARIMA-Neural Network combinations leverage seasonal pattern recognition while incorporating non-linear learning capabilities [ 31 ] . Recent comparative studies [ 12 ] revealed that SARIMA models consistently outperformed Support Vector Regression for energy forecasting when seasonal patterns were present. Notably, [ 25 ] found that SARIMA models outperformed advanced deep learning approaches, including Long Short-Term Memory networks for wind speed forecasting, suggesting that statistical methods retain advantages in interpretability and computational efficiency for operational applications. However, traditional statistical approaches face limitations with complex non-linear relationships and irregular temporal patterns in heterogeneous landscapes. Missing data handling remains challenging, particularly with cloud-affected satellite imagery, motivating the development of more sophisticated spatio-temporal modeling approaches. 2.2 Deep Learning Architectures in Remote Sensing The evolution of deep learning architectures has fundamentally transformed how researchers approach remote sensing time-series analysis. Early innovations with Convolutional Neural Networks demonstrated the potential for automatic feature extraction from satellite imagery, eliminating the need for handcrafted features [ 55 ] . Long Short-Term Memory networks subsequently proved effective in capturing temporal dependencies within satellite time-series, particularly for applications like crop classification and phenological monitoring where seasonal patterns are crucial. Contemporary deep learning frameworks for remote sensing have evolved to address domain-specific challenges through specialized architectural designs. The integration of spatial and channel attention mechanisms allows networks to focus on relevant spectral bands and spatial regions, improving discrimination between similar land cover types [ 8 ] . Multi-scale feature extraction approaches, inspired by the varying ground sampling distances in satellite imagery, enable models to simultaneously process objects of different sizes within a single framework. Recurrent architectures have been particularly successful in modeling temporal dynamics of Earth observation data. Bidirectional LSTMs capture both forward and backward temporal dependencies, proving valuable for detecting abrupt changes and gradual transitions in land cover. Gated Recurrent Units (GRUs) offer computational efficiency while maintaining temporal modeling capabilities, making them suitable for processing extensive satellite archives. The combination of convolutional and recurrent layers in hybrid architectures enables simultaneous extraction of spatial features and temporal patterns, addressing the inherent spatio-temporal nature of remote sensing data [ 15 ] . These architectures have shown remarkable success in applications ranging from vegetation dynamics monitoring to urban growth prediction. 2.3 Transformer-based Approaches for Temporal Modeling The adaptation of Transformer architectures to remote sensing has catalyzed a paradigm shift in processing satellite time-series data. Unlike their application in natural language processing, Transformers in remote sensing must handle irregular temporal sampling, missing data due to cloud coverage, and multi-modal sensor inputs [ 19 ] . Recent innovations have focused on developing specialized attention mechanisms that accommodate these domain-specific challenges. State-space models represent an emerging direction for efficient temporal modeling in remote sensing. The Mamba architecture and its variants have shown promise for processing long sequences with linear computational complexity [ 1 ] . While primarily explored for change detection and segmentation tasks, these models offer potential advantages for time-series analysis through their selective state-space mechanisms that can adaptively focus on relevant temporal features [ 5 ] . Multi-scale temporal attention mechanisms have proven essential for capturing phenomena occurring at different temporal frequencies. The Spatio-Temporal SwinMAE architecture introduces hierarchical temporal modeling that processes seasonal patterns, inter-annual variations, and rapid changes simultaneously [ 52 ] . This multi-scale approach enables accurate monitoring of diverse Earth processes, from gradual land degradation to sudden natural disasters. Recent benchmarking studies reveal that lightweight Transformer variants specifically designed for remote sensing outperform generic architectures [ 44 ] . These models incorporate domain-specific inductive biases, such as temporal position encodings based on acquisition dates and sensor-specific normalization schemes, resulting in improved generalization across different geographic regions and temporal periods. 2.4 Self-Supervised Learning Approaches Self-supervised learning has revolutionized remote sensing by addressing the fundamental challenge of acquiring labeled data across vast geographical regions. The annotation of satellite imagery demands specialized expertise and substantial resources, particularly when dealing with diverse ecosystems and temporal variations [ 45 ] . Recent developments have demonstrated that self-supervised methods can leverage the abundant unlabeled satellite data to learn meaningful representations without manual annotations. Modern self-supervised frameworks for remote sensing employ various pretext tasks tailored to the unique characteristics of Earth observation data. Contrastive learning approaches have shown remarkable success by learning invariant representations across different augmentations and viewing conditions [ 2 ] . The SimSiam framework, when pre-trained on high-resolution remote sensing datasets, has demonstrated superior transfer learning capabilities compared to ImageNet pre-trained models, particularly for land cover classification tasks [ 17 ] . This domain-specific pre-training captures spectral and spatial patterns unique to satellite imagery that general-purpose models often miss. Several frameworks have been developed to handle the temporal aspects of satellite data within self-supervised paradigms. The Presto model represents progress in handling pixel-time-series through lightweight transformer architectures, demonstrating effectiveness for agricultural monitoring applications [ 38 ] . Temporal contrastive learning methods have been adapted to learn season-invariant features, enabling models to distinguish between natural phenological cycles and actual land cover changes [ 50 ] . Multi-modal self-supervised approaches have also emerged, jointly learning from optical and radar data to create weather-independent representations [ 2 ] . 2.5 Challenges and Gaps in Long-term Spatio-Temporal Analysis Despite significant advances in deep learning and self-supervised approaches, several critical challenges remain specific to long-term spatio-temporal modeling in remote sensing. Current self-supervised methods predominantly focus on single-image representations or short temporal sequences, typically spanning one year or less [ 50 ] . Agricultural applications have received disproportionate attention, leaving complex heterogeneous landscapes underexplored [ 32 ] . This temporal limitation prevents models from capturing multi-decadal environmental processes essential for climate monitoring and land use change detection. The computational demands of autoregressive prediction methods present significant obstacles for long-term forecasting. These approaches require sequential model activations for each temporal step, leading to error propagation and exponential growth in computational complexity [ 27 ] . Each prediction depends on previous outputs, causing small errors to compound over extended horizons. This cascading effect becomes particularly problematic when analyzing multi-decadal satellite archives where subtle long-term trends must be distinguished from noise and seasonal variations. Data heterogeneity poses another fundamental challenge for long-term analysis. Satellite missions evolve over time, introducing sensor variations, orbital changes, and calibration differences that complicate multi-decadal studies. Existing models often fail to account for these systematic changes, resulting in temporal inconsistencies and spurious trends [ 46 ] . The lack of standardized preprocessing pipelines for harmonizing long-term satellite archives further exacerbates this issue. Memory constraints represent a significant bottleneck for processing extensive temporal sequences. While state-space models offer linear complexity, they still require substantial memory for maintaining hidden states across long sequences. This limitation forces researchers to adopt temporal windowing strategies that may miss important long-term dependencies and cyclical patterns spanning multiple years. The trade-off between sequence length and model capacity remains a fundamental obstacle to capturing multi-decadal environmental dynamics. The scarcity of labeled data for long-term changes presents a critical gap in model development and evaluation. Most benchmark datasets focus on short-term changes or single-time observations, failing to capture gradual environmental processes like desertification, urbanization, or climate-induced vegetation shifts [ 15 ] . Additionally, the computational cost of training models on extensive temporal sequences often necessitates trade-offs between temporal resolution and sequence length, potentially missing critical transitional periods in environmental dynamics. Addressing these limitations requires fundamental rethinking of self-supervised objectives for temporal remote sensing data. Rather than adapting computer vision methods designed for static images, the field needs approaches that inherently model temporal dynamics, seasonal cycles, and long-term environmental changes. Direct temporal pattern learning, as opposed to iterative prediction, offers promising directions for capturing extended-range dependencies while maintaining computational efficiency [ 56 ] . Such methods must also account for the unique challenges of Mediterranean and other heterogeneous landscapes, where human activities, climate variability, and ecological processes interact across multiple temporal scales. The integration of spatio-temporal transformers with self-supervised learning presents a particularly promising direction for addressing these challenges. By processing entire temporal sequences through unified architectures that combine spatial patches, temporal embeddings, and geographic context, models can learn complex dependencies without the cascading errors of autoregressive approaches. Self-supervised masking strategies that operate across both spatial and temporal dimensions enable models to learn from the inherent structure of satellite time series, leveraging the vast amounts of unlabeled data available. This approach is especially valuable for heterogeneous landscapes where labeled data spanning multiple decades is scarce. Direct prediction frameworks that forecast future values in a single forward pass, rather than through iterative steps, offer computational efficiency while maintaining the ability to capture long-range temporal dependencies. Such architectures can adapt to varying prediction horizons and spatial resolutions through flexible embedding schemes, making them suitable for diverse remote sensing applications from short-term vegetation monitoring to multi-decadal climate impact assessment. 3 PROPOSED METHOD Our proposed approach formulates time-series prediction of satellite NDVI as a self-supervised learning problem, designed to exploit both the temporal evolution and spatial context of long-term satellite observations. As illustrated in Figure 3 , we feed the model sequences of past satellite imagery along with spatial patches centered around each target pixel, enabling it to learn from historical patterns without requiring labeled data. The training objective minimizes the difference between predicted and observed NDVI values, leveraging the rich spatio-temporal structure inherent in Landsat time series. This methodology predicts the future NDVI value of a central pixel by considering both its temporal sequence and the surrounding spatial environment at each time step. This combination allows the model to capture local spatial patterns, seasonal cycles, and long-term trends simultaneously. Specifically, for every pixel of interest, we extract a sequence of past NDVI patches and encode them together with corresponding temporal information—such as year and month—and location coordinates. The model is trained to forecast the NDVI value at a future time point by comparing predictions against actual measurements and iteratively updating its parameters to reduce forecasting errors. This spatio-temporal learning strategy enables the model to refine its predictions over time, adjusting its understanding of vegetation dynamics based on both historical observations and the spatial relationships of neighboring pixels. By integrating these dimensions, our method effectively learns complex dependencies that govern vegetation growth and response to climatic and anthropogenic factors across heterogeneous landscapes. Formally, we represent the input as a time-series sequence that includes spatial, temporal, and geographic information: O=\{(X_{t},M_{t},Y_{t},\text{lat},\text{lon})\mid t=0,\ldots,T\} (2) where T denotes the length of the historical time series, X_{t}\in\mathbb{R}^{N\times N} represents the NDVI values within a spatial patch of size N\times N at time t , M_{t} indicates the month corresponding to time t , Y_{t} specifies the year at time t , and lat and lon refer to the latitude and longitude of the patch’s central pixel. The prediction target is defined by the future month and year, denoted as M_{T+\Delta} and Y_{T+\Delta} , which specify the future timestamp for forecasting. The model’s task is to estimate the NDVI value at the central pixel for this future time point T+\Delta , formulated as: \hat{x}_{T+\Delta}=f(O,M_{T+\Delta},Y_{T+\Delta}) (3) where f is the transformer-based deep learning model. Unlike autoregressive models that require sequential predictions for each intermediate step, our non-autoregressive approach allows direct forecasting of the NDVI value for any specified future timestamp in a single step. By incorporating the target month and year together with the past temporal sequence, spatial patch data, and geographic coordinates, the model avoids error accumulation over multiple iterations and enables efficient, flexible prediction across arbitrary future horizons. The predicted value \hat{x}_{T+\Delta} is compared to the true observed value x_{T+\Delta} using a loss function L(\hat{x}_{T+\Delta},x_{T+\Delta}) . Model parameters are updated through iterative backpropagation to minimize this loss, thereby enhancing the model’s ability to forecast NDVI values accurately across different temporal horizons. Figure 4 illustrates the architecture of the proposed Transformer-based model for long-term NDVI prediction. The figure shows four main stages: • Input Masking : The input includes spatial NDVI patches, geographic coordinates, and the target future month and year. Spatial and temporal masking, along with horizon sampling, generate diverse training samples. • Embedding Layers : The masked inputs are transformed into feature vectors through spatial, temporal, coordinates, and positional embeddings, capturing patterns in both space and time. • Transformer Encoding : The combined embeddings are processed through Transformer blocks that model complex spatio-temporal dependencies. • Regressor Decoder : The encoded features are pooled and passed through a dense layer to predict the NDVI at the target time, with predictions optimized using MSE loss against ground truth values. Figure 4: Architecture of the proposed STT-LTF model, combining spatial, temporal, and geographic features. Input spatio-temporal patches undergo masking strategies before multi-channel embedding (spatial, temporal, coordinates, positional), transformer processing, and regression to predict target NDVI values through self-supervised learning. 3.1 Input Masking The initial stage of our framework involves comprehensive sampling and masking of satellite imagery time series to create diverse training scenarios that enhance model robustness and generalization capabilities. Our approach addresses the inherent challenges in remote sensing data, including irregular temporal sampling, varying spatial scales, and the need for multi-horizon predictions across different forecasting periods. For each pixel of interest, we construct a structured input sequence as defined in Equation 2 , which encompasses spatial NDVI patches, temporal metadata, and geographic coordinates. This multi-faceted representation enables simultaneous utilization of spatial patterns within local neighborhoods, temporal dynamics across multiple timescales, and geographic context that influences vegetation behavior patterns [ 16 ] . To enhance model adaptability and prevent overfitting to specific spatiotemporal configurations, we implement a comprehensive masking strategy that introduces structured variability during training. This approach draws inspiration from recent advances in self-supervised learning for time series forecasting and addresses the unique challenges of Earth observation data [ 54 , 49 ] . The masking strategy consists of three complementary operations applied stochastically during training. Spatial masking addresses the varying spatial scales encountered in real-world applications by randomly selecting a spatial window size n where n