Comparative Analysis of Time Series Foundation Models for Demographic Forecasting: Enhancing Predictive Accuracy in US Population Dynamics
Aditya Akella Jonathan Farah [email protected] [email protected] · 2025
Read Comparative Analysis of Time Series Foundation Models for Demographic Forecasting: Enhancing Predictive Accuracy in US Population Dynamics by Aditya Akella Jonathan Farah [email protected] [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-11680.txt.
Introduction
Aditya Akella and Jonathan Farah test whether a pretrained forecasting model can predict how the United States population will change. Planners need good demographic forecasts for housing, health care, and budgets, yet classic tools demand heavy tuning for each series. The authors took population data from the Census Bureau and a federal economic database. They pitted the foundation model TimesFM against three standard baselines across six varied states.
TimesFM posted the lowest squared error in nearly 87 percent of the test cases. It did especially well for minority populations, where history is sparse and older methods wobble. Because the model arrives pretrained, it needed little task-specific adjustment. The authors say such models could help governments act earlier on demographic change. Note that the catalog creator field mixes email addresses into the author names.
Catalog record
| CREATOR | Aditya Akella Jonathan Farah [email protected] [email protected] |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 15 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-11680
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Comparative Analysis of Time Series Foundation Models for Demographic Forecasting: Enhancing Predictive Accuracy in US Population Dynamics Aditya Akella Jonathan Farah [email protected] [email protected] Abstract Demographic shifts, influenced by globalization, economic conditions, geopolitical events, and environmental factors, pose significant challenges for policymakers and researchers. Accurate demographic forecasting is essential for informed decision-making in areas such as urban planning, healthcare, and economic policy. This study explores the application of time series foundation models to predict demographic changes in the United States using datasets from the U.S. Census Bureau and Federal Reserve Economic Data (FRED). We evaluate the performance of the Time Series Foundation Model (TimesFM) against traditional baselines including Long Short-Term Memory (LSTM) networks, Autoregressive Integrated Moving Average (ARIMA), and Linear Regression. Our experiments across six demographically diverse states demonstrate that TimesFM achieves the lowest Mean Squared Error (MSE) in 86.67% of test cases, with particularly strong performance on minority populations with sparse historical data. These findings highlight the potential of pre-trained foundation models to enhance demographic analysis and inform proactive policy interventions without requiring extensive task-specific fine-tuning. 1 Introduction Demographic changes fundamentally shape public health infrastructure, economic policies, and urban development strategies. As the United States population evolves through complex interactions of migration, economic shifts, and social dynamics, accurate forecasting methods become increasingly critical for effective resource allocation and policy planning [ 6 ] . Recent advances in machine learning, particularly in time series foundation models, offer new opportunities for demographic prediction. Unlike traditional statistical methods that require explicit modeling of trends and seasonality, modern deep learning approaches can automatically learn complex temporal patterns from data [ 5 ] . However, the application of state-of-the-art foundation models to demographic forecasting remains underexplored. This work addresses this gap by conducting a comprehensive evaluation of TimesFM [ 5 ] , a recently developed time series foundation model, for multi-racial demographic forecasting across diverse U.S. states. Our key contributions include: • A systematic comparison of TimesFM against established baselines (LSTM, ARIMA, Linear Regression) on real-world demographic data spanning 1990–2022 • Evidence that pre-trained foundation models can achieve superior accuracy without task-specific fine-tuning, particularly for populations with limited historical data • A reproducible framework for applying time series foundation models to demographic prediction tasks 2 Related Works 2.1 Classical Time Series Models Traditional statistical approaches to demographic forecasting have relied heavily on ARIMA [ 3 ] and Vector AutoRegression (VAR) [ 14 ] frameworks. These models leverage autoregressive and moving average components to capture linear temporal dependencies but impose strong assumptions of stationarity and linearity. Recent comparative studies [ 9 ] demonstrate that such classical methods often fail to capture the nonlinear patterns inherent in demographic shifts, particularly during periods of rapid social change. 2.2 Deep Learning Architectures The application of recurrent neural networks to time series forecasting marked a significant advance over classical methods. DeepAR [ 13 ] pioneered the use of autoregressive RNNs trained across multiple related time series, achieving substantial improvements on retail and demographic benchmarks. Subsequent work explored architectural variants: Temporal Convolutional Networks (TCN) [ 2 ] replaced recurrence with causal convolutions for improved parallelization, while hybrid approaches like ES-RNN [ 15 ] combined statistical and neural components. Notably, simpler architectures have recently challenged the necessity of complex models. N-BEATS [ 12 ] achieved state-of-the-art results on the M4 competition using only feedforward layers with residual connections, while DLinear [ 19 ] and TiDE [ 4 ] demonstrated that linear models with sufficient context can rival transformers on many benchmarks. 2.3 Transformer-Based Forecasting The adaptation of transformers to time series introduced new capabilities for modeling long-range dependencies. Informer [ 20 ] addressed computational challenges through sparse attention mechanisms, while Autoformer [ 16 ] incorporated series decomposition directly into the architecture. Recent innovations like PatchTST [ 11 ] and TimesNet [ 17 ] employ patch-based tokenization to balance local pattern recognition with global context modeling. 2.4 Time Series Foundation Models The emergence of foundation models represents a paradigm shift in time series analysis. These large-scale pre-trained models learn universal temporal representations from diverse datasets, enabling strong zero-shot performance on unseen domains [ 18 ] . TimesFM [ 5 ] , our primary model of interest, employs a decoder-only transformer architecture with 200M parameters, pre-trained on approximately 100 billion time points from both real and synthetic sources. Its patch-based approach predicts 128 future values simultaneously, improving efficiency for long-horizon forecasting. Empirical evaluations show TimesFM achieving top-3 performance across major benchmarks without any task-specific fine-tuning. Contemporary foundation models include Chronos [ 1 ] , which frames time series as a language modeling task using T5 architecture, and Moirai-MoE [ 10 ] , which employs mixture-of-experts to handle heterogeneous series. TimeFound [ 18 ] introduces multi-resolution patching for capturing dynamics at different temporal scales. These models consistently demonstrate that pre-training on diverse time series enables effective transfer to new domains, with recent work showing that in-context learning can match fully supervised baselines [ 7 ] . For demographic applications specifically, the ability of foundation models to handle sparse, irregular data proves particularly valuable, as minority populations often lack comprehensive historical records [ 8 ] . 3 Methodology 3.1 Data Collection and Preprocessing We compiled demographic data for five racial groups (White, Black or African American, American Indian and Alaska Native, Asian, and Native Hawaiian and Other Pacific Islander) across six U.S. states selected for geographic and demographic diversity: Alabama, California, Hawaii, New York, Texas, and Wyoming. Population data from 1990–2019 was sourced from the Federal Reserve Economic Data (FRED) system, while 2020–2022 data came from U.S. Census Bureau estimates. Data preprocessing involved: (1) handling missing values through row-wise deletion for Native Hawaiian populations prior to 2000, (2) min-max normalization to standardize scales across populations of different magnitudes, and (3) merging FRED and Census datasets to create continuous time series for each state-race combination. 3.2 Experimental Setup We employed a temporal train-test split with training data from 1990–2016 and test data from 2017–2022. This chronological split ensures models are evaluated on genuine future predictions rather than interpolation. All models were evaluated using Mean Squared Error (MSE) as the primary metric: \text{MSE}=\frac{1}{n}\sum_{i=1}^{n}(y_{i}-\hat{y}_{i})^{2} (1) where y_{i} represents actual population values and \hat{y}_{i} represents predictions. 3.3 Model Configurations TimesFM : We utilized the pre-trained TimesFM checkpoint with context length 64 and prediction length 12. The model was fine-tuned for 50 epochs per state using learning rate 5e-4 and batch size 64. We employed the modified LagLlama training framework adapted for TimesFM’s architecture. LSTM : Our baseline LSTM consisted of two layers with 512 hidden units each, trained using sliding windows of 5 years. We used Adam optimizer with learning rate 0.001 for 72 epochs. ARIMA : Order selection for ARIMA(p,d,q) was performed using auto.arima with AIC criterion. Models were fit independently for each state-race combination. Linear Regression : Simple linear regression on year as the sole feature, providing a baseline for linear trend extrapolation. 4 Results 4.1 Quantitative Performance Table 1 presents MSE values across all models and demographics. TimesFM achieved the lowest error in 13 of 15 test cases (86.67%), with particularly strong performance on minority populations. For the Native Hawaiian demographic in New York, TimesFM reduced MSE by three orders of magnitude compared to LSTM (7.867e4 vs