MoDEx: Mixture of Depth-specific Experts for Multivariate Long-term Time Series Forecasting

Hyekyung Yoon, Minhyuk Lee, Imseong Park, Myungjoo Kang · 2026

Read MoDEx: Mixture of Depth-specific Experts for Multivariate Long-term Time Series Forecasting by Hyekyung Yoon, Minhyuk Lee, Imseong Park, Myungjoo Kang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-00624.txt.

Description

Hyekyung Yoon and colleagues study multivariate long-term time series forecasting, where embedding, backbone refinement, and long-horizon prediction rule. Backbone layers remain little studied, so they introduce layer sensitivity, a gradient-based metric of each time point's plus and minus effects on a layer's latent features. Applied to a three-layer MLP backbone, it reveals depth-specific specialisation in time dynamics. Their MoDEx mixture of depth-specific experts replaces backbones, ranking first in 78 percent of cases on seven benchmarks with far fewer weights.

Catalog record

CREATORHyekyung Yoon, Minhyuk Lee, Imseong Park, Myungjoo Kang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE30853
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602.00624

Browse the full library · About the Tower of Babel