MoDEx: Mixture of Depth-specific Experts for Multivariate Long-term Time Series Forecasting
Hyekyung Yoon, Minhyuk Lee, Imseong Park, Myungjoo Kang · 2026
Read MoDEx: Mixture of Depth-specific Experts for Multivariate Long-term Time Series Forecasting by Hyekyung Yoon, Minhyuk Lee, Imseong Park, Myungjoo Kang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-00624.txt.
Description
Hyekyung Yoon and colleagues study multivariate long-term time series forecasting, where embedding, backbone refinement, and long-horizon prediction rule. Backbone layers remain little studied, so they introduce layer sensitivity, a gradient-based metric of each time point's plus and minus effects on a layer's latent features. Applied to a three-layer MLP backbone, it reveals depth-specific specialisation in time dynamics. Their MoDEx mixture of depth-specific experts replaces backbones, ranking first in 78 percent of cases on seven benchmarks with far fewer weights.
Catalog record
| CREATOR | Hyekyung Yoon, Minhyuk Lee, Imseong Park, Myungjoo Kang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 30853 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602.00624