Transformer Encoder and Multi–features Time2Vec for Financial Prediction
Nguyen Kim Hai Bui 1 , Nguyen Duy Chien 1 , Péter Kovács 2 , and Gergő Bognár 2 · 2025
Read Transformer Encoder and Multi–features Time2Vec for Financial Prediction by Nguyen Kim Hai Bui 1 , Nguyen Duy Chien 1 , Péter Kovács 2 , and Gergő Bognár 2 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-13801.txt.
Description
Nguyen Kim Hai Bui and three co-authors forecast stock prices with a transformer that reads time through a richer lens, in this 2025 paper. Markets mix quick jitters with slow trends, and stocks in one sector often move together, facts single series models miss. Their design swaps the transformer's usual position stamps for a multi feature version of Time2Vec, an embedding that encodes time in learned waves.
A selection step first picks features by how strongly series correlate, feeding the model the companions that matter. After careful tuning, the architecture beat benchmark models and rival time encodings. Predicting several related stocks at once improved when correlated features were included. The authors conclude that time representation and company in the input both matter for financial forecasting.
Catalog record
| CREATOR | Nguyen Kim Hai Bui 1 , Nguyen Duy Chien 1 , Péter Kovács 2 , and Gergő Bognár 2 |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 21 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-13801