Designing Time Series Experiments in A/B Testing with Transformer Reinforcement Learning
Xiangkun WuSchool of Mathematical SciencesZhejiang UniversityHangzhou, China [email protected], Qianglin WenYunnan Key Laboratory of Statistical Modeling and Data AnalysisYunnan UniversityKunming, China [email protected], Yingying ZhangSchool of StatisticsEast China Normal UniversityShanghai, China [email protected], Hongtu ZhuUniversity of North Carolina at Chapel HillChapel Hill, NC, USA [email protected], Ting LiSchool of Statistics and Data ScienceShanghai University of Finance and EconomicsShanghai, China [email protected], Chengchun ShiDepartment of StatisticsLondon School of Economics and Political ScienceLondon, UK [email protected], [0.5em] Equal contribution · 2026
Read Designing Time Series Experiments in A/B Testing with Transformer Reinforcement Learning by Xiangkun WuSchool of Mathematical SciencesZhejiang UniversityHangzhou, China [email protected], Qianglin WenYunnan Key Laboratory of Statistical Modeling and Data AnalysisYunnan UniversityKunming, China [email protected], Yingying ZhangSchool of StatisticsEast China Normal UniversityShanghai, China [email protected], Hongtu ZhuUniversity of North Carolina at Chapel HillChapel Hill, NC, USA [email protected], Ting LiSchool of Statistics and Data ScienceShanghai University of Finance and EconomicsShanghai, China [email protected], Chengchun ShiDepartment of StatisticsLondon School of Economics and Political ScienceLondon, UK [email protected], [0.5em] Equal contribution (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-01853.txt.
Description
Xiangkun Wu and colleagues improve A/B testing for time series experiments, where policies change over time. Existing designs neither use full history for treatment picks nor avoid strong assumptions for the goal. Their impossibility theorem shows ignoring full history yields poor designs, because time series experiments carry dynamic dependencies. Their transformer reinforcement learning approach conditions picks on the entire history and optimizes mean squared error directly, without strict assumptions. Tests on fake data, a public dispatch simulator and a real ridesharing set show it beats existing designs.
Catalog record
| CREATOR | Xiangkun WuSchool of Mathematical SciencesZhejiang UniversityHangzhou, China [email protected], Qianglin WenYunnan Key Laboratory of Statistical Modeling and Data AnalysisYunnan UniversityKunming, China [email protected], Yingying ZhangSchool of StatisticsEast China Normal UniversityShanghai, China [email protected], Hongtu ZhuUniversity of North Carolina at Chapel HillChapel Hill, NC, USA [email protected], Ting LiSchool of Statistics and Data ScienceShanghai University of Finance and EconomicsShanghai, China [email protected], Chengchun ShiDepartment of StatisticsLondon School of Economics and Political ScienceLondon, UK [email protected], [0.5em] Equal contribution |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 72677 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602.01853