Designing Time Series Experiments in A/B Testing with Transformer Reinforcement Learning

Xiangkun WuSchool of Mathematical SciencesZhejiang UniversityHangzhou, China [email protected], Qianglin WenYunnan Key Laboratory of Statistical Modeling and Data AnalysisYunnan UniversityKunming, China [email protected], Yingying ZhangSchool of StatisticsEast China Normal UniversityShanghai, China [email protected], Hongtu ZhuUniversity of North Carolina at Chapel HillChapel Hill, NC, USA [email protected], Ting LiSchool of Statistics and Data ScienceShanghai University of Finance and EconomicsShanghai, China [email protected], Chengchun ShiDepartment of StatisticsLondon School of Economics and Political ScienceLondon, UK [email protected], [0.5em] Equal contribution · 2026

Read Designing Time Series Experiments in A/B Testing with Transformer Reinforcement Learning by Xiangkun WuSchool of Mathematical SciencesZhejiang UniversityHangzhou, China [email protected], Qianglin WenYunnan Key Laboratory of Statistical Modeling and Data AnalysisYunnan UniversityKunming, China [email protected], Yingying ZhangSchool of StatisticsEast China Normal UniversityShanghai, China [email protected], Hongtu ZhuUniversity of North Carolina at Chapel HillChapel Hill, NC, USA [email protected], Ting LiSchool of Statistics and Data ScienceShanghai University of Finance and EconomicsShanghai, China [email protected], Chengchun ShiDepartment of StatisticsLondon School of Economics and Political ScienceLondon, UK [email protected], [0.5em] Equal contribution (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-01853.txt.

Description

Xiangkun Wu and colleagues improve A/B testing for time series experiments, where policies change over time. Existing designs neither use full history for treatment picks nor avoid strong assumptions for the goal. Their impossibility theorem shows ignoring full history yields poor designs, because time series experiments carry dynamic dependencies. Their transformer reinforcement learning approach conditions picks on the entire history and optimizes mean squared error directly, without strict assumptions. Tests on fake data, a public dispatch simulator and a real ridesharing set show it beats existing designs.

Catalog record

CREATORXiangkun WuSchool of Mathematical SciencesZhejiang UniversityHangzhou, China [email protected], Qianglin WenYunnan Key Laboratory of Statistical Modeling and Data AnalysisYunnan UniversityKunming, China [email protected], Yingying ZhangSchool of StatisticsEast China Normal UniversityShanghai, China [email protected], Hongtu ZhuUniversity of North Carolina at Chapel HillChapel Hill, NC, USA [email protected], Ting LiSchool of Statistics and Data ScienceShanghai University of Finance and EconomicsShanghai, China [email protected], Chengchun ShiDepartment of StatisticsLondon School of Economics and Political ScienceLondon, UK [email protected], [0.5em] Equal contribution
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE72677
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602.01853

Browse the full library · About the Tower of Babel