AlphaForgeBench: Benchmarking End-to-End Trading Strategy Design with Large Language Models DOI: XXXXXXX.XXXXXXX Conference: 32nd SIGKDD Conference on Knowledge Discovery and Data Mining; August 09–13, 2026; Jeju, Korea ISBN: 978-1-4503-XXXX-X/2026/06 Conference: KDD 2026; August 9 to 13, 2026; Jeju

Wentao Zhang 1,† \mathpunct{,} Mingxuan Zhao 2,† \mathpunct{,} Jincheng Gao 2,† \mathpunct{,} Jieshun YOU 3 \mathpunct{,} Huaiyu Jia 2 \mathpunct{,} Yilei Zhao 1 \mathpunct{,} Bo An 1 \mathpunct{,} Shuo Sun 2,‡ 1 Nanyang Technological University 2 The Hong Kong University of Science and Technology ( · 2026

Read AlphaForgeBench: Benchmarking End-to-End Trading Strategy Design with Large Language Models DOI: XXXXXXX.XXXXXXX Conference: 32nd SIGKDD Conference on Knowledge Discovery and Data Mining; August 09–13, 2026; Jeju, Korea ISBN: 978-1-4503-XXXX-X/2026/06 Conference: KDD 2026; August 9 to 13, 2026; Jeju by Wentao Zhang 1,† \mathpunct{,} Mingxuan Zhao 2,† \mathpunct{,} Jincheng Gao 2,† \mathpunct{,} Jieshun YOU 3 \mathpunct{,} Huaiyu Jia 2 \mathpunct{,} Yilei Zhao 1 \mathpunct{,} Bo An 1 \mathpunct{,} Shuo Sun 2,‡ 1 Nanyang Technological University 2 The Hong Kong University of Science and Technology ( (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-18481.txt.

Description

Wentao Zhang and seven co-authors expose a reliability flaw in AI trading agents. Their 2026 paper notes financial benchmarks for language models moved from static knowledge tests to interactive trading tests. Yet existing real-time trading frameworks miss a critical failure: severe instability in sequential decisions.

Experiments show trading-agent language models vary wildly from run to run, generate inconsistent actions under fixed decoding, and often flip actions across steps. The team blames the stateless autoregressive nature of language models, lacking memory of prior actions, plus response to action mappings in portfolio tasks. These flaws undermine the reliability of many trading benchmarks. The team proposes AlphaForgeBench, which recasts language models as quant researchers, not random trading agents. Models generate usable alpha factors and compose factor-based strategies from market knowledge. That design separates reasoning from execution for fixed, reproducible evaluation matching real research workflows.

Catalog record

CREATORWentao Zhang 1,† \mathpunct{,} Mingxuan Zhao 2,† \mathpunct{,} Jincheng Gao 2,† \mathpunct{,} Jieshun YOU 3 \mathpunct{,} Huaiyu Jia 2 \mathpunct{,} Yilei Zhao 1 \mathpunct{,} Bo An 1 \mathpunct{,} Shuo Sun 2,‡ 1 Nanyang Technological University 2 The Hong Kong University of Science and Technology (
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE327 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-18481

Browse the full library · About the Tower of Babel