CLQT: A Closed-Loop, Cost-Aware, Strategy-Consistent Benchmark for Diagnostic Evaluation of LLM Portfolio-Management Agents

2026

Read CLQT: A Closed-Loop, Cost-Aware, Strategy-Consistent Benchmark for Diagnostic Evaluation of LLM Portfolio-Management Agents (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-29771.txt.

Introduction

Qu and Chen introduce CLQT, a benchmark for language model agents acting as portfolio managers. Most closed-loop trading benchmarks rank agents by returns over a fixed window. Such leaderboards certify neither sound reasoning nor a consistent strategy.

CLQT reframes evaluation as diagnosis rather than ranking. Agents run a five-stage cycle: they gather and synthesize, construct a mandate-aware portfolio, execute it under realistic costs, then reflect. Each round is sealed into a hash chain, so every metric can be recomputed from the audit trail. A five-axis capability scorecard rates coherence, acuity, composure, discipline, and reliability. Validation uses a controlled backtest plus a live broker track.

Catalog record

YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE120 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.29771

Browse the full library · About the Tower of Babel