CLQT: A Closed-Loop, Cost-Aware, Strategy-Consistent Benchmark for Diagnostic Evaluation of LLM Portfolio-Management Agents
2026
Read CLQT: A Closed-Loop, Cost-Aware, Strategy-Consistent Benchmark for Diagnostic Evaluation of LLM Portfolio-Management Agents (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-29771.txt.
Introduction
Qu and Chen introduce CLQT, a benchmark for language model agents acting as portfolio managers. Most closed-loop trading benchmarks rank agents by returns over a fixed window. Such leaderboards certify neither sound reasoning nor a consistent strategy.
CLQT reframes evaluation as diagnosis rather than ranking. Agents run a five-stage cycle: they gather and synthesize, construct a mandate-aware portfolio, execute it under realistic costs, then reflect. Each round is sealed into a hash chain, so every metric can be recomputed from the audit trail. A five-axis capability scorecard rates coherence, acuity, composure, discipline, and reliability. Validation uses a controlled backtest plus a live broker track.
Catalog record
| YEAR | 2026 |
|---|---|
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 120 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.29771