Capturing LLM Capabilities via Evidence-Calibrated Query Clustering
Fangzhou Wu, Sandeep Silwal, Qiuyi (Richard) Zhang · 2026
Read Capturing LLM Capabilities via Evidence-Calibrated Query Clustering by Fangzhou Wu, Sandeep Silwal, Qiuyi (Richard) Zhang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-17110.txt.
Description
Wu, Silwal and Zhang argue that grouping test questions by surface meaning misses what each question truly demands from a model. Their 2026 ECC method tunes those rough groups with a small set of head-to-head model comparisons, scoring each group by a capability profile. The tuned groups rank model skills far better than human labels or plain embeddings, gaining roughly eighteen points on each. The approach also aids routing each question to a fitting model.
Catalog record
| CREATOR | Fangzhou Wu, Sandeep Silwal, Qiuyi (Richard) Zhang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 123841 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.17110