Capturing LLM Capabilities via Evidence-Calibrated Query Clustering

Fangzhou Wu, Sandeep Silwal, Qiuyi (Richard) Zhang · 2026

Read Capturing LLM Capabilities via Evidence-Calibrated Query Clustering by Fangzhou Wu, Sandeep Silwal, Qiuyi (Richard) Zhang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-17110.txt.

Description

Wu, Silwal and Zhang argue that grouping test questions by surface meaning misses what each question truly demands from a model. Their 2026 ECC method tunes those rough groups with a small set of head-to-head model comparisons, scoring each group by a capability profile. The tuned groups rank model skills far better than human labels or plain embeddings, gaining roughly eighteen points on each. The approach also aids routing each question to a fitting model.

Catalog record

CREATORFangzhou Wu, Sandeep Silwal, Qiuyi (Richard) Zhang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE123841
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.17110

Browse the full library · About the Tower of Babel