CL-bench: A Benchmark for Context Learning

Shihan Dou Ming Zhang Zhangyue Yin Chenhao HuangYujiong ShenJunzhe Wang[0.2cm] Jiayi Chen Yuchen Ni Junjie Ye Cheng Zhang Huaibing Xie Jianglu Hu [0.2cm] Shaolei Wang Weichao Wang Yanling Xiao Yiting Liu Zenan Xu Zhen Guo, [0.2cm] Pluto Zhou Tao Gui Zuxuan Wu Xipeng Qiu Qi Zhang Xuanjing Huang [0.2c · 2026

Read CL-bench: A Benchmark for Context Learning by Shihan Dou Ming Zhang Zhangyue Yin Chenhao HuangYujiong ShenJunzhe Wang[0.2cm] Jiayi Chen Yuchen Ni Junjie Ye Cheng Zhang Huaibing Xie Jianglu Hu [0.2cm] Shaolei Wang Weichao Wang Yanling Xiao Yiting Liu Zenan Xu Zhen Guo, [0.2cm] Pluto Zhou Tao Gui Zuxuan Wu Xipeng Qiu Qi Zhang Xuanjing Huang [0.2c (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-03587.txt.

Description

A model can ace exam-style reasoning yet fail when the needed knowledge sits in the task's own context. Shihan Dou and 26 co-authors call that missing skill context learning and build a benchmark for it in a 2026 paper. CL-bench gathers 500 complex contexts with nearly 1,900 tasks and over 31,000 verification checks, all written by domain experts.

Each task can only be solved with content supplied in its context: new domain knowledge, rule systems, procedures, or laws fitted to data. Ten frontier language models solve only about 17 percent of tasks on average, and the best reaches under 24 percent. The authors present the gap as a central bottleneck for deploying models on real, context-heavy work.

Catalog record

CREATORShihan Dou Ming Zhang Zhangyue Yin Chenhao HuangYujiong ShenJunzhe Wang[0.2cm] Jiayi Chen Yuchen Ni Junjie Ye Cheng Zhang Huaibing Xie Jianglu Hu [0.2cm] Shaolei Wang Weichao Wang Yanling Xiao Yiting Liu Zenan Xu Zhen Guo, [0.2cm] Pluto Zhou Tao Gui Zuxuan Wu Xipeng Qiu Qi Zhang Xuanjing Huang [0.2c
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE226 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-03587

Browse the full library · About the Tower of Babel