The CoT Encyclopedia : Analyzing, Predicting, and Controlling how a Reasoning Model will Think

Seongyun Lee, Seungone Kim, Minju Seo, Yongrae Jo, Dongyoung Go, Hyeonbin Hwang, Jinho Park, Xiang Yue, Sean Welleck, Graham Neubig, Moontae Lee, Minjoon Seo, KAIST AI, Carnegie Mellon University, LG AI Research, NAVER Search US, Cornell University · 2025

Read The CoT Encyclopedia : Analyzing, Predicting, and Controlling how a Reasoning Model will Think by Seongyun Lee, Seungone Kim, Minju Seo, Yongrae Jo, Dongyoung Go, Hyeonbin Hwang, Jinho Park, Xiang Yue, Sean Welleck, Graham Neubig, Moontae Lee, Minjoon Seo, KAIST AI, Carnegie Mellon University, LG AI Research, NAVER Search US, Cornell University (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-10185.txt.

Description

Seongyun Lee and co-authors present a 2025 paper building an encyclopedia of how reasoning models think. Long chains of thought power today's language models, yet the strategies inside them are poorly mapped. Hand-made categories miss much of what models actually do.

The team instead mined strategies from model-written chains of thought, embedded and clustered them, and built contrast rubrics for each type. Human judges found the map more complete and readable than earlier schemes. Knowing the strategy types lets the system predict which one a model will pick and steer it toward a better one. One surprise: whether training data is free-form or multiple choice shapes reasoning style far more than its topic.

Catalog record

CREATORSeongyun Lee, Seungone Kim, Minju Seo, Yongrae Jo, Dongyoung Go, Hyeonbin Hwang, Jinho Park, Xiang Yue, Sean Welleck, Graham Neubig, Moontae Lee, Minjoon Seo, KAIST AI, Carnegie Mellon University, LG AI Research, NAVER Search US, Cornell University
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE105 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-10185

Browse the full library · About the Tower of Babel