ThinkTuning : Instilling Cognitive Reflections without Distillation
Aswin RRV, Jacob Dineen, Divij Handa, Md Nayem Uddin, Chitta Baral, Ben Zhou · 2025
Read ThinkTuning : Instilling Cognitive Reflections without Distillation by Aswin RRV, Jacob Dineen, Divij Handa, Md Nayem Uddin, Chitta Baral, Ben Zhou (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-07616.txt.
Description
Aswin RRV and co-authors proposed a training method in 2025 that teaches language models to stop, reflect, and fix their own reasoning. Strong models gain these habits from reward training, but that training mostly draws out habits the model already has. Models that lack the habits need another way to gain them.
Their method, ThinkTuning, borrows a classroom pattern: a teacher poses a problem, lets the student try, then gives feedback and the answer. A teacher model of the same size gives that feedback on the student's tries, and the feedback reshapes later attempts. On math and science tests, the method beat plain reward training by a few points. The team shares its code for others to test.
Catalog record
| CREATOR | Aswin RRV, Jacob Dineen, Divij Handa, Md Nayem Uddin, Chitta Baral, Ben Zhou |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 55 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-07616