DeepSeek-R1 Thoughtology: Let’s think about LLM reasoning

Sara Vera Marjanović, Arkil Patel, Vaibhav Adlakha, Milad Aghajohari, Parishad BehnamGhader, Mehar Bhatia, Aditi Khandelwal, Austin Kraft, Benno Krojer, Xing Han Lù, Nicholas Meade, Dongchan Shin, Amirhossein Kazemnejad, Gaurav Kamath, Marius Mosbach, Karolina Stańczak, Siva Reddy · 2025

Read DeepSeek-R1 Thoughtology: Let’s think about LLM reasoning by Sara Vera Marjanović, Arkil Patel, Vaibhav Adlakha, Milad Aghajohari, Parishad BehnamGhader, Mehar Bhatia, Aditi Khandelwal, Austin Kraft, Benno Krojer, Xing Han Lù, Nicholas Meade, Dongchan Shin, Amirhossein Kazemnejad, Gaurav Kamath, Marius Mosbach, Karolina Stańczak, Siva Reddy (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-07128.txt.

Description

A team of seventeen authors, led by Sara Vera Marjanović, wrote this 2025 paper studying the visible thought process of DeepSeek-R1. Large reasoning models do not answer at once. They first write out long chains of steps, as if thinking aloud, and only then give a reply.

Since those chains are public, researchers can study how such a model reasons. The authors coin a name for that study: Thoughtology. They start with a taxonomy of the basic building blocks in the model's reasoning. Their tests then probe several questions. How does the length of thought change the answer, and can it be controlled? How does the model handle long or confusing contexts? What cultural and safety issues appear in its chains? The paper opens a field that treats machine thought as an object of science.

Catalog record

CREATORSara Vera Marjanović, Arkil Patel, Vaibhav Adlakha, Milad Aghajohari, Parishad BehnamGhader, Mehar Bhatia, Aditi Khandelwal, Austin Kraft, Benno Krojer, Xing Han Lù, Nicholas Meade, Dongchan Shin, Amirhossein Kazemnejad, Gaurav Kamath, Marius Mosbach, Karolina Stańczak, Siva Reddy
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE304 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-07128

Browse the full library · About the Tower of Babel