Resa : Transparent Reasoning Models via SAEs

Shangshang Wang, Julian Asilis, Ömer Faruk Akgül, Enes Burak Bilgin, Ollie Liu, Deqing Fu, and Willie Neiswanger · 2025

Read Resa : Transparent Reasoning Models via SAEs by Shangshang Wang, Julian Asilis, Ömer Faruk Akgül, Enes Burak Bilgin, Ollie Liu, Deqing Fu, and Willie Neiswanger (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-09967.txt.

Introduction

Shangshang Wang and six co-authors show how to move reasoning skill from one language model to another at very low cost. Their paper appeared in two thousand twenty-five. Their family of small reasoning models is called Resa. The trick is to first train a sparse autoencoder on a strong source model.

The autoencoder learns to spot the inner patterns tied to reasoning. It then guides normal fine-tuning of a target model on checked question-answer pairs. No worked reasoning traces are needed for that step. The tuned models kept nearly all of the skill of far costlier trained peers. Training took minutes and cost about a dollar. Skills lifted from one data set still helped on bigger ones. They could even be bolted onto a third model at test time with no new training.

Catalog record

CREATORShangshang Wang, Julian Asilis, Ömer Faruk Akgül, Enes Burak Bilgin, Ollie Liu, Deqing Fu, and Willie Neiswanger
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE72 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-09967

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Resa : Transparent Reasoning Models via SAEs Shangshang Wang, Julian Asilis, Ömer Faruk Akgül, Enes Burak Bilgin, Ollie Liu, Deqing Fu, and Willie Neiswanger Abstract How cost-effectively can we elicit strong reasoning in language models by leveraging their underlying representations? We answer this question with Resa, a family of 1.5B reasoning models trained via a novel and efficient sparse autoencoder tuning (SAE - Tuning) procedure. This method first trains an SAE to capture reasoning abilities from a source model, and then uses the trained SAE to guide a standard supervised fine-tuning process to elicit such abilities in a target model, all using verified question-answer data without any reasoning traces . Notably, when applied to certain base models before further RL post-training, SAE - Tuning retains >97% of its RL - trained counterpart’s reasoning performance while reducing training costs by >2000x to roughly $1 and training time by >450x to around 20 minutes. Furthermore, when applied to lightly RL - trained models (e.g., within 1 hour on 2 GPUs), it enables reasoning performance such as 43.33% Pass@1 on AIME24 and 90% Pass@1 on AMC23 for only around $1 additional cost. Surprisingly, the reasoning abilities extracted via SAEs are potentially both generalizable and modular. Generality means abilities extracted from one dataset still elevate performance on a larger and overlapping corpus. Modularity means abilities extracted from Qwen or Qwen - Math can be attached to the R1 - Distill model at test time, without any retraining , and yield comparable gains. Extensive ablations validate these findings and all artifacts are fully open-sourced. Notion Blog : https://shangshangwang.notion.site/resa Code Repository : https://github.com/shangshang-wang/Resa Training Logs : https://wandb.ai/upup-ashton-wang-usc/Resa = Model Weights & Checkpoints : https://huggingface.co/Resa-Yi 1 Introduction Reasoning language models have demonstrated increasing performance in domains like math, coding, and science ( Wang and Neiswanger 2025 , Xu et al. 2025 ) . Despite the impressive reasoning performance elicited by reinforcement learning (RL) or supervised fine-tuning (SFT) ( Chu et al. 2025 ) , these methods often operate as a “black box”. In other words, while they improve reasoning, how they alter the model’s internal representations to do so is largely opaque. Furthermore, RL-based workflows are notoriously resource-intensive, requiring vast computational power and long training time to converge. On the other hand, SFT hinges on the availability of high-quality Chain-of-Thought (CoT) reasoning traces, which are costly to curate ( Muennighoff et al. 2025 ) . This leaves a critical gap in the field: The need for a three-birds-one-stone method that can elicit strong reasoning abilities in a way that is not only effective but also computationally efficient and transparent . Figure 1 : Comparison between Example Resa Models and Baselines The Tina models correspond to the best checkpoints in Wang et al. 2025a . Resa-STILL and Resa-DeepScaleR correspond to Resa-STILL-v5 and Resa-DeepScaleR-v3 in Table 4 , respectively. For these Resa models, the required SAEs are trained from scratch (as shown in Section 3.2 ) and both computational and time costs are total costs for training SAEs and models. Reasoning performance denotes the average zero-shot Pass@1 score across AIME24/25, AMC23, MATH500, GPQA Diamond, and Minerva benchmarks. In this paper, we bridge this gap with Resa , a family of 1.5B re asoning models trained via sparse autoencoders ( SA Es), using a novel SAE-Tuning procedure. SAEs are unsupervised models designed to deconstruct a model’s dense internal activations into a sparse dictionary of more interpretable latent features ( Anthropic 2023 , Anthropic 2024 ) . Our key insight is that within this dictionary, certain features must correspond to the fundamental building blocks of reasoning. By instilling latent reasoning features captured by an SAE back into a model via a tuning procedure, we can effectively and efficiently elicit the model’s reasoning abilities. Specifically, SAE-Tuning involves two key stages: First, we use an SAE to probe the internal activations of a source model, identifying and extracting a dictionary of latent features that correspond to its reasoning processes. Second, we freeze this feature-rich SAE and insert it into a target model to guide a SFT process to elicit reasoning abilities in the target model. SAE-Tuning also distinguishes itself from existing methods by using SFT on a minimal verified CoT-free question-answer data type. By verified, we mean that the answer correctness is ensured via methods like human annotation or language-model-based verification ( Guha et al. 2025 ) , while CoT-free signifies that our SAE-Tuning procedure functions without needing explicit step-by-step reasoning traces. Crucially, our control experiments in Table 4 demonstrate that performing standard SFT on this same CoT-free data without an SAE fails to elicit any meaningful reasoning, highlighting the vital role of the SAE. We summarize our core contributions as follows: • Efficient Reasoning Ability Elicitation Purely using verified CoT-free data, we demonstrate that SAE-Tuning can be applied in an end-to-end manner to certain base models with a trained-from-scratch SAE to elicit reasoning abilities on par with those achieved via costly RL. This leads to substantial gains with peak training cost reductions of over 2000x (to approximately $1) and time reductions of over 450x (to under 20 minutes) compared to RL-based workflows, while maintaining comparable performance. • Generalizable and Modular Reasoning Ability We establish the generality and modularity of the extracted reasoning abilities such that these abilities generalize across out-of-distribution datasets and can be attached to models within the same family at test time without additional training, functioning as a portable reasoning adapter. • Transparent Reasoning Feature Extraction We provide a transparent view into the model’s reasoning abilities. Specifically, we propose a novel prompt-only method to extract and quantify latent reasoning features using SAEs and show that the layer-wise distribution of these reasoning features correlates with reasoning performance of Resa models, offering a data-driven path to optimizing SAE-Tuning. 2 Resa: Transparent Reasoning Models via SAEs Resa is a family of 1.5B transparent reasoning models derived from the Tina models ( Wang et al. 2025a ) and R1-Distill 1 1 1 deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B ( DeepSeek-AI 2025 ) via SAEs. The transparent designation reflects our methodology’s focus on interpretability. We use an SAE to explicitly isolate and extract implicit reasoning abilities (i.e., latent reasoning features) from a source model, and use that trained SAE to controllably instill those features into a target model to elicit reasoning abilities. The entire procedure relies on a novel SAE-Tuning procedure, which uses only verified CoT-free question-answer data. Figure 2 : Two-Stage Pipeline of SAE-Tuning The procedure begins with SAE training (Left), where an SAE is trained to capture reasoning features from a source model with a trigger dataset. During SAE-guided SFT (Right), the trained SAE is then frozen and inserted into a target model. An elicitation dataset is used to guide a SFT process to elicit the reasoning abilities in the target model. Notably, the trigger and elicitation datasets are usually the same CoT-free data. See Section 2.1 for a description of each component. 2.1 Sparse Autoencoder Tuning SAE-Tuning is an efficient two-stage training procedure designed to transfer implicit reasoning abilities from a source model to a target model; this full procedure is summarized in Figure 2 . The two stages consist of: • Stage I: SAE Training (Reasoning Ability Extraction) The first stage involves training an SAE to

Read the complete text