From Knots to Knobs: Towards Steerable Collaborative Filtering Using Sparse Autoencoders CCS: Information systems Recommender systems

Martin Spišák, Ladislav Peška, Petr Škoda, Vojtěch Vančura, Rodrigo Alves · 2026

Read From Knots to Knobs: Towards Steerable Collaborative Filtering Using Sparse Autoencoders CCS: Information systems Recommender systems by Martin Spišák, Ladislav Peška, Petr Škoda, Vojtěch Vančura, Rodrigo Alves (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-11182.txt.

Introduction

Martin Spisak, Ladislav Peska, Petr Skoda, Vojtech Vancura, and Rodrigo Alves link two hot tools. Their 2026 preprint joins sparse autoencoders with recommender systems. Sparse autoencoders first grew in work on large language models. There they help expose clear features hid in dense code.

Those features can be read at more than one scale of detail. They can also be switched on to steer what a model writes. The team now brings that trick to joint filtering for picks and ranks. The aim is a recommender whose taste can be tuned by hand. Users could turn clear knobs, not just take what the black box gives.

Catalog record

CREATORMartin Spišák, Ladislav Peška, Petr Škoda, Vojtěch Vančura, Rodrigo Alves
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE53 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-11182

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

From Knots to Knobs: Towards Steerable Collaborative Filtering Using Sparse Autoencoders CCS: Information systems Recommender systems Martin Spišák, Ladislav Peška, Petr Škoda, Vojtěch Vančura, Rodrigo Alves Abstract . Sparse autoencoders (SAEs) have recently emerged as pivotal tools for introspection into large language models. SAEs can uncover high-quality, interpretable features at different levels of granularity and enable targeted steering of the generation process by selectively activating specific neurons in their latent activations. Our paper is the first to apply this approach to collaborative filtering, aiming to extract similarly interpretable features from representations learned purely from interaction signals. In particular, we focus on a widely adopted class of collaborative autoencoders (CFAEs) and augment them by inserting an SAE between their encoder and decoder networks. We demonstrate that such representation is largely monosemantic and propose suitable mapping functions between semantic concepts and individual neurons. We also evaluate a simple yet effective method that utilizes this representation to steer the recommendations in a desired direction. Figure 1 . The proposed pipeline for steering CFAE-based recommendations. A sparse autoencoder (SAE) can disentangle user embeddings within collaborative filtering autoencoders (CFAEs), exposing a structured layer of interpretable “knobs.” Such knobs may be labeled based on their activation patterns and exposed to the users or editors in the form of a “control panel”. They can steer the recommendations by gradually increasing the activation of such knobs that correspond to their current needs or desires. 1. Introduction Collaborative-filtering (CF) techniques have been dominating the recommender systems’ research since the late 1990s, following their success in early benchmark datasets such as MovieLens and the Netflix Prize competition ( 25 ) . While the dawn of deep learning partially shifted the focus towards approaches incorporating multiple input modalities ( 12 ) , pure CF techniques remain fundamental, especially for the initial stages of the recommendation pipeline, i.e., candidate retrieval. Among the plethora of CF algorithms, collaborative autoencoders (CFAEs) ( 48 ) belong to the most widely used approaches for this task. CFAEs are recommendation methods designed to encode sparse user–item interaction data into a dense, lower-dimensional latent space and then reconstruct it, enabling the extraction of information crucial for matching users with items. The encoder-decoder architecture can vary in complexity (from shallow ( 41 ; 53 ) to deep structures ( 28 ; 32 ) , including variational approaches ( 29 ; 50 ) ), allowing the model to capture different levels of abstraction and adapt to the specific characteristics of the data. By focusing on the most relevant features of user behavior and item characteristics during reconstruction, these models reveal latent patterns and hidden relationships that are not immediately apparent in the raw data. This versatility, combined with strong recommendation performance, has made them a popular choice among researchers and practitioners for addressing challenges such as data sparsity and noise ( 27 ; 62 ) , making these models a surging trend in the recommendation industry ( 53 ; 20 ; 61 ; 51 ) . However, despite their flexibility and robust performance, understanding the underlying mechanisms and characteristics hidden in the latent structure of CFAEs remains a very challenging task ( 64 ; 33 ; 1 ) . The abstract encoder-decoder mechanism not only results in opaque model behavior, making it difficult to track how recommendations are derived, but also limits the capacity of different agents (e.g., users, editors, providers) to influence or steer the recommendation process. This lack of transparency is inherent also for other CF techniques based on latent representations, and poses significant challenges when diagnosing issues, fine-tuning performance, ensuring fairness, and granting meaningful control over recommendation outcomes. Even shallow architectures, which might appear straightforward at first glance, can exhibit unexpected behaviors on complex real-world datasets ( 52 ) . This complicates efforts to trace decision paths and adjust parameters to satisfy both business and ethical standards ( 49 ) . Understanding internal mechanisms and latent model structures is a broader challenge, not limited to CF, and has been explored across many areas of machine learning. For instance, the field of mechanistic interpretability has recently made substantial progress in tackling this problem, driven by rapid advancements in large language models (LLMs) ( 3 ) . One promising approach involves using a different type of autoencoder – a sparse autoencoder (SAE) -- to identify highly interpretable, monosemantic features (i.e., a dictionary of concepts) 1 1 1 We understand the term concept as a latent yet meaningful property of an item. in the residual streams of language models ( 10 ; 6 ) . This is achieved by disentangling typically polysemantic activation neurons through high-dimensional, sparsely activated latent representations. The disentangling projection is trained in a self-supervised manner using sparsity-inducing activation functions. Promisingly, recent work has successfully applied this approach to highly expressive models, including state-of-the-art LLMs ( 14 ; 58 ) . In this research, we investigate the use of SAEs as an interface for interpreting and steering the outputs of collaborative filtering algorithms, specifically CFAEs . We illustrate this approach in Figure 1 . On the left, a standard CFAE encodes a user’s (sparse) interaction vector into a dense latent embedding, which is then decoded, producing recommendation scores for all candidate items and generating Top- N recommendations. This process alone offers limited options for external influence, apart from modifying the input interaction vector directly. Therefore, as shown on the right of Figure 1 , we propose inserting an SAE between the CFAE’s encoder and decoder. This SAE “hook” maps the dense latent user representation to a higher-dimensional, sparsely activated user code – effectively exposing a control panel of interpretable knobs (neurons), each corresponding to a distinct concept. For example, a neuron may be associated with love stories (depicted as a red heart), or David Lynch (blue diamond). 2 2 2 Interestingly, our experiments (Section 4.3 ) show that meaningful neuron–concept correspondence emerges through self-supervised SAE training on purely interaction-based data – that is, even without access to item metadata. To steer the recommendations, we may amplify one or more of the knobs (e.g., boost the love story neuron in a date night context). The modified sparse code then passes through the SAE decoder and subsequently the CFAE decoder to generate recommendations steered toward the desired theme while maintaining original user preferences as much as possible. By exposing and manipulating these monosemantic controls, our method enables fine-grained, human-understandable steering of recommendations. Moreover, different agents can initiate these semantic boosts: for example, (1) a user might increase the love story knob for a romantic evening via a graphical interface, while (2) an editor could selectively boost the David Lynch knob (even if it was originally inactive and not part of the user’s initial interests) to craft curated, editorial recommendations. Ultimately, our approach presents a key interface for seamless, personalized control over recommendations through semantic-level interventions, rather than by manual item selection. Although previous work has addressed the steering of general recommendation models ( 5 ; 19 ; 24 ) as well as interpretability of CFAE-like models ( 11 ; 52 ; 59 ; 46 ; 17 ; 47 ) , none of these approaches has applied SAEs to generate interpretable user embeddings while simultaneously steering recommendations. Moreover, no previous

Read the complete text