Task-Specific Data Selection for Instruction Tuning via Monosemantic Neuronal Activations
Da Ma, Gonghu Shang, Zhi Chen, Libo Qin, Yijie Luo, Lei Pan, Shuai Fan, Lu Chen, Kai Yu · 2025
Read Task-Specific Data Selection for Instruction Tuning via Monosemantic Neuronal Activations by Da Ma, Gonghu Shang, Zhi Chen, Libo Qin, Yijie Luo, Lei Pan, Shuai Fan, Lu Chen, Kai Yu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-15573.txt.
Introduction
Da Ma and co-authors pick training data for a target task by reading a model's own neuron activity, in a paper from two thousand twenty-five. Instruction tuning teaches models to follow orders, but the best data for one task is hard to choose. Past pickers lean on surface features or messy embeddings that miss how the model really processes a sample.
Single neurons fire for many ideas at once, muddying raw activity. A sparse autoencoder untangles that activity into single-meaning units. A matching score in that clean space then finds task-relevant samples. Wide tests across data sets, models, and pick rates beat prior pickers in stability and task gains.
Catalog record
| CREATOR | Da Ma, Gonghu Shang, Zhi Chen, Libo Qin, Yijie Luo, Lei Pan, Shuai Fan, Lu Chen, Kai Yu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 54 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-15573
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Task-Specific Data Selection for Instruction Tuning via Monosemantic Neuronal Activations Da Ma, Gonghu Shang, Zhi Chen, Libo Qin, Yijie Luo, Lei Pan, Shuai Fan, Lu Chen, Kai Yu Abstract Instruction tuning improves the ability of large language models (LLMs) to follow diverse human instructions, but achieving strong performance on specific target tasks remains challenging. A critical bottleneck is selecting the most relevant data to maximize task-specific performance. Existing data selection approaches include unstable influence-based methods and more stable distribution alignment methods, the latter of which critically rely on the underlying sample representation. In practice, most distribution alignment methods, from shallow features (e.g., BM25) to neural embeddings (e.g., BGE, LLM2Vec), may fail to capture how the model internally processes samples. To bridge this gap, we adopt a model-centric strategy in which each sample is represented by its neuronal activation pattern in the model, directly reflecting internal computation. However, directly using raw neuron activations leads to spurious similarity between unrelated samples due to neuron polysemanticity, where a single neuron may respond to multiple, unrelated concepts. To address this, we employ sparse autoencoders to disentangle polysemantic activations into sparse, monosemantic representations, and introduce a dedicated similarity metric for this space to better identify task-relevant data. Comprehensive experiments across multiple instruction datasets, models, tasks, and selection ratios show that our approach consistently outperforms existing data selection baselines in both stability and task-specific performance. 1 Introduction Instruction tuning [ 1 , 2 ] enables large language models (LLMs) to better follow human instructions, powering versatile applications such as chatbots [ 3 , 4 , 5 , 6 ] . However, real-world tasks often require specialized abilities—like professional physics problems—that general instruction tuning may not provide [ 7 ] . While fine-tuning LLMs on diverse and broad instruction datasets [ 8 , 9 ] improves their overall generalization, performance on specific tasks often remains suboptimal [ 7 ] . This raises a key challenge: how can we efficiently select data subsets from general instruction datasets to maximize LLM performance on targeted tasks, given only a handful of examples ( § 2.1 ) [ 10 , 11 ] . To address this challenge, data selection methods can be roughly grouped into two main categories: influence-based methods and distribution alignment methods. Influence-based methods [ 11 , 12 , 13 ] select training data by estimating the influence of each candidate sample on the evaluation loss for target examples [ 14 ] , and prioritize samples that are expected to most reduce this loss. However, these approaches can be unstable since evaluation loss can fail to reflect true model performance after instruction tuning, causing inconsistency in selection results [ 15 , 16 , 17 ] . As an alternative, distribution alignment methods [ 18 , 19 , 20 , 21 ] select data whose distribution is similar to that of the target task, in order to minimize distribution shift and improve generalization [ 10 , 22 , 23 , 24 ] . These methods typically embed samples into a feature space, define a similarity metric within this space, and select data most similar to representative samples of the target task ( § 2.2 ). Figure 1 : (a) An example of neural coactivation in brain [ 25 ] (b) Disentangling polysemantic activations into monosemantic representations via a sparse autoencoder (SAE) (c) Improved data selection using monosemantic activations (More details are in Appendix B.3 ) While distribution alignment offers a principled framework for data selection, its effectiveness depends heavily on how samples are represented. Existing methods typically rely on data-centric embeddings, derived either from shallow textual features (e.g., BM25 [ 18 ] and DSIR [ 19 ] ) or high-dimensional neural representations (e.g., BGE [ 20 ] and LLM2Vec [ 21 ] ) extracted directly from the data. While effective in many settings, such representations may fail to capture the internal computational dynamics of how the model processes different data points, which is crucial for task-specific performance [ 26 , 27 ] . To address this, we introduce a model-centric paradigm which explicitly captures these internal dynamics by representing each data point through the neuronal activation pattern it triggers in a pretrained model . This approach is inspired by neuroscience, where related concepts trigger coordinated neural responses [ 28 ] (Figure 1 -a). Accordingly, we select those training samples whose activation signatures in the model are most similar to those elicited by target task exemplars. Nonetheless, directly using raw neuron activations can yield suboptimal similarity estimates due to neuron polysemanticity, where a single neuron may respond to multiple, unrelated concepts 1 1 1 For example, one neuron in a large language model may be activated by both academic citations and HTTP request patterns. [ 26 ] . As a consequence, unrelated samples can appear spuriously similar due to shared activation of polysemantic neurons (left of Figure 1 -b). To mitigate this issue, we employ sparse autoencoders (SAEs) [ 27 , 29 , 30 ] to disentangle polysemantic activations into sparse, monosemantic units, making similarity in activation space more aligned with semantic similarity (right of Figure 1 -b, § 2.3 ). This improvement is illustrated in Figure 1 -c, where data selection based on monasemantic activations yields superior performance compared to raw polysemantic activations. In addition, we introduce a dedicated similarity metric tailored to the sparse monosemantic activation space produced by SAEs, as detailed in § 2.4 . In summary, our contributions are: 1) We propose MoNA ( Mo nosemantic N euronal A ctivation-based Data Selection), a novel method for task-specific data selection in instruction tuning. MoNA represents each sample using sparse, monosemantic neuronal activations derived from sparse autoencoders, enabling model-centric data selection. 2) We introduce a similarity metric tailored to this sparse monosemantic activation space, enabling more accurate identification of task-relevant examples. 3) Comprehensive experiments across multiple candidate instruction tuning datasets, evaluation tasks, models, and data selection ratios demonstrate that MoNA consistently outperforms existing data selection approaches. We will release our code to facilitate further research in the community. 2 Methods We begin this section by formalizing the task-specific data selection problem and its objective. Next, we outline the distribution alignment framework that underpins our approach. We then describe our proposed method ( MoNA ) in detail, including the construction of monosemantic neuronal activation embeddings and the dedicated similarity metric designed for this embedding space. 2.1 Problem Formulation Given a large-scale general instruction dataset \mathcal{D}^{\text{src}}=\left\{\mathbf{s}_{i}\right\}_{i=1}^{N} and a small set of representative examples from the target task \mathcal{D}^{\text{tgt}}=\left\{\mathbf{s}_{j}\right\}_{j=1}^{M} , where M\ll N , our goal is to select a subset \mathcal{D}^{\text{sel}}\subset\mathcal{D}^{\text{src}} such that fine-tuning a large language model (LLM) on \mathcal{D}^{\text{sel}} leads to the best overall performance on the target task, denoted as \mathcal{T}^{\text{tgt}} . Formally, let \mathcal{M}_{\theta} denote an LLM with parameters \theta , and S(\mathcal{M}_{\theta},\mathcal{T}^{\text{tgt}}) denote its performance metric (e.g., accuracy, F1-score) on the target task. The data selection objective is formulated as: \displaystyle\mathcal{D}^{\text{sel}}=\argmax_{\mathcal{D}\subset\mathcal{D}^{\text{src}},\,|\mathcal{D}|=k}S\left(\mathcal{M}_{\theta^{*}},\mathcal{T}^{\text{tgt}}\right), (1) where |\mathcal{D}|=k is a budget constraint on the number of selected samples, and \theta^{*} is obtained by fine-tuning the model on \mathcal{D} : \displaystyle\theta^{*}=\textit{Optimize}\left(\mathcal{M}_{\theta},\mathcal{D}\right). (2) However, directly optimizing Eq. ( 1 ) is computationally infeasible, as it involves enumerating all possible subsets and retraining the model for each. This motivates the need for efficient