BrainDistill: Implantable Motor Decoding with Task-Specific Knowledge Distillation

Yuhan Xie, Jinhan Liu, Xiaoyong Ni, Fei Tan, Icare Sakr, Thibault Collin, Shiqi Sun, Alejandro Rodriguez Guajardo, Demon Fanny, Charles-francois Vincent Latchoumane, Henri Lorach, Jocelyne Bloch, Gregoire Courtine, Mahsa Shoaran · 2026

Read BrainDistill: Implantable Motor Decoding with Task-Specific Knowledge Distillation by Yuhan Xie, Jinhan Liu, Xiaoyong Ni, Fei Tan, Icare Sakr, Thibault Collin, Shiqi Sun, Alejandro Rodriguez Guajardo, Demon Fanny, Charles-francois Vincent Latchoumane, Henri Lorach, Jocelyne Bloch, Gregoire Courtine, Mahsa Shoaran (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-17625.txt.

Introduction

Yuhan Xie and co-authors present BrainDistill for implantable brain-computer interfaces. Large transformer decoders now beat older methods on BCI tasks. They are too big and power-hungry for implants. Implants must run cool and small inside the body. BrainDistill uses task-specific knowledge distillation. A big teacher trains a small model for one task.

A lean decoder that keeps accuracy could reach real patients. Motor decoding turns brain signals into movement commands. That can restore control for people with paralysis. Distillation tuned per task squeezes size where it counts. The work targets the gap between lab scores and bedside use. Power limits, not accuracy, are the wall it attacks.

Catalog record

CREATORYuhan Xie, Jinhan Liu, Xiaoyong Ni, Fei Tan, Icare Sakr, Thibault Collin, Shiqi Sun, Alejandro Rodriguez Guajardo, Demon Fanny, Charles-francois Vincent Latchoumane, Henri Lorach, Jocelyne Bloch, Gregoire Courtine, Mahsa Shoaran
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE72 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-17625

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

BrainDistill: Implantable Motor Decoding with Task-Specific Knowledge Distillation Yuhan Xie, Jinhan Liu, Xiaoyong Ni, Fei Tan, Icare Sakr, Thibault Collin, Shiqi Sun, Alejandro Rodriguez Guajardo, Demon Fanny, Charles-francois Vincent Latchoumane, Henri Lorach, Jocelyne Bloch, Gregoire Courtine, Mahsa Shoaran Abstract Transformer-based neural decoders with large parameter counts, pre-trained on large-scale datasets, have recently outperformed classical machine learning models and small neural networks on brain–computer interface (BCI) tasks. However, their large parameter counts and high computational demands hinder deployment in power-constrained implantable systems. To address this challenge, we introduce BrainDistill , a novel implantable motor decoding pipeline that integrates a implantable neural decoder ( IND ) with a task-specific knowledge distillation ( TSKD ) framework. Unlike standard feature distillation methods that attempt to preserve teacher representations in full, TSKD explicitly prioritizes features critical for decoding through supervised projection. Across multiple neural datasets, IND consistently outperforms prior neural decoders on motor decoding tasks, while its TSKD-distilled variant further surpasses alternative distillation methods in few-shot calibration settings. Finally, we present a quantization-aware training scheme that enables integer-only inference with activation clipping ranges learned during training. The quantized IND enables deployment under the strict power constraints of implantable BCIs with minimal performance loss. 1 Introduction Decoding movement intentions from neural recordings is a fundamental application of Brain-Computer Interfaces (BCIs), enabling the control of various devices such as drones ( 8 ) , cursors ( 4 ) , and, most importantly, neural prostheses for patients with disabilities ( 31 ) . Multiple recording paradigms have been developed to capture neural activity from the motor cortex, including EEG ( 7 ) , intracortical spikes ( 32 ) , and Electrocorticography or ECoG ( 49 ) . Among these, ECoG offers a favorable balance between spatiotemporal resolution and practicality: it provides higher resolution than EEG while remaining more feasible for long-term use compared to invasive intracortical recordings. Figure 1 : BrainDistill pipeline: (a) Training and testing paradigms of BrainDistill. IND distills from a pre-trained large neural model using small-volume recalibration data via TSKD, and then performs online motor decoding. (b) The two-step TSKD process. First, teacher embeddings are compressed in a supervised manner by a projector; second, the fixed projector is used to align student embeddings with the task space. (c) Task-Specific Projection. TSKD projects teacher embeddings into a task-specific subspace, ensuring that critical task-relevant information is well preserved. A variety of algorithms have been proposed for motor decoding, ranging from classical machine learning methods that rely on hand-crafted features ( 52 ; 2 ; 55 ) to shallow neural networks that automatically extract task-relevant features from raw signals using convolution and attention mechanisms ( 58 ; 45 ; 34 ) . More recently, large neural foundation models pre-trained on diverse neural datasets have been introduced to boost decoding performance and improve long-term stability ( 57 ; 50 ; 51 ; 54 ) . Once pre-trained, these models yield generalizable feature representations that can be efficiently adapted to new datasets with minimal fine-tuning. However, the growing size of neural decoders poses significant challenges for the practical deployment of BCI systems. In fully implantable and long-term medical devices, Systems-on-Chips (SoCs) have been widely adopted ( 42 ) . These SoCs integrate recording, decoding, and potentially stimulation modules into a single cortical implant, making compact and energy-efficient decoders essential. For example, ( 41 ) developed a brain-to-text decoding chip based on LDA with salient feature selection, while ( 43 ) implemented a tree-based model ( 62 ) for brain state classification (e.g., seizures or tremors). The substantial computational complexity of foundation models, combined with the tight hardware constraints of implantable BCI chips, highlights a critical application gap. Although recent work ( 27 ) significantly reduces the number of trainable parameters of brain foundation models using LoRA ( 15 ) without sacrificing performance, it still fails to reduce the model size at inference time. Knowledge distillation (KD) is a popular approach to bridge this gap by transferring knowledge from foundation models to compact student models. However, existing KD methods primarily aim to preserve teacher embeddings as fully as possible ( 36 ; 61 ; 11 ) , which becomes problematic when the student model lacks the capacity to mimic complex teacher features, resulting in limited performance gains. In order to address this challenge, we propose BrainDistill , a novel implantable motor decoding pipeline that combines a lightweight neural decoder with a task-specific knowledge distillation framework. The decoder achieves strong performance on simple motor decoding tasks and, through distillation from a teacher model, generalizes to more complex tasks. Figure 1 illustrates the BrainDistill pipeline and distillation process. Our main technical contributions are: • We propose TSKD , a novel distillation method for neural decoding that is particularly effective when teacher and student models have a large capacity gap and long-term stable performance must be maintained with minimal recalibration data. Our method prioritizes task-specific information by compressing the teacher embeddings under supervision, thereby compensating for the capacity gap and enabling the student to learn stable features. • Beyond empirical analysis, we introduce an evaluation protocol to quantify how much the student model can benefit from different projected teacher embeddings. Specifically, we propose a task-specific ratio ( TSR ), a metric that measures how much task-relevant information is preserved after projection, enabling straightforward selection of the best feature projection for any teacher model on a given dataset. • In addition, we present IND , a neural decoder that tokenizes features via the Continuous Wavelet Transform (CWT) and adopts a lightweight, quantization-friendly linear attention architecture. To further reduce hardware cost, we enhance integer-only quantization with a quantization-aware training (QAT) scheme using learnable clipping ranges. We validate BrainDistill through comparisons with existing decoders, ablations across model architectures and input features, and analysis of chip-level power consumption. The results demonstrate that BrainDistill can serve as a complete implantable motor decoding system with strong potential for clinical applications. Appendix A.1 reviews prior studies on motor decoding, knowledge distillation, and integer-only quantization, and highlights the novelty of our approach. 2 Method 2.1 Problem Definition We consider a motor decoding task with neural data \mathcal{X}=\{(x_{1},y_{1}),(x_{2},y_{2}),\cdots,(x_{n},y_{n})\} , where x_{t}\in\mathbb{R}^{T\times C} represents a segment of brain signals with look back length T and channel number C . At time t , y_{t} denotes either the category of movements or the the joint position. A parameterized neural decoder F is composed of a feature extractor g_{\theta} and a linear classifier layer f_{\phi} . During inference, the model first computes an embedding z_{t}=g_{\theta}(x_{t}) , which is then passed to a classifier to produce the prediction \hat{y_{t}}=f_{\phi}(z_{t}) . In the simplest setting, F will first train on past recordings \mathcal{X}_{\text{offline}} and then test on new coming neural data \mathcal{X}_{\text{online}} . \mathcal{X}_{\text{online}} could contain multiple sessions, where each session is a separate experiment, and the interval between sessions can be days to weeks, depending on the experiment setting. Neural data often drift across recording sessions, which can lead to degraded decoder performance and necessitate periodic recalibration. During recalibration, the parameters \theta and \phi are updated using a subset of recordings \mathcal{X}_{\text{recalib}} from the new session. For efficiency, the size of \mathcal{X}_{\text{recalib}} should be much smaller than that of the offline training set \mathcal{X}_{\text{offline}} . Neural foundation

Read the complete text