MEG-XL: Data-Efficient Brain-to-Text via Long-Context Pre-Training

Dulhan Jayalath, Oiwi Parker Jones · 2026

Read MEG-XL: Data-Efficient Brain-to-Text via Long-Context Pre-Training by Dulhan Jayalath, Oiwi Parker Jones (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-02494.txt.

Description

Dulhan Jayalath and 1 co-author pretrain a brain-to-text model on minutes of neural context instead of seconds, in a 2026 arXiv paper. Clinical brain interfaces serve paralyzed patients who cannot record hours of training data. Pretraining across subjects helps, but only if the model sees enough context, since speech unfolds gradually.

Their model, MEG-XL, pretrains on two and a half minutes of magnetoencephalography per sample, five to three hundred times longer than prior work. Fine-tuned for word decoding, it matched supervised performance using a fraction of the data, one hour instead of fifty in one comparison. It also outperformed brain foundation models. Longer pretraining contexts produced representations that transferred better to decoding. The authors release code, weights, and instructions, arguing that extended neural context is signal other methods discard.

Catalog record

CREATORDulhan Jayalath, Oiwi Parker Jones
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE54 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-02494

Browse the full library · About the Tower of Babel