Finding the Translation Switch: Discovering and Exploiting the Task-Initiation Features in LLMs

Xinwei Wu, Heng Liu, Xiaohu Zhao, Yuqi Ren, Linlong Xu, Longyue Wang, Deyi Xiong, Weihua Luo, Kaifu Zhang · 2026

Read Finding the Translation Switch: Discovering and Exploiting the Task-Initiation Features in LLMs by Xinwei Wu, Heng Liu, Xiaohu Zhao, Yuqi Ren, Linlong Xu, Longyue Wang, Deyi Xiong, Weihua Luo, Kaifu Zhang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-11019.txt.

Description

Xinwei Wu and co-authors hunt for the translation switch inside large language models. Models often translate well with no task-specific fine-tuning. The inner mechanism behind that ready skill is largely opaque. The team uses sparse autoencoders, tools that pull apart a model's activity into readable features. They build a framework to find task-specific features.

Their target is the set of features that initiate translation, the switch that tells the model to switch languages. Finding such features would show how one model routes itself among skills. It could also give engineers a dial: turn the feature on or off to control behavior. The work advances the craft of reading models from the inside.

Catalog record

CREATORXinwei Wu, Heng Liu, Xiaohu Zhao, Yuqi Ren, Linlong Xu, Longyue Wang, Deyi Xiong, Weihua Luo, Kaifu Zhang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE40 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-11019

Browse the full library · About the Tower of Babel