Censored LLMs as a Natural Testbed for Secret Knowledge Elicitation
Helena CasademuntHarvard University [email protected], Bartosz CywińskiWarsaw University of TechnologyIDEAS Research Institute [email protected], Khoi Tran, Arya JakkliCentraleSupélecSamuel MarksAnthropicNeel Nanda · 2026
Read Censored LLMs as a Natural Testbed for Secret Knowledge Elicitation by Helena CasademuntHarvard University [email protected], Bartosz CywińskiWarsaw University of TechnologyIDEAS Research Institute [email protected], Khoi Tran, Arya JakkliCentraleSupélecSamuel MarksAnthropicNeel Nanda (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-05494.txt.
Introduction
Casademunt and team use censored open-weights language models made in China as a natural testbed for secret knowledge elicitation. Qwen3 models often state false claims about Falun Gong and the Tiananmen protests, yet sometimes answer right, showing knowledge they hold but hide. For honesty elicitation, tuning on generic honesty data, few-shot prompting, and sampling without a chat template best raise truthful answers. On the lie-spotting side, the censored model sorting its answers nears the best an uncensored model can do, and no technique wipes out false answers.
Catalog record
| CREATOR | Helena CasademuntHarvard University [email protected], Bartosz CywińskiWarsaw University of TechnologyIDEAS Research Institute [email protected], Khoi Tran, Arya JakkliCentraleSupélecSamuel MarksAnthropicNeel Nanda |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 125765 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.05494