Censored LLMs as a Natural Testbed for Secret Knowledge Elicitation

Helena CasademuntHarvard University [email protected], Bartosz CywińskiWarsaw University of TechnologyIDEAS Research Institute [email protected], Khoi Tran, Arya JakkliCentraleSupélecSamuel MarksAnthropicNeel Nanda · 2026

Read Censored LLMs as a Natural Testbed for Secret Knowledge Elicitation by Helena CasademuntHarvard University [email protected], Bartosz CywińskiWarsaw University of TechnologyIDEAS Research Institute [email protected], Khoi Tran, Arya JakkliCentraleSupélecSamuel MarksAnthropicNeel Nanda (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-05494.txt.

Introduction

Casademunt and team use censored open-weights language models made in China as a natural testbed for secret knowledge elicitation. Qwen3 models often state false claims about Falun Gong and the Tiananmen protests, yet sometimes answer right, showing knowledge they hold but hide. For honesty elicitation, tuning on generic honesty data, few-shot prompting, and sampling without a chat template best raise truthful answers. On the lie-spotting side, the censored model sorting its answers nears the best an uncensored model can do, and no technique wipes out false answers.

Catalog record

CREATORHelena CasademuntHarvard University [email protected], Bartosz CywińskiWarsaw University of TechnologyIDEAS Research Institute [email protected], Khoi Tran, Arya JakkliCentraleSupélecSamuel MarksAnthropicNeel Nanda
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE125765
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.05494

Browse the full library · About the Tower of Babel