It Takes Two : Complementary Self-Distillation for Contextual Integrity in LLMs
Sangwoo Park, Woongyeong Yeo, Seanie Lee, Yumin Choi, Hyomin Lee, Kangsan Kim, Jinheon Baek, Seong Joon Oh, Sung Ju Hwang, [0.5em] KAIST · 2026
Read It Takes Two : Complementary Self-Distillation for Contextual Integrity in LLMs by Sangwoo Park, Woongyeong Yeo, Seanie Lee, Yumin Choi, Hyomin Lee, Kangsan Kim, Jinheon Baek, Seong Joon Oh, Sung Ju Hwang, [0.5em] KAIST (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-20258.txt.
Description
Sangwoo Park and eight co-workers set out SELFCI, a self-taught frame steering private flows by setting norms in LLMs. Agent aides must choose what to share well, yet top models choose poorly, and fixes blunt their work. SELFCI splits the job in two reverse KL teacher tracks, one guarding task facts, one keeping sharing small and apt, joining skill and restraint as one Product-of-Experts aim. With no outside supervision, it beats GRPO and holds up on new agentic jobs with piled-up private context.
Catalog record
| CREATOR | Sangwoo Park, Woongyeong Yeo, Seanie Lee, Yumin Choi, Hyomin Lee, Kangsan Kim, Jinheon Baek, Seong Joon Oh, Sung Ju Hwang, [0.5em] KAIST |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 93666 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.20258