It Takes Two : Complementary Self-Distillation for Contextual Integrity in LLMs

Sangwoo Park, Woongyeong Yeo, Seanie Lee, Yumin Choi, Hyomin Lee, Kangsan Kim, Jinheon Baek, Seong Joon Oh, Sung Ju Hwang, [0.5em] KAIST · 2026

Read It Takes Two : Complementary Self-Distillation for Contextual Integrity in LLMs by Sangwoo Park, Woongyeong Yeo, Seanie Lee, Yumin Choi, Hyomin Lee, Kangsan Kim, Jinheon Baek, Seong Joon Oh, Sung Ju Hwang, [0.5em] KAIST (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-20258.txt.

Description

Sangwoo Park and eight co-workers set out SELFCI, a self-taught frame steering private flows by setting norms in LLMs. Agent aides must choose what to share well, yet top models choose poorly, and fixes blunt their work. SELFCI splits the job in two reverse KL teacher tracks, one guarding task facts, one keeping sharing small and apt, joining skill and restraint as one Product-of-Experts aim. With no outside supervision, it beats GRPO and holds up on new agentic jobs with piled-up private context.

Catalog record

CREATORSangwoo Park, Woongyeong Yeo, Seanie Lee, Yumin Choi, Hyomin Lee, Kangsan Kim, Jinheon Baek, Seong Joon Oh, Sung Ju Hwang, [0.5em] KAIST
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE93666
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.20258

Browse the full library · About the Tower of Babel