Guided Self-Evolving LLMs with Minimal Human Supervision

Wenhao Yu 1 , Zhenwen Liang 1 , Chengsong Huang 2 , Kishan Panaganti 1 , Tianqing Fang 1 , Haitao Mi 1 , Dong Yu 1 1 Tencent AI Lab in Seattle, 2 Washington University in St. Louis [email protected] · 2025

Read Guided Self-Evolving LLMs with Minimal Human Supervision by Wenhao Yu 1 , Zhenwen Liang 1 , Chengsong Huang 2 , Kishan Panaganti 1 , Tianqing Fang 1 , Haitao Mi 1 , Dong Yu 1 1 Tencent AI Lab in Seattle, 2 Washington University in St. Louis [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-02472.txt.

Description

Wenhao Yu and colleagues at Tencent AI Lab and Washington University ask whether language models can teach themselves. Models that learn from their own practice runs could keep improving with little human help. In practice, though, unguided self training often stalls fast, or even gets worse over time.

Their 2025 study adds guidance to that loop while keeping human input small. The aim is steady gains rather than drift, with models taking in and refining what they learn. Work of this kind speaks to a long held hope for AI that improves on its own, safely and well. The work shows why a guide still helps when a model trains on its own past work.

Catalog record

CREATORWenhao Yu 1 , Zhenwen Liang 1 , Chengsong Huang 2 , Kishan Panaganti 1 , Tianqing Fang 1 , Haitao Mi 1 , Dong Yu 1 1 Tencent AI Lab in Seattle, 2 Washington University in St. Louis [email protected]
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-02472

Browse the full library · About the Tower of Babel