AGORA: Incentivizing Group Emergence Capability in LLMs via Group Distillation
Ren Zhuang, Ben Wang, Shuifa Sun · 2025
Read AGORA: Incentivizing Group Emergence Capability in LLMs via Group Distillation by Ren Zhuang, Ben Wang, Shuifa Sun (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-21166.txt.
Introduction
Human culture improves because each generation keeps what the last one learned, a ratchet that blocks backsliding. Ren Zhuang asks whether groups of language models can ratchet too. He built a society of small models that solve problems, check each other's work, and store the verified results in a shared memory. The models then absorb that memory into their own weights.
On math reasoning tests, populations of small models gained nine to nineteen points over their base versions. They closed much of the gap to models many times their size. Tests that removed parts of the system showed peer checking was the main ratchet. Absorbing the memory kept gains alive across rounds. Interaction, not just size, drove the growth.
Catalog record
| CREATOR | Ren Zhuang, Ben Wang, Shuifa Sun |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 31 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-21166
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
AGORA: Incentivizing Group Emergence Capability in LLMs via Group Distillation Ren Zhuang, Ben Wang, Shuifa Sun Abstract Progress in complex reasoning is constrained by the static nature of the current training datasets. We propose structured interaction as a new scaling axis, moving beyond the prevailing paradigm of increasing model parameters. Our self-evolving framework, AGORA, enables a collaborative ensemble to achieve reasoning performance exceeding state-of-the-art monolithic systems by up to 4.45 percentage points on challenging mathematical benchmarks. This gain stems from group emergent ability—the synthesis of collective capabilities unattainable by isolated models, validating interaction as a scalable driver of intelligence. Our results position the engineering of collaborative ecosystems as a vital frontier for capability emergence. Introduction While Large Language Models (LLMs) demonstrate strong performance across diverse tasks ( Guo et al. 2025 ; Chen et al. 2025 ; Liu et al. 2024 ) , progress in complex reasoning domains that necessitate verifiable, multi-step thought processes remains constrained. Mathematics itself, the domain that first revealed emergent abilities in LLMs ( Wei et al. 2022b ; Yao et al. 2023 ) , starkly illustrates the limitations of learning from static, externally-curated datasets ( Shao et al. 2024 ; Zhuang, Wang, and Sun 2025 ; Wang et al. 2025 ; Ye et al. 2025 ) . This paradigm creates a paradox: we expect models to learn dynamically, yet we train them in static environments. Existing methods, from synthetic data generation ( Luo et al. 2025 ; Li et al. 2023a ) to reinforcement learning ( Ouyang et al. 2022 ; Rafailov et al. 2023 ; Schulman et al. 2017 ) , rely on knowledge from exogenous sources. They fail to create a self-sufficient ecosystem where curriculum and capabilities co-evolve endogenously—a long-standing goal in fields like Multi-Agent Systems ( Van der Hoek and Wooldridge 2008 ) and Artificial Life ( Langton 1997 ) . We introduce Autopoietic Group Optimization Reasoning Ascension (AGORA), a framework that cultivates an ecosystem of heterogeneous models that co-evolve with their own dynamically generated data. As shown in Figure 1 , AGORA enables an ensemble of small models to achieve a collective reasoning performance that surpasses monolithic systems with substantially more parameters. Group distillation, AGORA’s core mechanism, drives this process through a decentralized protocol where models learn from peer-generated solutions, dynamically alternating between teacher and student roles. This multidirectional knowledge flow contrasts sharply with the fixed, top-down hierarchies of traditional distillation ( Hinton, Vinyals, and Dean 2015 ; Frosst and Hinton 2017 ; Chen et al. 2021 ) . The system drives this evolution by coupling rapid in-context adaptation with permanent knowledge consolidation via Low-Rank Adaptation (LoRA) ( Hu et al. 2022 ) , steered by automated peer evaluation. AGORA’s significance, however, lies in the collective behaviors that emerge from this architecture, making the whole greater than the sum of its parts. This dynamic echoes the foundational principle of emergence that more is different ( Anderson 1972 ) . Figure 1: Performance trajectory of the AGORA ensemble on MATH500. The ensemble’s performance improves over evolutionary steps, surpassing several larger, static benchmarks. The star denotes a strategic shift toward elite-peer learning, which breaks a performance plateau. Our core contributions are: • We introduce group distillation , a novel decentralized knowledge transfer mechanism where models dynamically assume teacher-student roles, enabling multidirectional knowledge flow within the ensemble. • We define and validate group emergent ability , a phenomenon where collaborative interaction enables a collective of models to develop synergistic capabilities unattainable in isolation. • We provide empirical evidence that an AGORA ensemble of small models can significantly outperform strong, state-of-the-art self-improvement methods applied to its individual constituents. Related Work AGORA represents a paradigm that unifies three distinct lines of research: knowledge transfer, emergent abilities, and data synthesis. It proposes that complex social-cognitive dynamics, rather than resource scale alone, can be the primary driver of capability enhancement. Knowledge Distillation and Collaborative Learning Traditional knowledge distillation is a top-down process that transfers knowledge from a fixed, superior teacher model to a student ( Sachdeva and McAuley 2023 ; Gou et al. 2021 ; Hinton, Vinyals, and Dean 2015 ) . This top-down structure inherently limits the learning dynamic. While recent advances like Self-Distillation ( Zhang, Bao, and Ma 2021 ) and Online Distillation ( Anil et al. 2018 ) have challenged this, they still largely operate within predefined, static relationships. AGORA’s group distillation transcends this by establishing a decentralized ecosystem where teacher-student roles are dynamic. Whereas traditional methods transfer existing knowledge, Group Distillation is designed to catalyze the synthesis of novel collective capabilities that may not pre-exist in any individual member. Emergent Abilities in Large Language Models Scaling LLMs has revealed emergent abilities ( Wei et al. 2022a ; Hoffmann et al. 2022 ) —qualitative leaps in capability unpredictable from smaller models ( Achiam et al. 2023 ; Zhao et al. 2023 ) . These abilities, ranging from multi-step arithmetic to complex instruction-following ( Ouyang et al. 2022 ; Wei et al. 2022b ) , appear to arise when a model is sufficiently large, a principle investigated in scaling law studies ( Kaplan et al. 2020 ) . The current paradigm assumes this emergence is driven by scaling a single, monolithic model. AGORA challenges this single-source assumption, proposing that emergence can also be driven by interaction. Data Synthesis Leading approaches for mathematical reasoning rely on sophisticated forms of data synthesis. These range from systematically augmenting existing problems, as explored by MuggleMath ( Li et al. 2023a ) , to evolving instructions based on predefined heuristics for complexity and novelty, as seen in DART ( Tong et al. 2024 ) and MAGPIE ( Xu et al. 2024 ) . Other techniques synthesize training data from a model’s own outputs. For instance, some bootstrap from solutions verified against ground-truth answers, a technique used in the STaR framework ( Zelikman et al. 2022 ) . Another approach, used by SGDS ( Li et al. 2023b ) , filters for a high-difficulty subset based on a predefined metric. While these represent powerful data generation pipelines, they differ fundamentally from AGORA. Unlike methods that treat data generation as a distinct, offline step, AGORA integrates it as a dynamic part of the learning loop. Crucially, because its curriculum emerges endogenously from collective judgment rather than from external heuristics, AGORA internalizes the very process of defining what constitutes a valuable learning experience. The Architecture of AGORA Figure 2: The AGORA architecture. A four-module, dual-loop architecture that facilitates two core processes: Challenge Generation (I), Solution Formulation (II), Quality Evaluation (III), and Model Evolution (IV). The architecture facilitates group distillation for knowledge consolidation and uses an elite history of peer solutions to incentivize group emergence. AGORA’s architecture is built on three core dynamics: collaborative genesis, endogenous evaluation, and concurrent evolution. Together, these dynamics govern how models generate problems, provide peer feedback, and internalize results. This structure transforms a static ensemble into a self-improving system driven by its own collaborative discourse. Collaborative Genesis This dynamic generates a continuous stream of problems and solutions through the interplay of a problem-generating Q-Group and a problem-solving R-Group, with roles detailed in Figure 2 . Challenge Generation The Q-Group adaptively adjusts curriculum difficulty through a dual-loop feedback mechanism. The inner