Squeeze Evolve Unified Multi-Model Orchestration for Verifier-Free Evolution
Monishwaran Maheswaran Leon Lakhani Zhongzhu Zhou Shijia Yang Junxiong Wang Coleman Hooper Yuezhou Hu Rishabh Tiwari Jue Wang Harman Singh Qingyang Wu Yuqing Jian Ce Zhang Kurt Keutzer Tri Dao Xiaoxia Wu Ben Athiwaratkun James Zou Chenfeng Xu UC Berkeley UT Austin Stanford University Princeton University Together AI · 2026
Read Squeeze Evolve Unified Multi-Model Orchestration for Verifier-Free Evolution by Monishwaran Maheswaran Leon Lakhani Zhongzhu Zhou Shijia Yang Junxiong Wang Coleman Hooper Yuezhou Hu Rishabh Tiwari Jue Wang Harman Singh Qingyang Wu Yuqing Jian Ce Zhang Kurt Keutzer Tri Dao Xiaoxia Wu Ben Athiwaratkun James Zou Chenfeng Xu UC Berkeley UT Austin Stanford University Princeton University Together AI (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-07725.txt.
Introduction
Maheswaran and 18 colleagues present Squeeze Evolve, a way to evolve model answers with no outside checker scoring them. Strong models handle only the stages where added skill matters most. Cheaper models cover the rest, which curbs collapse toward narrow answers and keeps costs down. Across math, coding, and vision tests it beats single-model evolution on cost versus skill, cuts API cost up to about threefold, and on discovery tasks matches methods that use checkers.
Catalog record
| CREATOR | Monishwaran Maheswaran Leon Lakhani Zhongzhu Zhou Shijia Yang Junxiong Wang Coleman Hooper Yuezhou Hu Rishabh Tiwari Jue Wang Harman Singh Qingyang Wu Yuqing Jian Ce Zhang Kurt Keutzer Tri Dao Xiaoxia Wu Ben Athiwaratkun James Zou Chenfeng Xu UC Berkeley UT Austin Stanford University Princeton University Together AI |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 52282 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.07725
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Squeeze Evolve Unified Multi-Model Orchestration for Verifier-Free Evolution Monishwaran Maheswaran Leon Lakhani Zhongzhu Zhou Shijia Yang Junxiong Wang Coleman Hooper Yuezhou Hu Rishabh Tiwari Jue Wang Harman Singh Qingyang Wu Yuqing Jian Ce Zhang Kurt Keutzer Tri Dao Xiaoxia Wu Ben Athiwaratkun James Zou Chenfeng Xu UC Berkeley UT Austin Stanford University Princeton University Together AI Abstract We show that verifier-free evolution is bottlenecked by both diversity and efficiency: without external correction, repeated evolution accelerates collapse toward narrow modes, while the uniform use of a high-cost model wastes compute and quickly becomes economically impractical. We introduce Squeeze Evolve , a unified multi-model orchestration framework for verifier-free evolutionary inference. Our approach is guided by a simple principle: allocate model capability where it has the highest marginal utility. Stronger models are reserved for high-impact stages, while cheaper models handle the other stages at much lower costs. This principle addresses diversity and cost-efficiency jointly while remaining lightweight. Squeeze Evolve naturally supports open-source, closed-source, and mixed-model deployments. Across AIME 2025, HMMT 2025, LiveCodeBench V6, GPQA-Diamond, ARC-AGI-V2, and multimodal vision benchmarks, such as MMMU-Pro and BabyVision, Squeeze Evolve consistently improves the cost–capability frontier over single-model evolution and achieves new state-of-the-art results on several tasks. Empirically, Squeeze Evolve reduces API cost by up to ∼ \sim 3 × \times and increases fixed-budget serving throughput by up to ∼ \sim 10 × \times . Moreover, on discovery tasks, Squeeze Evolve is the first verifier-free evolutionary method to match, and in some cases exceed, the performance of verifier-based evolutionary methods. Code | Project Page Figure 1 : Squeeze Evolve shifts the cost–capability frontier left by combining verifier-free evolution with multi-model orchestration. Left: Conceptual scaling curves. Right: Key results across ARC-AGI-V2, MMMU-Pro, and BabyVision. 1 Introduction Test-time scaling has emerged as a practical way to push language models beyond one-shot inference by spending additional compute at test time to search over or refine candidate solutions ( 52 ; 30 ; 50 ) . A particularly promising direction is self-evolution, where models iteratively improve candidates through selection, mutation, and recombination ( 34 ; 42 ; 24 ; 28 ) . When coupled with an external verifier, this paradigm can unlock powerful discovery capabilities. But in many important domains, verification is too expensive and slow, or simply unavailable. For example, in nuclear fusion research, a single tokamak plasma study may require more than 120 million CPU-hours ( 18 ) . This motivates our focus on verifier-free evolution . However, verifier-free evolution is also expensive. In methods such as RSA, the model may generate 500–700 \times more tokens than standard single-shot LLM inference, making the cost of additional search increasingly difficult to sustain. This cost pressure is compounded by a second tension: models differ sharply in both capability and cost. Proprietary frontier models typically lead on broad, high-stakes benchmarks, while open-weight models offer clear advantages in accessibility, controllability, and marginal cost, especially when self-hosted. Based on listed API prices as of March 16, 2026, representative proprietary reasoning models remain substantially more expensive than strong hosted open-weight alternatives, with output-token costs roughly 4\times to 25\times higher across the providers and models considered here ( 37 ; 3 ; 16 ; 47 ; 48 ) . Even within the open-weight ecosystem, cost differences can still be substantial across model families and deployment settings. Together, these two pressures suggest that verifier-free evolution must not only scale compute, but allocate it across models of different cost. As a result, the key question is shifting: rather than only asking how we can spend more compute and money to unlock new capabilities? , we must also ask how we can achieve a given capability target under tight budget constraints? This is the same principle that has historically driven advances in software and algorithms: progress comes not just from using more resources, but from using them more efficiently and lowering the cost needed to achieve a given capability target. 1 1 1 https://epochai.substack.com/p/the-least-understood-driver-of-ai In this work, we advance this principle, as illustrated in Figure 1 . To answer the above question, we first take a system perspective: many seemingly disparate test-time methods can be expressed as instances of a single evolutionary framework. Once cast in this unified form, they expose a common design space that can be optimized jointly. In Section 3 , we describe how we unify the current test-time scaling method into a single evolutionary framework, where different operator choices recover a wide spectrum of existing test-time strategies. For example, majority voting ( 52 ) corresponds to a shallow single-step evolution, recursive self-aggregation ( 50 ) corresponds to a verifier-free multi-step evolutionary process, and verifier-based self-evolve pipelines such as AlphaEvolve ( 34 ) correspond to feedback-driven evolutionary search. Our unified framework naturally highlights the key problems: 1. Given models with different cost–capability trade-offs, which model should be assigned to each operator in the evolutionary pipeline (e.g., initialization, generation, recombination, or fitness estimation)? 2. How should these models be coordinated across the pipeline to maximize capability per unit cost without incurring excessive orchestration overhead? We answer these two questions through a comprehensive empirical analysis in Section 4 . In brief, we find that: 1. From the verification perspective, scaling the token budget can partially offset the absence of explicit verification. By spending additional tokens on diverse generation and iterative aggregation, verifier-free evolution can converge reliably toward correct solutions even without external reward signals. This makes verifier-free evolution especially attractive in practice, as it improves capability while avoiding the substantial cost of explicit verification. 2. From the performance perspective, unlike verifier-based method, simple verifier-free evolution causes the upper bound ( e.g., pass@N or best continuous score ) to degrade significantly. Such a drop directly limits the achievable performance of the entire pipeline. We further find that this upper bound is highly correlated with generation diversity, highlighting diversity as a central ingredient for effective verifier-free evolution. This further strongly motivates our use of multi-model orchestration to preserve diversity and sustain performance. 3. From the cost perspective, different models are best suited to different roles, and assigning them accordingly can maximize performance per unit cost. In particular, we find that initialization quality largely determines the quality of the final recombination result, while recombination capability varies substantially across models and depends on the candidate set being aggregated. Furthermore, we show that self-model and cross-model’s internal signals can serve as reliable fitness signals in the verifier-free setting. These findings provide a foundation for more principled orchestration design. Motivated by these observations and by the economic mismatch between open and closed model ecosystems, we present Squeeze-Evolve , a multi-model orchestration framework that routes each evolutionary operation to the most cost-effective model based on confidence-derived fitness signals, reserving expensive models for only the highest-marginal-utility steps. We evaluate Squeeze Evolve across AIME 2025, HMMT 2025, GPQA-Diamond, LiveCodeBench V6, MMMU-Pro, BabyVision, ARC-AGI-V2, and circle packing, spanning open-source model pairs, mixed open-source and proprietary model pairs, and multimodal vision settings. In summary, we make the following contributions: 1. We unify existing test-time scaling methods into a single evolutionary framework and identify the key design axes for multi-model orchestration (Section 3 ). A comprehensive motivation analysis reveals that diversity collapse is the central bottleneck of verifier-free evolution, and that