OctoT2I: A Self-Evolving Agentic Text-to-Image Router
Xu Jiang, Bin Chen, Gehui Li, Yule Duan, Ronggang Wang, Jian Zhang · 2026
Read OctoT2I: A Self-Evolving Agentic Text-to-Image Router by Xu Jiang, Bin Chen, Gehui Li, Yule Duan, Ronggang Wang, Jian Zhang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-01803.txt.
Introduction
Jiang and co-authors build a router that picks image-making tools per prompt. Many text-to-image models now exist, from huge to light. One model alone no longer grows much in quality. Agent-based tools use several models, but with flaws. They lean on costly hand-made rules or human labels.
Their OctoT2I router works in rounds and keeps state. A self-built knowledge base guides each pick. The base grows with no human help. It first names traits like style, color, and count. Then a loop of propose, solve, judge, and learn maps each tool. Tests are reported as strong on GenEval scores. Speed gains are also claimed by the authors.
Catalog record
| CREATOR | Xu Jiang, Bin Chen, Gehui Li, Yule Duan, Ronggang Wang, Jian Zhang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 36 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.01803
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
OctoT2I: A Self-Evolving Agentic Text-to-Image Router Xu Jiang, Bin Chen, Gehui Li, Yule Duan, Ronggang Wang, Jian Zhang Abstract The explosive growth of Text-to-Image (T2I) models, from large-scale versions to lightweight, real-time ones, now faces diminishing marginal returns from single-model scaling. Agentic T2I methods emerged to alleviate this bottleneck by using multiple models. However, existing agentic T2I methods suffer from three key challenges: reliance on expensive handcrafted priors or human annotations, rigid single-path decision mechanisms, and a neglect of inference efficiency. To address these challenges, we introduce OctoT2I , a novel agentic framework that reformulates the T2I task as a joint optimization of generation quality and inference efficiency. OctoT2I implements a stateful, multi-round routing strategy that adaptively selects the most suitable tool based on its knowledge and memory. This strategy is enabled by a knowledge base built from scratch by our novel Self-Evolving Mechanism. This mechanism, which requires no human supervision, first autonomously defines foundational Conceptual Dimensions ( e.g . , style, color, count) and then intelligently explores their combinations via an iterative “Propose–Solve–Evaluate–Learn” (PSEL) loop. The PSEL loop efficiently discovers each tool’s capability frontier, driving continuous improvement without external guidance. Extensive experiments demonstrate that OctoT2I achieves competitive performance ( 0.96 ) on GenEval while delivering a 90.3% inference speedup and a 56.6% energy-efficiency gain over the leading baseline (Flow-GRPO), striking an exceptional balance between performance and efficiency. Code is available at https://github.com/JaxJiang2642081986/OctoT2I . Figure 1 : The core advantages of OctoT2I in performance, decision-making, and knowledge acquisition. (a) OctoT2I (Ours) achieves an exceptional performance-efficiency balance on GenEval. (b) This superior performance stems from its intelligent, evidence-based decisions, which route each user prompt to the most suitable T2I model. For example, it selects the most efficient tool (sd-turbo) for “a photo of a snowboard” while allocating the most justifiable tool (flow-grpo) for “Generate an image containing 5 hamburgers”. (c, d, e) This intelligent decision-making capability is enabled by our novel (e) self-evolving mechanism, which overcomes the limitations of previous (c) handcrafted priors or (d) costly supervised fine-tuning (SFT) with human-annotated data. † † footnotetext: This work was supported in part by National Natural Science Foundation of China (62372016), National Science and Technology Major Project-Mobile Information Networks (2024ZD130060), Guangdong Provincial Key Laboratory of Ultra High Definition Immersive Media Technology (2024B1212010006), Shenzhen Science and Technology Program (SYSPG20241211173440004) and Outstanding Talents Training Fund in Shenzhen. † † footnotetext: ∗ Equal contribution. † Corresponding author. 1 Introduction Text-to-Image (T2I) models translate textual language into corresponding images and thereby improve the efficiency of visual content creation. Architectural progress has been rapid: diffusion models 4 ; 36 ; 38 ; 54 ; 61 ; 58 ; 3 ; 41 now dominate, while autoregressive approaches 55 ; 9 ; 32 ; 46 continue to advance. In parallel, the field shows a clear split in scale. One line of work 11 ; 26 ; 29 ; 51 ; 24 focuses on building larger models to reach state-of-the-art performance, often with reinforcement learning during post-training; for example, reported parameter counts range from roughly \sim 1B in early Stable Diffusion 38 variants and 0.6B in PixArt- \alpha 8 to multi-billion scales such as 8B in Stable Diffusion 3 11 and 24B in Playground v3 28 . A second line of work 39 ; 26 ; 54 ; 7 emphasizes efficiency and yields lightweight models with much faster generation. Despite these gains, the marginal return from scaling a single model is diminishing, and the rapidly growing number of different models makes it difficult for non-professional users to select the most suitable tool for a given task. To overcome the capability bottleneck of a single model, researchers have brought agents 25 ; 6 ; 57 ; 14 ; 63 into T2I. The core idea is to use an LLM as a controller that composes and schedules multiple off-the-shelf T2I models (referred to as “tools”) so the system can tackle complex tasks that a single tool struggles to solve. Initial works 48 ; 60 ; 20 ; 63 provide preliminary evidence that these agentic methods can enhance the capability of T2I systems. Despite early progress, the performance of agentic T2I methods remains constrained by how they acquire tool-usage knowledge. On the one hand, 48 ; 5 relies on human-written priors for decision making. Its performance, therefore, depends on the granularity and coverage of human-written tool descriptions, which consequently limit generalization and system performance. On the other hand, 20 ; 63 pursues better generalization by training LLMs on large, finely annotated datasets created by humans. This path is very expensive for both annotation and model training, exhibits limited scalability 44 ; 43 , and is ultimately bounded by human supervision 18 ; 62 . Beyond knowledge, current systems are further limited by static and single-path decision mechanisms. Workflows such as 48 ; 20 ; 5 typically use only one specific T2I tool for a single round of generation. Idea2Img 60 enables multiple rounds of generation, but the generation tool used remains fixed. Finally, efficiency has been overlooked in previous work, leading to high inference latency and computational cost that harm user experience in interactive settings and hinder practical deployment and sustainability in the long term. To this end, we reformulate agentic T2I as a joint optimization of generation quality and inference efficiency. We then introduce OctoT2I , a novel agentic framework designed to operationalize this new formulation. The core of this framework is a router agent capable of iterative decision-making, which relies on two key information sources: a Knowledge Module for storing long-term knowledge of tools, and a Memory Module for recording the execution history of the current task. In each decision round, the agent queries these two sources and decides which tool to execute. Subsequently, the Evaluation Module quantitatively scores the outcome, and this score is fed back into the memory as new experience to inform the next round of decisions, forming a complete “reason-act-reflect” loop. Additionally, to alleviate the performance limitations and high costs in the knowledge acquisition of prior methods, we design a novel Self-Evolving Mechanism where the agent autonomously acquires knowledge from scratch. Specifically, the agent first autonomously defines a set of conceptual dimensions. Subsequently, the agent initiates an iterative “Propose–Solve–Evaluate–Learn” (PSEL) loop over conceptual dimension combinations, which is guided by an Exploration Space Pruning strategy for efficient and adaptive tool capability frontier search. In the “Propose” stage, it instantiates current dimension combination into concrete textual prompts. The agent then proceeds to the “Solve” and “Evaluate” stages by solving tasks with different tools and quantitatively assessing the generated images. Finally, in the “Learn” stage, it analyzes and summarizes the evaluation results to update its knowledge base. This data-driven process, built entirely on self-interaction, enables the agent to surpass the performance limitations of traditional, handcrafted priors. ❑ (1) We propose OctoT2I, a novel agentic router to operationalize the co-optimization of performance and efficiency. It implements a stateful, multi-round router that leverages knowledge and memory to adaptively select the most suitable tool for each prompt based on real-time feedback. ❑ (2) We introduce a self-evolving mechanism that enables the agent to acquire knowledge entirely through self-interaction, without external data or human supervision. ❑ (3) Extensive experiments show that OctoT2I achieves leading performance