Multi-Task Optimization over Networks of Tasks
Julian Hatzky, Thomas Bartz-Beielstein, A. E. Eiben, Anil Yaman · 2026
Read Multi-Task Optimization over Networks of Tasks by Julian Hatzky, Thomas Bartz-Beielstein, A. E. Eiben, Anil Yaman (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-21991.txt.
Introduction
Hatzky and three colleagues introduce MONET, a multi-task optimizer modeling the task space as a graph, with tasks as nodes linked by edges in parameter space. This enables knowledge transfer and stays tractable for high-dimensional problems while exploiting task-space topology. MONET pairs social learning, which breeds candidates from neighboring nodes, with individual learning, which improves a node's solution by mutation. Tested on archery, arm, cartpole (5,000 tasks each), and hexapod (2,000), MONET matches or exceeds MAP-Elites-based baselines in all four domains.
Catalog record
| CREATOR | Julian Hatzky, Thomas Bartz-Beielstein, A. E. Eiben, Anil Yaman |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 54855 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.21991
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Multi-Task Optimization over Networks of Tasks Julian Hatzky, Thomas Bartz-Beielstein, A. E. Eiben, Anil Yaman Abstract Multi-task optimization is a powerful approach for solving a large number of tasks in parallel. However, existing algorithms face distinct limitations: Population-based methods scale poorly and remain underexplored for large task sets. Approaches that do scale beyond a thousand tasks are mostly MAP-Elites variants and rely on a fixed, discretized archive that disregards the topology of the task space. We introduce MONET (Multi-Task Optimization over Networks of Tasks), a multi-task optimization algorithm that models the task space as a graph: tasks are nodes, and edges connect tasks in the task parameter space. This representation enables knowledge transfer between tasks and remains tractable for high-dimensional problems while exploiting the topology of the task space. MONET combines social learning , which generates candidates from neighboring nodes via crossover, with individual learning , which refines a node’s own solution independently via mutation. We evaluate MONET on four domains (archery, arm, and cartpole with 5,000 tasks each; hexapod with 2,000 tasks) and show that it matches or exceeds the performance of existing MAP–Elites-based baselines across all four domains. 1 Introduction To maintain reliable performance, real-world embodied agents must remain operational even when their configurations change. For example, in scenarios where a legged robot loses a limb [ 14 , 11 ] or a modular robot reconfigures itself to navigate a narrow passage [ 52 , 46 , 43 ] , they are required to maintain their performance. In such cases, the ability to adapt an existing control strategy instead of relearning a new strategy for the new configuration from scratch can prove to be more efficient. It is possible to achieve this by employing the multi-task optimization approach [ 22 ] , where each configuration variant (e.g. morphology) is treated as a distinct task, and solutions (e.g. controller) are pre-computed for all of them, so that when the configurations change, an appropriate controller is already available or is faster to adapt [ 36 , 12 ] . In other words, given a parameterized family of tasks, the multi-task optimization approach aims to find a high-quality solution for each task simultaneously and in parallel [ 22 ] . Figure 1 : Illustration of the MONET task network structure. Each node V_{i}=\boldsymbol{\tau}_{i} represents a task, labelled by its current best solution \mathcal{A}[\boldsymbol{\tau}_{i}]\in\Theta . (a) Task network with the individual and social learning strategies that operate on it. (b) Task network and solution qualities at 500{,}000 evaluations ( 50\% of the total). Existing multi-task optimization algorithms face a fundamental scalability–structure tradeoff. Population-based multi-task evolutionary methods [ 28 , 49 ] maintain a separate population per task and quickly become impractical as the number of tasks grows into the thousands and beyond. Quality-diversity (QD) algorithms and MAP-Elites [ 14 , 36 ] in particular, bypass this by replacing per-task populations with a single structured archive. MAP-Elites has been extended to multi-task settings by Multi-Task MAP-Elites (MT-ME) [ 37 ] , which solves a fixed set of tasks via a globally shared archive, and Parametric-Task MAP-Elites (PT-ME) [ 4 ] , which extends this to continuous task spaces. Both have demonstrated strong performance on problems with thousands of tasks. However, these archive-based methods exhibit two intertwined limitations. First, the archive is a fixed discretized grid over the task or feature space: with c bins per dimension and a d -dimensional task space its size grows as \mathcal{O}(c^{d}) , so the representation becomes infeasible already for moderate d . Second, the archive is largely topologically flat : in MT-ME any solution can serve as a parent for any task. PT-ME partially addresses this through a local linear regression operator that exploits Delaunay triangulation [ 17 ] between tasks to calculate an adjacency matrix. Even so, this locality is confined to one of two variation paths, and the global Simulated Binary Crossover (SBX) operator [ 15 ] still draws parents without regard for task similarity. Neither method makes the task-space topology a first-class structural element that governs all recombination. We introduce MONET (Multi-Task Optimization over Networks of Tasks), a multi-task optimization algorithm that resolves both limitations by replacing the flat archive with an explicit graph over tasks (Figure 1 ): each node in the vertex set \mathcal{V} represents a task and stores its current best solution, while bidirectional edges in \mathcal{E} connect tasks to enable knowledge transfer (e.g., through crossover or direct copy). Unlike a grid, this representation does not depend on a discretization of the task space and scales as \mathcal{O}(|\mathcal{V}|\,k) , where k is the number of neighbors per node, remaining tractable as the task space dimensionality grows. Unlike a flat archive, the graph encodes topology directly: every node has a well-defined neighborhood that the search can exploit. The evolutionary process operates on this graph through two complementary mechanisms. Individual learning improves a solution in isolation through mutation, exploring the local fitness landscape of a single task. Social learning transfers information between neighboring nodes in variable ratios by selecting parent solutions from neighboring tasks and generating offspring through crossover. This separation is inspired by cultural evolution, where individual innovation and the social spread of useful innovations through a population jointly drive adaptation [ 41 , 51 ] . The balance between individual and social learning, the strategy to select a node (random or best fit), the size of the neighborhood, and the type of neighborhood (closest neighbors, distance-proportional sampling, or random selection) are key design choices that shape how information flows through the graph. A small neighborhood with strong social learning concentrates exploitation among very similar tasks, while a larger neighborhood or weaker social learning permits broader exploration. Understanding which of these choices matters and whether a single robust configuration exists in different problem domains is essential for the practical application of MONET. To this end, we conducted a hyperparameter study in four environments: archery, arm, and cartpole with 5,000 tasks each, and hexapod with 2,000 tasks. We show that MONET outperforms both MT-ME and PT-ME across all four environments, demonstrating that exploiting task-space structure through a network of task neighborhoods is an effective approach to multi-task optimization at scale. Our contributions are: 1. A unified formal taxonomy of MAP-Elites variants for multi-task optimization that exposes the structural modifications distinguishing each variant and motivates MONET (Section 2 ). 2. MONET, a graph-based multi-task optimizer that makes task-space neighborhoods an explicit element of recombination and combines localized social and individual learning (Section 3 ). 3. A systematic hyperparameter study across four task domains (archery, arm, cartpole, and hexapod) analyzing the effects of neighborhood type, neighborhood size, and the social/individual balance (Sections 4 and 5 ). 4. Empirical evidence that a single MONET configuration generalizes across all four domains and matches or outperforms MT-ME and PT-ME, showing task-space topology to be a valuable and underexploited source of information in multi-task optimization (Sections 5 and 6 ). 2 Related Works Evolutionary multi-task optimization has become a highly active area of research within the computational intelligence community [ 22 , 23 , 53 , 39 ] . To concretize the description, we specify the problem setting as follows. Consider a set of n tasks, each described by