( 𝜽 l , 𝜽 u \bm{\theta}_{l},\bm{\theta}_{u} )-Parametric Multi-Task Optimization: Joint Search in Solution and Infinite Task Spaces

Tingyang Wei, Jiao Liu, Abhishek Gupta, Puay Siew Tan, and Yew-Soon Ong Β· 2025

Read ( 𝜽 l , 𝜽 u \bm{\theta}_{l},\bm{\theta}_{u} )-Parametric Multi-Task Optimization: Joint Search in Solution and Infinite Task Spaces by Tingyang Wei, Jiao Liu, Abhishek Gupta, Puay Siew Tan, and Yew-Soon Ong (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-08394.txt.

Introduction

Tingyang Wei and co-authors set out a new kind of task problem in a 2025 paper on search methods. Most work of this sort fixes a small set of tasks in advance. Here the tasks form a smooth, bounded space, so the set can in effect be endless, with each task set by a pair of bounds.

Their method works in two modes. Offline, it learns one model that links shared solutions to the goals of all tasks, and a second model that links tasks to good solutions. Online, those models let any new task in the space be solved at once, with no fresh search. Tests use both made-up problems and real cases, such as resetting robot controls when tasks change.

Catalog record

CREATORTingyang Wei, Jiao Liu, Abhishek Gupta, Puay Siew Tan, and Yew-Soon Ong
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE87 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-08394

Browse the full library Β· About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

( 𝜽 l , 𝜽 u \bm{\theta}_{l},\bm{\theta}_{u} )-Parametric Multi-Task Optimization: Joint Search in Solution and Infinite Task Spaces Tingyang Wei, Jiao Liu, Abhishek Gupta, Puay Siew Tan, and Yew-Soon Ong Abstract Multi-task optimization is typically characterized by a fixed and finite set of tasks. The present paper relaxes this condition by considering a non-fixed and potentially infinite set of optimization tasks defined in a parameterized, continuous and bounded task space. We refer to this unique problem setting as parametric multi-task optimization (PMTO). Assuming the bounds of the task parameters to be ( 𝜽 l \bm{\theta}_{l} , 𝜽 u \bm{\theta}_{u} ), a novel ( 𝜽 l \bm{\theta}_{l} , 𝜽 u \bm{\theta}_{u} )-PMTO algorithm is crafted to operate in two complementary modes. In an offline optimization mode, a joint search over solution and task spaces is carried out with the creation of two approximation models: (1) for mapping points in a unified solution space to the objective spaces of all tasks, which provably accelerates convergence by acting as a conduit for inter-task knowledge transfers, and (2) for probabilistically mapping tasks to their corresponding solutions, which facilitates evolutionary exploration of under-explored regions of the task space. In the online mode, the derived models enable direct optimization of any task within the bounds without the need to search from scratch. This outcome is validated on both synthetic test problems and practical case studies, with the significant real-world applicability of PMTO shown towards fast reconfiguration of robot controllers under changing task conditions. The potential of PMTO to vastly speedup the search for solutions to minimax optimization problems is also demonstrated through an example in robust engineering design. I Introduction Optimization tasks rarely exist in isolation. Multi-task optimization (MTO), first formulated in evolutionary computation by means of the multifactorial evolutionary algorithm [ 1 ] , has therefore emerged as a promising approach for solving problems simultaneously by leveraging shared information across related tasks [ 2 ] . This concept has been successfully applied in both evolutionary computation [ 1 ] and Bayesian optimization [ 3 ] , supported by knowledge transfer strategies such as solution-based transfer [ 4 , 5 ] and model-based transfer [ 3 , 6 , 7 ] . The applicability of these methods has been studied in a variety of domains, including robotics [ 8 ] , time series prediction [ 9 ] , vehicle shape design [ 10 ] , among many others [ 11 ] , achieving faster convergence under limited computational budgets. MTO is typically characterized by a fixed and finite set of optimization tasks. In this paper, we relax this paradigm by introducing Parametric Multi-Task Optimization (PMTO) as a framework that considers a non-fixed and potentially infinite set of optimization tasks within a parameterized, continuous, and bounded task space \Theta\subset\mathbb{R}^{D} . Each task in PMTO is defined by a unique vector \bm{\theta}\in(\bm{\theta}_{l},\bm{\theta}_{u}) , where \bm{\theta} represents the task parameters . Fig. 1 illustrates the difference between MTO and PMTO. As shown in Fig. 1(a), the objective functions in MTO are defined as independent mappings from a unified decision space to task-specific objective spaces. In contrast, the task parametrization directly influences the mapping from solutions to objectives in PMTO. This inclusion of a task space brings opportunities and challenges. PMTO benefits from leveraging information from both solution and task representations, enabling more effective inter-task relationship analysis and potentially more efficient cross-task optimization. However, continuous task parameters also imply an infinite task set, posing a challenge for algorithm development compared to the simpler case of a fixed task set in MTO. To address PMTO problems, this paper introduces a novel ( \bm{\theta}_{l},\bm{\theta}_{u} )-PMTO algorithm that incorporates a joint search over solutions and tasks. The algorithm operates in two complementary modes. In an offline optimization mode, a mapping f:\mathcal{X}\times\Theta\rightarrow\mathbb{R} from the solution space to the objective space is built by including task parameters as side information, thereby capturing correlations and facilitating the transfer of knowledge across tasks for provably faster convergence. ( \bm{\theta}_{l},\bm{\theta}_{u} )-PMTO also induces a probabilistic model \mathcal{M}:\Theta\rightarrow\mathcal{X} mapping tasks to their corresponding optimized solutions, with the inter-task relationships captured by the model helping support the evolutionary exploration of undersampled tasks. Through an iterative search process, the algorithm collects data on representative points that cover the task space. A well-calibrated task model \mathcal{M} obtained by the end of the offline ( \bm{\theta}_{l},\bm{\theta}_{u} )-PMTO run can then enable fast online identification of near-optimal solutions for any task in that space. The practical implications of PMTO are particularly profound in its online application to problems requiring fast adaptation in diverse and uncertain environments. Taking robotic control as an example [ 12 , 13 ] , standard MTO can be configured for multiple predefined morphologies of robots to achieve specific tasks including navigation, manipulation, and locomotion. However, real-world scenarios often involve unexpected changes, such as unforeseen damages or obstacles. These changes may cause the actual problem setup to deviate significantly from the predefined MTO set, leading to inferior results when obtained solutions are applied to unforeseen tasks. PMTO addresses this challenge seamlessly by pre-optimizing over a non-fixed and potentially infinite set of tasks, as shown in the top panel in Fig. 1(b). This enables diverse operating morphologies or damage conditions to be encoded as continuous task parameters, allowing the resulting task model to directly predict optimized solutions for any unseen problem setting, as illustrated in the bottom panel in Fig. 1(b). (a) Multi-task Optimization (b) Parametric Multi-task Optimization Fig. 1: Distinguishing multi-task optimization and parametric multi-task optimization. (a) In multi-task optimization, there typically exists a predefined and fixed set of tasks (3 in this example) whose objective functions map points from a unified solution space to the respective objective spaces. (b) In parametric multi-task optimization, continuous task parameters imply a potentially infinite set of tasks. During PMTO’s offline optimization mode, a task model \mathcal{M}:\Theta\rightarrow\mathcal{X} is built to actively evolve and optimize tasks with unknown optima. In the online mode, this task model is applied to directly predict optimized solutions for any new task without entailing additional evaluation costs. PMTO seeks to simultaneously explore solutions for a range of parameterized tasks, making it a versatile framework for addressing problem classes where such task spaces naturally occur. Consider minimax optimization in robust engineering design [ 14 ] as an example, where the goal is to identify designs that are worst-case optimal under random variations in the design parameters. This involves optimizing (minimizing) the worst (maximum) objective value to account for real-world variabilities. By re-imagining the space of random variations as the solution space ( \mathcal{X} ) and the original design parameters to form the task space ( \Theta ), the robust optimization problem can be recast in the new light of PMTO. Related mathematical programs, such as bilevel programming which is known to be amenable to MTO approaches [ 15 ] , can also be recast in this way. A case study demonstrating this novel application to minimax optimization is presented in Section VI-E. In this paper, we focus on expensive optimization problems in PMTO settings. Assessing the performance of derivative-free optimizers under stringent budget constraints is deemed especially meaningful, as real-world problems frequently entail costly function evaluation calls. The major contributions of this

Read the complete text