LLM Driven Design of Continuous Optimization Problems with Controllable High-level Properties

Urban Skvorc, Niki van Stein, Moritz Seiler, Britta Grimme, Thomas Bäck, Heike Trautmann · 2026

Read LLM Driven Design of Continuous Optimization Problems with Controllable High-level Properties by Urban Skvorc, Niki van Stein, Moritz Seiler, Britta Grimme, Thomas Bäck, Heike Trautmann (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-18846.txt.

Introduction

Urban Skvorc and six colleagues ask if language models can design fresh test tasks for search tools that hunt best plans. A good test set needs tasks of many forms, so a tool can't ace it by one trick. The main set in use has a thin range of forms. That thin range can hide a tool's weak spots. The team put models in a loop that breeds new tasks gen by gen.

Each new task must hold set traits of its form: how rough its land runs, how many peaks it has, and where they sit. The loop grades each task on those traits and keeps the ones that fit. A bred set could be both wide in form and strict in traits. Such a set would make tool grades far more hard to game. It would also let teams build tests for the land forms they care about.

Catalog record

CREATORUrban Skvorc, Niki van Stein, Moritz Seiler, Britta Grimme, Thomas Bäck, Heike Trautmann
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE37 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-18846

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

LLM Driven Design of Continuous Optimization Problems with Controllable High-level Properties Urban Skvorc, Niki van Stein, Moritz Seiler, Britta Grimme, Thomas Bäck, Heike Trautmann Abstract Benchmarking in continuous black-box optimisation is hindered by the limited structural diversity of existing test suites such as BBOB. We explore whether large language models embedded in an evolutionary loop can be used to design optimisation problems with clearly defined high-level landscape characteristics. Using the LLaMEA framework, we guide an LLM to generate problem code from natural-language descriptions of target properties, including multimodality, separability, basin-size homogeneity, search-space homogeneity and global–local optima contrast. Inside the loop we score candidates through ELA-based property predictors. We introduce an ELA-space fitness-sharing mechanism that increases population diversity and steers the generator away from redundant landscapes. A complementary basin-of-attraction analysis, statistical testing and visual inspection, verifies that many of the generated functions indeed exhibit the intended structural traits. In addition, a t t -SNE embedding shows that they expand the BBOB instance space rather than forming an unrelated cluster. The resulting library provides a broad, interpretable, and reproducible set of benchmark problems for landscape analysis and downstream tasks such as automated algorithm selection. 1 Introduction The performance of optimization algorithms strongly depends on the problems being solved; no single algorithm performs best across all instances. A promising direction to address this challenge is Automated Algorithm Selection (AAS), which trains models to automatically select the best-performing algorithm for a given problem instance. Machine-learning-based AAS approaches have shown strong potential [ 9 ] , but they are constrained by the limited diversity of existing benchmark problems. As highlighted by Cenikj et al. [ 3 ] , current benchmark suites often cover only narrow regions of the problem space, hindering generalization and making the evaluation of algorithm selectors highly dependent on how training and testing instances are split. One way to mitigate this limitation is the automatic generation of optimization problems to populate under-represented regions of the problem space. Several approaches have been proposed, including affine combinations of existing problems [ 5 , 27 , 28 ] and randomly generated tree-like functions [ 22 , 19 ] . However, affine combinations provide only limited novelty, while random function generators are difficult to control certain high-level landscape properties. In this paper, we present an initial analysis of using Large Language Models (LLMs) for optimization problem generation. Specifically, we investigate whether an LLM can create problems that are both novel and interpretable by enforcing or verifying high-level properties such as multimodality. In recent years, LLMs have demonstrated strong performance in text generation and Retrieval-Augmented Generation (RAG) [ 6 ] . Within the field of optimization, LLMs have also been successfully applied to algorithm generation. One example is the Large Language Model–driven Evolutionary Algorithm (LLaMEA) framework [ 20 ] . By contrast, the use of LLMs for generating optimization problems themselves has received relatively little attention, with the work by Yuhiro et al. [ 16 ] being, to the best of our knowledge, the only prior study. The goal of this work is to assess whether LLaMEA can also serve as a viable tool for generating interpretable optimization problems. In particular, we study the ability of a LLaMEA-based generator to produce problems with predefined high-level characteristics described in natural language. We examine five high-level properties [ 14 ] that have previously been used to characterize benchmark problems: multimodality, search-space homogeneity, basin-size homogeneity, separability, and global-to-local optima contrast . The contributions of this paper can be summarized as follows: First, we present the first use case of LLM-driven evolutionary computation for the automatic synthesis of optimization problems with pre-specified high-level properties. Second, we extend the LLaMEA framework with an adaptive fitness sharing mechanism that promotes diversity among generated problems. Third, we propose verification techniques to evaluate whether problems exhibit the intended properties and discuss the strengths and limitations of the approach. Finally, we provide an extensive library of verified optimization problems with specific high-level properties, made available as an easy-to-use Python library. The remainder of this paper is structured as follows: Section 2 provides a brief overview of prior work, Section 3 describes the proposed methodology, including a description of the LLaMEA framework and its adaption for problem generation. Section 4 reports preliminary experiments conducted to fine-tune the LLaMEA framework prior to problem generation. Section 5 presents the experimental verification of whether the generated problems exhibit the desired properties. Section 6 concludes the paper. All the code for used for the experiments in this paper is available in our repository [ 24 ] . 2 Prior work Several studies have explored the automatic generation of optimization problems. In the combinatorial domain, one such example is the work by Ullrich et al [ 23 ] ). In the continuous domain, a lot of research builds upon the well-known BBOB problem set [ 8 ] . Muñoz et al. [ 15 ] aimed to generate new problems with landscape feature values not yet represented in BBOB, whereas Vermetten et al. [ 28 ] combined two or more BBOB functions through affine transformations to create new instances. Further studies have proposed tree-based problem generators independent of the BBOB suite, such as Tian et al. [ 21 ] and Seiler et al. [ 19 ] , while Wang et al. [ 29 ] applied deep-learning models for this purpose. The work most closely related to ours is that of Muñoz et al. [ 15 ] , who generated new continuous benchmark functions by evolving mathematical function forms whose Exploratory Landscape Analysis (ELA) [ 13 ] features match selected target vectors. Starting from the BBOB set, they computed ELA features to map each instance into a high-dimensional instance space , where problems with similar feature values are located close to one another. They then projected this space into two dimensions to visualize coverage by existing benchmarks and used genetic programming to create new functions whose ELA features matched selected target points, thus filling previously unexplored regions. This provides precise numeric control of feature combinations but requires expert knowledge to select suitable targets. In contrast, the LLaMEA approach proposed in this paper offers more interpretable control by linking groups of ELA features to qualitative, so-called high-level, landscape properties (e.g., multimodality, separability, basin - size homogeneity). The LLM then generates new problem definitions guided by these properties, producing diverse and verifiable landscapes described in human - readable terms rather than numerical feature goals. Our generator is based on the LLaMEA framework [ 20 ] , which integrates evolutionary computation with the generative capabilities of large language models (LLMs). LLaMEA enables an automated and interpretable approach to algorithm design. Unlike traditional evolutionary algorithms [ 2 ] , which evolve numerical representations such as parameter vectors, operator weights, or network topologies, LLaMEA evolves executable algorithmic code. Each individual in the population represents a candidate algorithm expressed in Python, originally for solving black-box optimization problems but also applied to combinatorial problems and other real-world tasks [ 25 , 31 ] . The role of the LLM is to instantiate and refine these candidates by responding to natural-language prompts that encode evolutionary operators such as mutation and recombination. Each newly generated (mutated) algorithm is executed and evaluated on a

Read the complete text