Beyond Numerical Features: CNN-Driven Algorithm Selection via Contour Plots for Continuous Black-Box Optimization Accepted by the International Joint Conference on Neural Networks (IJCNN 2026), IEEE World Congress on Computational Intelligence (WCCI 2026). This is the authors’ accepted version. © 2026 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Yiliang Yuan 1 , Xiang Shi 2 , Mustafa Misir 2 · 2026
Read Beyond Numerical Features: CNN-Driven Algorithm Selection via Contour Plots for Continuous Black-Box Optimization Accepted by the International Joint Conference on Neural Networks (IJCNN 2026), IEEE World Congress on Computational Intelligence (WCCI 2026). This is the authors’ accepted version. © 2026 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. by Yiliang Yuan 1 , Xiang Shi 2 , Mustafa Misir 2 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-20797.txt.
Introduction
Yiliang Yuan, Xiang Shi, and Mustafa Misir pick solvers for black-box optimization from contour plots rather than number features alone. Prior work leans on landscape descriptors and learned codes, but this paper studies contour-map views of probed landscapes as a second view. A convolutional regressor takes several instance-specific contour views and predicts each solver's performance, enabling selection by predicted best value. On the BBOB 2009 protocol, their picks beat the single best solver and rival feature-based baselines.
Catalog record
| CREATOR | Yiliang Yuan 1 , Xiang Shi 2 , Mustafa Misir 2 |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 31313 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.20797
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Beyond Numerical Features: CNN-Driven Algorithm Selection via Contour Plots for Continuous Black-Box Optimization Accepted by the International Joint Conference on Neural Networks (IJCNN 2026), IEEE World Congress on Computational Intelligence (WCCI 2026). This is the authors’ accepted version. © 2026 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. Yiliang Yuan 1 , Xiang Shi 2 , Mustafa Misir 2 Abstract The present paper introduces a new representation-driven approach to per-instance algorithm selection, applied to black-box optimization, for automatically choosing the most promising solver from a fixed portfolio. Prior work in continuous optimization largely relies on numerical descriptors, including Exploratory Landscape Analysis features and learned embeddings such as Deep-ELA. This work studies a complementary representation: contour-map visualizations of probed landscapes. A CNN regressor takes multiple instance-specific contour views (stacked or encoded per view and aggregated) and predicts per-solver performance, enabling selection by the predicted best value. On the standard BBOB 2009 single-objective protocol, the resulting selectors significantly outperform the single best solver (SBS) and are competitive with feature-based baselines. A subsequent bi-objective evaluation under the DeepELA setting further indicates that the same image-based principle can be competitive when using windowed contour views. Overall, the results suggest that simple vision models can exploit spatial structure in probed landscapes for algorithm selection without handcrafted ELA features. I Introduction Continuous black-box optimization (BBO) is a common setting in science and engineering where only function evaluations are available and gradient information is inaccessible [ 13 ] . In such regimes, derivative-free solvers like CMA-ES variants offer strong performance, yet the No Free Lunch theorem implies that no single algorithm universally outperforms across all instances [ 21 ] . Consequently, the potential to improve performance by selecting a solver tailored to each problem instance rather than committing to a static choice, motivates Automated Algorithm Selection (AAS) [ 11 , 15 ] . AAS in continuous BBO typically relies on instance representations derived from probing evaluations. Exploratory Landscape Analysis (ELA) constructs numerical feature vectors intended to summarize properties such as curvature, separability, and modality [ 12 ] . Recent works replace handcrafted ELA features with learned embeddings, reducing feature correlation and improving robustness under the same benchmark protocol [ 19 ] . However, both types of studies rely on abstract numerical descriptors that may fail to capture the spatial structure evident in a visualized landscape. In parallel, CNN-based AAS has been explored in discrete domains where direct instance encodings are available [ 14 ] ; the continuous BBO setting differs in that a representation must be constructed through probing rather than read off from an explicit input. This paper studies a probing-based, image-centered representation for continuous BBO. This paper mainly investigates whether 2-D contour maps of probed landscapes contain useful signal for AAS in continuous BBO. Each problem instance is rendered as a grayscale contour map from objective evaluations on a fixed grid. Then, a CNN model is built to predict per-solver performance and to choose the best algorithm. Specifically, two variants are considered: a combined-view model that stacks multiple instance views as channels, and a separate-view model that encodes each view and aggregates the resulting features. Evaluation on BBOB [ 8 ] under the established protocol shows that our methods substantially improve over the single best solver and are competitive with ELA/Deep-ELA [ 19 ] baselines. A follow-up bi-objective study following [ 19 ] further examines the same principle. The main contributions are: 1. a probing-based AAS formulation for continuous BBO that uses contour-map renderings as instance representations and trains CNN selectors without handcrafted landscape features 2. an empirical study on single- and multi-objective optimization problems under standard AAS protocols, analyzing the effects of view aggregation and input resolution, and positioning contour-based selection relative to ELA and Deep-ELA baselines. The remainder of this article is structured as follows. Section II discusses optimization and AAS. Our proposed CNN-based AAS setup and the representation it utilizes are detailed in Section III . Section IV reports the empirical results. Finally, Section V summarizes the work, presents the key findings, and outlines future research directions. Problem Instance Set \mathbf{\mathcal{I}}=\{i_{1},i_{2},\dots,i_{n}\} Feature Extractor \mathbf{\mathcal{I}}\rightarrow\mathbf{Z} AAS Model \displaystyle\Phi:\mathbf{Z}\mapsto\hat{\mathcal{P}}(\mathcal{A},\mathcal{I}) Algorithm Portfolio \mathcal{A}=\{a_{1},a_{2},\dots,a_{m}\} a new problem instance i_{\text{new}} \Phi:\mathbf{Z}(i_{\text{new}})\xrightarrow{}a^{*} Fig. 1: A traditional performance prediction based Automated Algorithm Selection (AAS) process. \mathcal{I} denotes the instance set, \mathcal{A} the algorithm portfolio, and Z the feature extractor, yielding a predicted solver a^{*} . II Background II-A Optimization Problems An optimization problem requires determining values for decision variables that minimize or maximize an objective function, possibly subject to constraints [ 4 ] . Problems are commonly categorized by variable domain (discrete vs. continuous) and by the number of objectives (single- vs. multi-objective). Discrete optimization involves integer, binary, or categorical variables and typically yields combinatorial search spaces. Continuous optimization, in contrast, deals with real-valued variables and induces continuous objective landscapes. Single-objective optimization targets one scalar objective, whereas multi-objective optimization considers multiple, often conflicting, objectives and evaluates solutions via Pareto dominance and the Pareto front. II-B Automated Algorithm Selection for Optimization AAS largely aims to specify and apply the most suitable algorithm from a portfolio for solving a given problem instance. Typical AAS pipelines extract instance descriptors and combine them with empirical performance data, such as runtime or solution quality, to train predictive models that map instances to algorithms [ 1 ] , as depicted in Figure 1 . Beyond handcrafted numerical descriptors, representation learning has been explored for AAS. For example, applying CNNs to image-like encodings of combinatorial problem instances, constructed from instance descriptions, enables selection without manual feature engineering [ 14 ] . This paradigm is feature-free in the sense of avoiding explicit engineered descriptors, but it does not rely on black-box probing nor on visualizing fitness landscapes concerning solution spaces. In continuous BBO, AAS has been widely studied under benchmarked settings such as BBOB [ 8 ] . A dominant approach is Exploratory Landscape Analysis (ELA) , which computes numerical landscape features such as curvature, convexity, and level-set structure, from a limited sample of evaluations and uses these features to train AAS models [ 12 , 18 ] . More recently, Deep-ELA replaces handcrafted ELA vectors with embeddings learned by pretrained transformers, trained via self-supervision on a large portfolio of synthetic optimization problems, yielding lower-correlation and higher-signal-to-noise-ratio representations for downstream selection [ 19 ] . Within this line, the central design choice is the representation of an instance under a probing budget. The present work follows the same AAS setting but considers a complementary representation that preserves spatial structure by mapping probed evaluations to contour-plot images, enabling CNN-based selection from visual landscape information. III Methodology III-A Benchmarks and Performance Metrics This study uses two benchmarks, respectively for single-objective optimization (SOO) and multi-objective optimization (MOO), both mirroring the evaluation settings of Deep-ELA [ 19 ] . Single-objective optimization. The primary evaluation dataset is the widely used COCO/BBOB 2009 noiseless single-objective benchmark suite [ 8 ] . It consists of