Does Dimensionality Reduction via Random Projections Preserve Landscape Features? DOI: 10.1145/nnnnnnn.nnnnnnn ISBN: 978-x-xxxx-xxxx-x/YY/MM Conference: The Genetic and Evolutionary Computation Conference 2026; July 13–17, 2026; San José, Costa Rica CCS: Computing methodologies Continuous space search CCS: Computing methodologies Dimensionality reduction

Iván Olarte Rodríguez, Anja Jankovic, Thomas Bäck, Elena Raponi · 2026

Read Does Dimensionality Reduction via Random Projections Preserve Landscape Features? DOI: 10.1145/nnnnnnn.nnnnnnn ISBN: 978-x-xxxx-xxxx-x/YY/MM Conference: The Genetic and Evolutionary Computation Conference 2026; July 13–17, 2026; San José, Costa Rica CCS: Computing methodologies Continuous space search CCS: Computing methodologies Dimensionality reduction by Iván Olarte Rodríguez, Anja Jankovic, Thomas Bäck, Elena Raponi (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-13230.txt.

Introduction

Olarte Rodríguez, Jankovic, Bäck, and Raponi ask whether random projections preserve landscape features used to describe black-box tuning problems. Working out exploratory landscape analysis features in reduced spaces and comparing them with original values. Across sample budgets and reduced sizes, they find linear random maps often distort the shape and topological structure that matters. A small subset of features stays fairly stable, but most prove highly touchy, and seeming toughness may reflect projection quirks rather than true traits.

Catalog record

CREATORIván Olarte Rodríguez, Anja Jankovic, Thomas Bäck, Elena Raponi
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE42397
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.13230

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Does Dimensionality Reduction via Random Projections Preserve Landscape Features? DOI: 10.1145/nnnnnnn.nnnnnnn ISBN: 978-x-xxxx-xxxx-x/YY/MM Conference: The Genetic and Evolutionary Computation Conference 2026; July 13–17, 2026; San José, Costa Rica CCS: Computing methodologies Continuous space search CCS: Computing methodologies Dimensionality reduction Iván Olarte Rodríguez, Anja Jankovic, Thomas Bäck, Elena Raponi Abstract . Exploratory Landscape Analysis (ELA) provides numerical features for characterizing black-box optimization problems. In high-dimensional settings, however, ELA suffers from sparsity effects, high estimator variance, and the prohibitive cost of computing several feature classes. Dimensionality reduction has therefore been proposed as a way to make ELA applicable in such settings, but it remains unclear whether features computed in reduced spaces still reflect intrinsic properties of the original landscape. In this work, we investigate the robustness of ELA features under dimensionality reduction via Random Gaussian Embeddings (RGEs). Starting from the same sampled points and objective values, we compute ELA features in projected spaces and compare them to those obtained in the original search space across multiple sample budgets and embedding dimensions. Our results show that linear random projections often alter the geometric and topological structure relevant to ELA, yielding feature values that are no longer representative of the original problem. While a small subset of features remains comparatively stable, most are highly sensitive to the embedding. Moreover, robustness under projection does not necessarily imply informativeness, as apparently robust features may still reflect projection-induced artifacts rather than intrinsic landscape characteristics. 1. Introduction Identifying informative and reliable problem characteristics is a key requirement for a wide range of downstream tasks in numerical optimization, including landscape similarity analysis, problem classification, and automated algorithm configuration and selection ( Kerschke et al. 2019 ; Kerschke and Trautmann 2019a ) . In recent years, Exploratory Landscape Analysis (ELA) ( Mersmann et al. 2011 ) has emerged as a prominent data-driven framework for this purpose. By mapping a set of sampled points and their corresponding objective values to a numerical feature representation, ELA enables the characterization of black-box optimization problems without requiring explicit access to their analytical structure. Despite their demonstrated effectiveness, ELA-based pipelines have limited applicability in expensive, large-scale optimization settings. A key limitation is that many ELA features require relatively large sample sizes to yield stable and informative estimates ( Muñoz et al. 2022 ) , which is often infeasible when function evaluations are costly. In addition, feature estimates can exhibit considerable stochastic variability, with values differing substantially across samples of identical size ( Renau et al. 2020 ) . Furthermore, several widely used ELA features have been shown to be highly correlated with one another and to display limited variation across problem classes, thereby diminishing their discriminative capability ( Renau et al. 2019 ) . An additional and often overlooked limitation of ELA concerns its scalability with respect to problem dimensionality. As pointed out by Tanabe 2021 , most existing ELA studies focus on low- to moderate-dimensional problems (particularly for D\leq 20 ). However, many real-world optimization problems are inherently high-dimensional, and the computational cost of feature computation can grow rapidly with dimension. In particular, feature sets such as meta-model and level set become prohibitively expensive to compute in large dimensions due to repeated classifier training or regression model fitting. Similarly, features based on cell mappings ( Kerschke et al. 2014 ) suffer from exponential growth in complexity, rendering them impractical beyond very small dimensions (typically D\leq 5 ). As a result, several feature classes that have proven important in low-dimensional settings cannot be applied to large-scale problems in practice. Previous studies have shown that the limited scalability of ELA-based approaches substantially restricts its applicability to large-scale black-box optimization problems ( Tanabe 2021 ; Renau et al. 2019 ) . To mitigate this limitation, dimensionality reduction has been proposed as a viable strategy for extending ELA to high-dimensional settings ( Tanabe 2021 ) . Rather than computing landscape features directly in the original search space, this approach projects sampled points into a lower-dimensional representation and performs ELA feature extraction in the reduced space. Tanabe 2021 addressed the scalability of computationally expensive ELA features via dimensionality reduction, focusing on cell mapping, level set, and meta-model features. Building on a PCA-inspired approach proposed for high-dimensional Bayesian optimization ( Raponi et al. 2020 ; Antonov et al. 2022 ) , they showed that combining features computed in a reduced space with inexpensive features can improve classification performance when the original features are intractable in high dimensions. Despite these results, two questions remain open. First, the effect of dimensionality reduction on other ELA feature sets is not well understood. Second, it is unclear whether features computed in reduced spaces reflect intrinsic properties of the objective function or are influenced by distortions introduced by the transformation. In this work, we position ourselves in the setting where we are already given a sampled set of points of small size relative to the problem dimension, and we need to characterize the objective landscape based on this limited information. We aim to study how projection-based dimensionality reduction affects the characterization of the objective landscapes through ELA. Specifically, we use Random Gaussian Embeddings (RGEs) ( Dasgupta 1999 ) as dimensionality reduction technique, which embeds points into lower-dimensional manifolds independently of the sampled data. Unlike PCA-based approaches ( Tanabe 2021 ) , RGEs define random linear projections that do not depend on the function-instance pair, enabling us to analyze how multiple projections affect sampled points and the resulting ELA features. Our contributions We systematically investigate the impact of RGEs on ELA features, using the noiseless Black-Box Optimization Benchmarking (BBOB) problem collection from the COmparing Continuous Optimizers (COCO) platform ( Hansen et al. 2021 ) as testbed. ELA features are computed in both the original search space and in the corresponding reduced spaces across multiple problem instances. Specifically, our contributions are: • We apply RGEs as a dimensionality reduction mechanism in the ELA setting , enabling the extraction of multiple low-dimensional representations from the same original problem instance and sample set. • We systematically study ELA feature distortion under dimensionality reduction considering both limited ( 10\cdot D ) and abundant ( 100\cdot D ) evaluation budgets, to reflect realistic data regimes in black-box optimization. • We analyze the distributional variability induced by the embedding procedure , highlighting which ELA features are stable versus sensitive, and providing insights into the preservation of landscape characterization when using random projections. Our analysis identifies a subset of ELA features that remains robust under dimensionality reduction for a fixed sample size, providing guidance for constructing feature sets resilient to perturbations and outliers. However, robustness alone does not ensure informativeness, as some features preserve or display small changes due to limited sensitivity to underlying landscape variations. Furthermore, dimensionality reduction may alter how landscape properties are reflected in ELA features, raising questions about whether observed preservation corresponds to intrinsic problem characteristics. These findings suggest that relying on such features could adversely affect downstream applications, even though these effects are not directly evaluated in this study. Code Availability https://github.com/olarterodriguezivan/Dimensionality-Reduction-and-Projections Supplementary Material Supplementary material is available as a separate file. 2. Preliminaries In Section 2.1 , we provide preliminaries on ELA and motivate our selection of landscape features, while Section 2.2 introduces RGEs as a dimensionality

Read the complete text