Search-Based Software Engineering in the Landscape of AI Foundation Models
Hassan Sartaj, Shaukat Ali · 2025
Read Search-Based Software Engineering in the Landscape of AI Foundation Models by Hassan Sartaj, Shaukat Ali (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-19625.txt.
Introduction
Hassan Sartaj, Shaukat Ali, Paolo Arcaini, and Andrea Arcuri chart how search-based software engineering meets AI foundation models in this 2025 roadmap paper. Their field applies search techniques borrowed from optimization to problems across the whole life of software, and it has been active for about twenty-five years. Foundation models such as large language models now raise the question of where the field goes next.
The authors sort the meeting point into three directions: using foundation models to strengthen search-based methods, using search methods to improve foundation models, and blending the two more deeply. For each direction they map what has been done, name the open challenges, and sketch research worth pursuing. They close with a forward look at chances to apply the combined approach in new domains. The paper is meant as a guide for researchers choosing where to work in this fast-moving overlap.
Catalog record
| CREATOR | Hassan Sartaj, Shaukat Ali |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 31 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-19625
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Search-Based Software Engineering in the Landscape of AI Foundation Models Hassan Sartaj, Shaukat Ali Abstract Search-based software engineering (SBSE), at the intersection of artificial intelligence (AI) and software engineering, has been an active area of research for about 25 years. It has been applied to solve numerous problems across the entire software engineering lifecycle and has demonstrated its versatility in multiple domains. With the recent advancements in AI, particularly the emergence of foundation models (FMs), the evolution of SBSE alongside FMs remains undetermined. In this window of opportunity, we propose a research roadmap that articulates the current landscape of SBSE in relation to foundation models (FMs), highlights open challenges, and outlines potential research directions for advancing SBSE through its interplay with FMs. This roadmap aims to establish a forward-thinking and innovative perspective for the future of SBSE in the era of FMs. K eywords AI \cdot Search-based Software Engineering \cdot Metaheuristic Optimization \cdot Foundation Models \cdot Large Language Models \cdot Vision Language Models \cdot Multimodal Models 1 Introduction Search-based software engineering (SBSE) has been a prominent field for nearly a quarter-century—approaching its silver jubilee—since it was first introduced by Harman and Jones 2001 in 2001. Over the years, it has rapidly evolved to address emerging and complex software engineering problems. It has been successfully applied throughout the software engineering (SE) lifecycle, including requirements engineering, software design, software development, software testing, deployment, and maintenance [ 19 ] . SBSE uses metaheuristic search optimization techniques to solve SE problems. This involves reformulating SE problems as metaheuristic search problems by creating solution representation, defining fitness functions, and selecting search operators [ 17 ] . The problem formulated in this way is then solved by applying search and optimization techniques to identify optimal solutions. These techniques include single-objective, multi-objective, and many-objective search algorithms, each designed for different problem types and levels of complexity [ 18 , 19 ] . Recently, artificial intelligence (AI) foundation models (FMs) have brought a major transformation, attracting widespread interest across research communities, academia, and industry [ 23 ] . These models are trained on vast amounts of data and are capable of performing a wide range of analytical tasks. For specific application domains, these models can be adapted using techniques such as fine-tuning and prompt engineering. Depending on their modalities, architecture, and application domains, FMs can be categorized as follows: Large Language Models (LLMs) like GPT for textual content; Vision Language Models (VLMs) like ResNet for image and video data; Speech and Audio Models (SAMs) like WaveNet for tasks related to speech recognition, synthesis, and audio analysis; and Multimodal Models (MMs) like CLIP that integrate multiple types of data, such as text and images, to enable content generation and comprehension across different modalities [ 44 ] . Their ability to generalize knowledge across multiple domains and adapt to diverse applications has enabled new AI-driven innovations, making them a focal point of exploration. As a result, researchers are actively exploring their potential, academic institutions are integrating them into curricula, and industries are leveraging them to enhance automation, decision-making, and user experiences. Considering rapid AI transformations driven by FMs, in this paper, we present a strategic roadmap exploring the synergistic interplay between SBSE and FMs in the context of future innovations and advancements. We structure this roadmap to explore four key dimensions, as illustrated in Figure 1 : (i) how FMs can be leveraged for SBSE design ( Section 2 ), (ii) how FMs can complement SBSE applied for SE problems ( Section 3 ), (iii) how well-studied SBSE practices can be adapted to FMs customized for particular SE activities ( Section 4 ), and (iv) how SBSE and FMs operate together and their synergistic potential ( Section 5 ). For each dimension, we review the current state of the art, discuss open challenges, and present opportunities with a forward-looking vision that outlines potential research directions. Figure 1: Research roadmap dimensions outlining the potential integration of SBSE with AI foundation models. 2 Foundation Models for Automating Search-based Software Engineering Design Recently, LLMs have attracted significant interest in evolutionary computation due to their ability to enhance various aspects [ 42 ] . An important step in this regard is to use LLMs as search operators for single and multi-objective optimization, such as language model crossover (LMX) for single-objective [ 28 ] and LLM-assisted offspring generation for multi-objective optimization [ 41 ] . Another line of work is evolutionary algorithm generation and improvement using LLMs. Notable works include using LLMs to generate swarm intelligence algorithms [ 31 ] , designing heuristic algorithms [ 24 ] , and evolving search algorithms [ 45 ] . In addition, some studies also focused on using LLMs to assist novice users in interpreting and comprehending evolutionary algorithm-generated solutions [ 25 , 38 ] . While LLM-based evolutionary computation has recently gained attention in the literature, its effectiveness within the SBSE context remains understudied. Moreover, given LLMs’ potential to enhance evolutionary computation, we anticipate that other FMs, such as VLMs and MMs, could further complement SBSE in solving complex SE problems. Considering this, we outline key research opportunities as follows: 2.1 Design of Fitness Functions for SBSE Problems Typically, a software engineer manually identifies and defines the fitness functions for SBSE problems based on their understanding of the domain. FMs have the potential to assist in automating the definition and subsequent implementation of fitness functions for a given SBSE problem. For example, in test case prioritization, FMs can help provide alternative fitness function options to guide search algorithms in prioritizing test cases, e.g., based on historical data on faults found by each test case and the coverage achieved. We foresee the following options to be investigated with FMs for designing fitness functions for SBSE problems: 1) FMs can be studied as a chatbot created for SBSE users, where they can build fitness functions by interacting with the chatbot and then implement their fitness functions themselves; 2) SBSE users can provide a set of requirements and ask an FM to implement the fitness function. In addition, VLMs, SAMs, and MMs can be used to derive fitness function suggestions from images, audio, and video data, for example, when generating test scenarios for autonomous driving systems (ADS). 2.2 Design of Search Operators In a recent study, Wu et al. 2024 categorized various LLM-based search operators, such as crossover and mutation, for single and multi-objective algorithms. However, the application of such operators in SBSE remains undetermined. Therefore, one potential research direction is to explore LLM-based search operators in the SBSE context. Another research direction is to define search operators using other FMs like VLMs and MMs to enable SBSE applications to emerging domains such as autonomous systems and quantum computing. For example, when dealing with ADS data in image format, VLM-based search operators can be employed to generate test scenarios. Similarly, for ADS data in audio or video formats, search operators based on SAMs and MMs can enhance test scenarios considering the mixed-mode nature of data. 2.3 Solution Encoding for SBSE Problems A fundamental step in SBSE is solution encoding for a particular SE problem. This varies from one problem nature to another and requires problem-domain knowledge. FMs with diverse capabilities can