Adaptive Design for Contour Estimation from Computer Experiments with Quantitative and Qualitative Inputs
Anita Shahrokhian, Xinwei Deng, C. Devon Lin, Pritam Ranjan, Li Xu · 2025
Read Adaptive Design for Contour Estimation from Computer Experiments with Quantitative and Qualitative Inputs by Anita Shahrokhian, Xinwei Deng, C. Devon Lin, Pritam Ranjan, Li Xu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-05498.txt.
Introduction
Anita Shahrokhian and co-authors present a 2025 statistics paper on computer experiments with two kinds of inputs. Some inputs are numbers that can slide along a scale. Others are choices, such as which material or method to use. The goal is to find the line where an output hits a set level.
The team offers a step-by-step design that picks new test points as results come in. Their rule splits the test space with bounds, then picks points near the target line with high doubt. Tests on sample problems and one real case gave more exact lines than older methods. The paper also gives the math behind the search. Readers get both a method and a proof.
Catalog record
| CREATOR | Anita Shahrokhian, Xinwei Deng, C. Devon Lin, Pritam Ranjan, Li Xu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 68 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-05498
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Adaptive Design for Contour Estimation from Computer Experiments with Quantitative and Qualitative Inputs Anita Shahrokhian, Xinwei Deng, C. Devon Lin, Pritam Ranjan, Li Xu Abstract Computer experiments with quantitative and qualitative inputs are widely used to study many scientific and engineering processes. Much of the existing work has focused on design and modeling or process optimization for such experiments. This paper proposes an adaptive design approach for estimating a contour from computer experiments with quantitative and qualitative inputs. A new criterion is introduced to search for the follow-up inputs. The key features of the proposed criterion are (a) the criterion yields adaptive search regions; and (b) it is region-based cooperative in that for each stage of the sequential procedure, the candidate points in the design space is divided into two disjoint groups using confidence bounds, and within each group, an acquisition function is used to select a candidate point. Among the two selected points, a point that is closer to the contour level with the higher uncertainty or that has higher uncertainty when the distance between its prediction and the contour level is within a threshold is chosen. The proposed approach provides empirically more accurate contour estimation than existing approaches as illustrated in numerical examples and a real application. Theoretical justification of the proposed adaptive search region is given. Keywords: Active learning, Emulator, Expected improvement, Gaussian process, Inverse problem, Sequential design, Uncertainty quantification, Upper confidence bound. 1 Introduction Computer simulators (models) have become fundamental and popular for studying complex physical systems Sacks et al. [1989] , Santner et al. [2003] . They are the mathematical models implemented in computer code. With the computer simulator at hands, computer experiments are conducted by varying the inputs and observing outputs. The scientific values of computer experiments have been demonstrated successfully in numerous applications such as fire evolution simulator, prosthesis device design, rocket booster simulation, and tidal power potential prediction Cooper and Stroup [1985] , Chang and Lin [2001] , Gramacy and Lee [2008] , MacDonald et al. [2015] . In some applications, computer experiments are computationally expensive as it may take several hours or days to get a single output. One common approach to address such an issue is to build statistical emulators (surrogate) to approximate computer simulators so that emulators can be used for further statistical analysis such as optimization Jones et al. [1998] , contour estimation Ranjan et al. [2008] , Bichon et al. [2008] , calibration Kennedy and O’Hagan [2001] , sensitivity analysis Oakley and O’Hagan [2004] , and so on. Computer experiments with quantitative and qualitative inputs occur frequently in applications in science and engineering. For instance, Rawlinson et al. [2006] studied the design of a knee prosthesis with qualitative inputs on prosthesis design and force pattern. Qian et al. [2008] considered a computer simulator for determining several air characteristics for a data storage area in which the input location of an air diffuser unit, the location of the hot air return vent, and the type of power unit are qualitative. For such computer experiments, various modeling approaches have been proposed to take into account the effects of qualitative inputs. The most recent efforts are the latent variable based Gaussian process models Zhang et al. [2020b] and the easy-to-interpret Gaussian process models Xiao et al. [2021] . To choose inputs for performing computer experiments with quantitative and qualitative inputs, sliced Latin hypercubes, and marginally (or doubly) coupled designs have been introduced Qian [2012] , He et al. [2017] , He et al. [2019] , Yang et al. [2023] . Although there is abundant work for the design and modeling of computer experiments with both types of inputs, little has been done for the analysis of such computer experiments. To the best of our knowledge, the only exceptions are for the problem of global optimization Zhang et al. [2020a] , Cai et al. [2024] . In this article, we consider the problem of contour (also known as level or excursion set) estimation for computer experiments with quantitative and qualitative inputs. The goal is to search for the inputs that yield a contour level of interest. The designs for computer experiments can be space-filling designs or model-dependent designs. Space-filling designs are chosen such that the design points are spread out the design space as uniformly as possible, regardless of the emulators chosen Lin and Tang [2015] . Thus, they are model independent. Model-dependent designs can be one-shot or adaptive designs. Space-filling or one-shot model-dependent designs can be inefficient because they do not take the goal of the analysis into account. Using adaptive designs, also known as active learning, is a practical way to overcome this issue by judiciously choosing inputs that help achieve the goal of the analysis with fewer design points. Adaptive designs use an initial design and fit the model for the data at hands and repeat the process of input selection and updating the model after each selection until they meet some stopping criterion. In adaptive designs, the essential issue is how to choose the follow-up inputs based on the current data collected. In the literature, various criteria such as expected improvements (EI), upper confidence bound, stepwise uncertainty reduction, entropy search and knowledge gradient were introduced for different goals of the analysis Jones et al. [1998] , Ranjan et al. [2008] , Picheny et al. [2010] , Srinivas et al. [2012] , Henrández-Lobato et al. [2014] , Frazier et al. [2009] , Bect et al. [2012] , Chevalier et al. [2014] , Marques et al. [2018] , Cole et al. [2023] . When the goal of the analysis is contour estimation, the issue of how to choose inputs adaptively for computer experiments with both quantitative and qualitative inputs has not been addressed in the literature. Although existing criteria for contour estimation from computer experiments with only quantitative inputs can be used for those with mixed inputs, their performance may be poor as we will demonstrate in the numerical examples. We propose an adaptive design using confidence bounds in the contour estimation problem by grouping the candidate points and using the proper criterion for each subgroup to solve the problem for any contour level of interest. The proposed method selects the candidate points in each subgroup using a certain criterion, and between the two selected points, we choose the next candidate point such that its prediction is closer to the contour level of interest and has the larger predictive variance, or it has a larger predictive variance when the difference between its prediction and the contour level is smaller than some threshold. The rest of the paper is organized as follows. Section 2 provides the necessary background on Gaussian processes (GP) models for computer experiments with both types of inputs, and reviews different acquisition functions used in models with only quantitative inputs. Section 3 presents the proposed adaptive design approach for contour estimation for computer experiments with both types of inputs. The theoretical justifications of adaptive search regions are also given. We illustrate the efficiency of the proposed method and compare it with existing methods through the simulation study in Section 4. Section 5 applies the proposed approach in a real application in high performance computing. Section 6 concludes