An adaptive discretization algorithm for locally optimal experimental design with constraints
Jochen Schmid, Philipp Seufert, Jan Schwientek, Tobias Seidel, Karl-Heinz Küfer Fraunhofer Institute for Industrial Mathematics (ITWM), 67663 Kaiserslautern, Germany [email protected] · 2026
Read An adaptive discretization algorithm for locally optimal experimental design with constraints by Jochen Schmid, Philipp Seufert, Jan Schwientek, Tobias Seidel, Karl-Heinz Küfer Fraunhofer Institute for Industrial Mathematics (ITWM), 67663 Kaiserslautern, Germany [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-18511.txt.
Introduction
Schmid and four colleagues develop a stepwise method for locally optimal design under budget or output constraints. It slices on the fly: each round solves a sliced problem, then refines it with a rough epsilon-fitness breaker. With zero epsilon, it settles on an optimal design, and with plus epsilon, it ends for sure at an epsilon-optimal one. Versus current methods, theirs needs less effort because subtasks are smaller and need rough answers only in chosen rounds. Good settling shows on plant problems with time and yield constraints.
Catalog record
| CREATOR | Jochen Schmid, Philipp Seufert, Jan Schwientek, Tobias Seidel, Karl-Heinz Küfer Fraunhofer Institute for Industrial Mathematics (ITWM), 67663 Kaiserslautern, Germany [email protected] |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 149238 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.18511
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
An adaptive discretization algorithm for locally optimal experimental design with constraints Jochen Schmid, Philipp Seufert, Jan Schwientek, Tobias Seidel, Karl-Heinz Küfer Fraunhofer Institute for Industrial Mathematics (ITWM), 67663 Kaiserslautern, Germany [email protected] Abstract We develop a novel iterative algorithm for locally optimal experimental design under constraints, like budget or performance constraints. It is an adaptive discretization algorithm. In every iteration, a discretized version of the constrained-design problem is solved and then the discretization is adaptively refined by adding an approximate violator of a suitable sufficient ε \varepsilon -optimality condition for the current design. We prove that with ε = 0 \varepsilon=0 , our algorithm converges to an optimal design and that with ε > 0 \varepsilon>0 , our algorithm finitely terminates at an ε \varepsilon -optimal design. Compared to the existing algorithms on constrained experimental design, our algorithm comes with considerably less computational effort because the nonlinear subproblems in our algorithm have a smaller dimension and have to be solved only approximately and only in selected iterations (typically the last few). Additionally, our algorithm covers a considerably larger class of constraints. We demonstrate the good convergence properties of the algorithm on experimental design problems from chemical engineering that feature time and yield constraints. 1 Introduction A large variety of scientific and industrial applications nowadays rely heavily on mathematical models for prediction and optimization. In particular, this is true for chemical process engineering. It is crucial, of course, that the employed models are sufficiently precise. In order to obtain precise models, one typically performs experiments and collects data, to which the model is then fitted. Yet, performing experiments is usually time- and cost-intensive. It is therefore important to find experimental plans, or designs, which are maximally informative, that is, lead to the highest possible model precision. Coming up with such maximally informative experimental designs is the core task of unconstrained optimal experimental design, and there is a tremendous amount of literature on such unconstrained design problems. See the textbooks [ 42 , 35 , 4 , 19 , 34 ] and the survey paper [ 15 ] for a general overview of the theory, algorithms, and applications of unconstrained design and [ 17 , 47 , 5 , 41 , 8 , 49 , 50 , 48 , 21 , 40 ] for selected algorithms to solve unconstrained design problems. In mathematical terms, unconstrained locally optimal design problems can be cast in the form \displaystyle\min_{\xi\in\Xi(X)}\Psi_{0}(\xi). (1.1) In this optimization problem, X is the so-called design space, that is, the set of possible individual experiments, \Xi(X) is the set of approximate (as opposed to exact) experimental designs on X , that is, probability measures on the Borel sigma-algebra \mathcal{B}_{X} of X , and \Psi_{0}:\Xi(X)\to\mathbb{R}\cup\{\infty\} is the so-called design criterion, that is, a function that measures the inverse information content of the design \xi about the model parameters [ 19 , 34 , 35 , 40 , 42 ] . Virtually all relevant design criteria are convex functions of the design and therefore the unconstrained design problems ( 1.1 ) are infinite-dimensional convex optimization problems. In many applications, however, finding experimental designs that are just maximally informative is not enough. Instead, one often has to additionally ensure that the proposed experimental design satisfies certain budget or performance constraints. Some typical examples are that the time or material costs required for carrying out the experiments in the proposed experimental design have to be less than some given thresholds or that the purity of a substance produced in the experiments of the proposed experimental design is high enough such that it can be re-used after the experiment. Coming up with experimental designs that are maximally informative and at the same time respect the relevant constraints is the task of constrained optimal experimental design. As is demonstrated in [ 12 , 19 ] , the constraints in many applications are convex or even affine functions of the design and therefore a large variety of constrained locally optimal design problems can be cast in the form \displaystyle\min_{\xi\in\Xi(X)}\Psi_{0}(\xi)\quad\text{s.t.}\quad\Psi_{i}(\xi)\leq 0\text{ for all }i\in I_{\mathrm{ineq}}\text{ and }\Psi_{i}(\xi)=0\text{ for all }i\in I_{\mathrm{eq}} (1.2) with convex inequality constraint functions \Psi_{i}:\Xi(X)\to\mathbb{R}\cup\{\infty\} for i\in I_{\mathrm{ineq}} and affine equality constraint functions \Psi_{i}:\Xi(X)\to\mathbb{R} for i\in I_{\mathrm{eq}} . Compared to unconstrained design, however, constrained design problems ( 1.2 ) – and especially dedicated algorithms for their numerical solution – are much less studied in the literature. Specifically, there are some few papers proposing algorithms for constrained design problems ( 1.2 ) with relatively general, finitely many constraints [ 12 , 20 , 30 ] . Additionally, there are a few papers investigating constrained design problems ( 1.2 ) with so-called bound constraints [ 18 , 31 , 33 , 22 ] (that is, infinitely many affine inequality constraints of the specific form \xi(E)\leq\omega(E) for all E\in\mathcal{B}_{X} with a reference design \omega ) or with so-called marginal constraints [ 11 , 23 , 12 ] (that is, infinitely many affine equality constraints of the specific form \xi(X\times F)=\omega(F) for all F\in\mathcal{B}_{Y} , where Y is the set of variables that are not controllable in experiments and \omega is a reference design). In the present paper, we develop a novel algorithm to solve constrained design problems of the form ( 1.2 ) with finitely many constraints. It comes with considerably less computational effort and, at the same time, covers a considerably broader setting than the algorithms from [ 12 , 20 , 30 ] . Similarly to the unconstrained-design algorithms from [ 48 , 40 ] , the algorithm proposed here is an adaptive discretization algorithm. In every iteration, it proceeds in the following two steps. In the first step, a saddle point of a discretized version of the constrained design problem ( 1.2 ) is computed, namely, a saddle point (\xi^{k},\lambda^{k}) of the finite-dimensional convex optimization problem \displaystyle\min_{\xi\in\Xi(X^{k})}\Psi_{0}(\xi)\quad\text{s.t.}\quad\Psi_{i}(\xi)\leq 0\text{ for all }i\in I_{\mathrm{ineq}}\text{ and }\Psi_{i}(\xi)=0\text{ for all }i\in I_{\mathrm{eq}} (1.3) that arises from ( 1.2 ) by replacing the infinite design space X by a suitable discretization X^{k} . In the second step, the discretization X^{k} is adaptively refined to \displaystyle X^{k+1}=X^{k}\cup\{x^{k}\} (1.4) by adding one point, namely an appropriate approximate violator x^{k} of a suitable sufficient \varepsilon -optimality condition at (\xi^{k},\lambda^{k}) . In essence, this sufficient \varepsilon -optimality condition consists in a lower-bound condition on the sensitivity function \psi^{L} of the Lagrangian L of ( 1.2 ), namely \displaystyle\psi^{L}(\xi^{k},\lambda^{k},x)\geq-\varepsilon\qquad(x\in X). (1.5) In analogy to unconstrained design, this sensitivity function, or more precisely, the function x\mapsto\psi^{L}(\xi^{k},\lambda^{k},x) , is the integral kernel of the directional derivatives of L at (\xi^{k},\lambda^{k}) in the directions \eta-\xi^{k} . An approximate violator of ( 1.5 ), in turn, is a point x^{k}\in X with \displaystyle\psi^{L}(\xi^{k},\lambda^{k},x^{k})<-\varepsilon+\underline{\delta}_{k} (1.6) for some \underline{\delta}_{k}\geq 0 . In the first version of our algorithm – called the special algorithm in the following – the point x^{k} is computed as a \underline{\delta}_{k} -approximate solution of the sensitivity minimization problem \displaystyle\min_{x\in X}\psi^{L}(\xi^{k},\lambda^{k},x) (1.7) in every iteration. It should be noticed that this typically requires global-optimization techniques because x\mapsto\psi^{L}(\xi^{k},\lambda^{k},x) is non-convex and multimodal in most applications. In the second version of our algorithm – called the general algorithm in the following – we therefore restrict the computation of \underline{\delta}_{k} -approximate solutions of the