Optimistic vs Pessimistic Uncertainty Model Unfalsification
Jannes Hühnerbein, Jad Wehbeh, Eric C. Kerrigan · 2025
Read Optimistic vs Pessimistic Uncertainty Model Unfalsification by Jannes Hühnerbein, Jad Wehbeh, Eric C. Kerrigan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-20669.txt.
Introduction
Jannes Hühnerbein, Jad Wehbeh, and Eric Kerrigan rethink how engineers pin down uncertainty in system models in a 2025 paper. The true size and shape of a model's uncertainty can never be fully known from data. Instead of claiming to identify it, the authors ask what concrete statements the data can support, a stance they call unfalsification.
Two viewpoints are developed. The optimistic one finds the smallest uncertainties that could still explain the recorded input output data. The pessimistic one finds the largest uncertainties the data cannot rule out, a harder problem they solve with an iterative algorithm. The two turn out to be mathematical duals of each other. Tests use a simple uncertain model fed data from a simulated nonlinear system.
Catalog record
| CREATOR | Jannes Hühnerbein, Jad Wehbeh, Eric C. Kerrigan |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 33 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-20669
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Optimistic vs Pessimistic Uncertainty Model Unfalsification Jannes Hühnerbein, Jad Wehbeh, Eric C. Kerrigan Abstract We present a novel, input-output data-driven approach to uncertainty model identification. As the true bounds and distributions of system uncertainties ultimately remain unknown, we depart from the goal of identifying the uncertainty model and instead look for minimal concrete statements that can be made based on an uncertain system model and available input-output data. We refer to this as unfalsifying an uncertainty model. Two different unfalsification approaches are taken. The optimistic approach determines the smallest uncertainties that could explain the given data, while the pessimistic approach finds the largest possible uncertainties suggested by the data. The pessimistic problem is revealed to be a semi-infinite program, which is solved using the local reduction algorithm. It is also shown that the optimistic and pessimistic approaches to uncertainty model unfalsification are mathematical duals. Finally, both approaches are tested using an uncertain linear model with data from a simulated nonlinear system. I Introduction I-A Motivation In classical control theory, controllers are initially designed for nominal systems without considering uncertainties or disturbances. The problem of controller synthesis for nominal, undisturbed systems is a well-studied one. In many cases, a nominal controller features sufficient stability margins, such that it works even in the presence of uncertainties and disturbances. However, if robustness is a more critical concern, the controller is modified based on an uncertainty model to ensure stability and, optionally, constraint satisfaction despite worst-case disturbances. Therefore, it is of high importance to have an understanding of disturbances and uncertainties that can arise in a given system. Data-driven approaches are commonly used to identify at least an approximate uncertainty model. However, as the true nature of uncertainties ultimately remains unknown, the notion of identifying an uncertainty model is misleading. No amount of data, no matter how large, is able to fully reflect system uncertainty. If that were the case, it would not be uncertain. For this reason, we look for ways to unfalsify an uncertainty model instead. I-B Related Work The term unfalsification originates from Logic of Scientific Discovery by Austrian-British philosopher Karl Popper [ 1 ] . In his work, Popper calls for falsifiability as a necessary property for any acceptable scientific hypothesis. Popper’s work can be understood as a proposal to solve David Hume’s Problem of Induction [ 2 ] by postulating that scientific theories are only acceptable if they are falsifiable, i. e. if they can be disproven. All acceptable scientific hypotheses that have not yet been falsified are not validated , but merely unfalsified . In the context of this paper, model unfalsification refers to the process of systematically challenging mathematical models of dynamical systems based on available data to gain confidence in their validity. I-B 1 Model Unfalsification for Dynamical Systems Modeling The problem of (uncertainty) model (un-)falsification was first formalized for dynamical systems and control by [ 3 ] and [ 4 ] . In the following, we briefly summarize their work. Optimal vs Feasible Parameters As [ 5 ] put it, model unfalsification is basically identical to classical system identification, but with the goal of feasibility instead of optimality . It is important to note that system identification problems are not always set up in a way that enables the model to recreate the given data exactly. This distinction separates system identification from model unfalsification. System identification strives for optimality in some sense, whereas unfalsification only requires feasibility , but is more strict regarding the exact reproducibility of the data. Extensions of the Idea The previous paragraphs make it seem like model unfalsification is always a binary problem, where a model is either falsified or unfalsified. While this is true in principle, the idea can be extended to also include secondary conditions and objectives. One way of doing so is to see model unfalsification as a special case of system identification that requires the model to be exact and in some sense optimal [ 6 , 7 , 8 ] . I-B 2 Recent Contributions to the Subject The majority of publications on model unfalsification date from the late 1990s and early 2000s. It was during this period that the concept, previously regarded as rather philosophical, was formally established in control and optimization theory. Since then, fewer publications have specifically mentioned the problem, which served as motivation for this paper. Nonetheless, a few noteworthy papers from recent years are to be discussed here. A direct application of Popper’s original philosophy to the example of numerical building modeling is given by [ 9 ] and the authors offer a pointed critique of the way data is currently used to inform mathematical models. The work of [ 10 ] is more directly applied to optimal control and is in some ways similar to what is proposed in this paper. They use an unfalsification approach to obtain optimal estimates for unknown parameters of an autonomous underwater vehicle. However, they do not formulate or solve the uncertainty model unfalsification problem as an optimization problem. A very similar approach is taken by [ 11 ] , however, they solely rely on output feedback and noisy (input-output) data. While [ 11 ] solve this problem via optimization, they do not consider the importance of exact feasibility of the problem, and instead propose the use of a standard least-squares system identification approach. Various data-enabled predictive control techniques, such as DeePC [ 12 , 13 , 14 , 15 ] , address this issue, but often rely on input-state data and sometimes neglect measurement noise. I-B 3 Semi-Infinite Programming & Local Reduction Semi-infinite programs (SIPs) that are also considered in this paper consist of a finite number of optimization variables and an infinite number of constraints; hence the name semi-infinite . The theory of SIP is described in more depth by [ 16 ] , who also provides applied examples with basic solution approaches. A more general solution approach to SIPs is given by [ 17 ] . They introduce the local reduction algorithm as a sequential approach of solving SIPs using subsets of constraints with finite cardinality. This idea was extended by [ 18 ] to a scenario-based approach that aims at finding worst-case scenarios that reduce the infinite number of constraints in the problem to a finite set of constraints that govern the “worst case”. These kinds of scenario-based approaches are not entirely new and were previously presented in the context of probabilistic solution techniques for robust controller design [ 19 , 20 ] . When solving SIPs, however, new scenarios are not generated at random but in a strategic way, such that the algorithm terminates at a local solution. This is referred to as automatic scenario generation by [ 18 ] . Another notable contribution to local reduction is made by [ 21 ] by accounting for existence constraints and non-unique optimization variable trajectories. I-C Contributions The main contribution of this paper is a novel optimization-based framework for data-driven uncertainty model unfalsification. Two formulations of this problem — optimistic and pessimistic — are proposed, each providing a different perspective on disturbances and uncertainties, recognizing that uncertainty models can never fully capture true system uncertainty. The framework also critiques conventional methods that