Moral Hazard in LTI Dynamics: A Hypothesis Testing Approach

Jaewon Jeong, Pan-Yang Su, S. Shankar Sastry, Anil Aswani · 2026

Read Moral Hazard in LTI Dynamics: A Hypothesis Testing Approach by Jaewon Jeong, Pan-Yang Su, S. Shankar Sastry, Anil Aswani (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-00158.txt.

Introduction

Jaewon Jeong, Pan-Yang Su, S. Shankar Sastry, and Anil Aswani study how to pay an agent whose effort cannot be watched. Their setting is a linear control system with noise, where an agent picks one of two controllers. One controller costs the agent more to run than the other.

The team designs a payment rule that makes the agent choose the controller that best serves the system's goals. They frame the design as a constrained optimization problem under risk aversion. For a payment made at a set time, the best rule sets the amount by a likelihood ratio test, a standard statistical check. They show the scheme at work on power grid frequency control and on body weight programs.

Catalog record

CREATORJaewon Jeong, Pan-Yang Su, S. Shankar Sastry, Anil Aswani
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE42 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.00158

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Moral Hazard in LTI Dynamics: A Hypothesis Testing Approach Jaewon Jeong, Pan-Yang Su, S. Shankar Sastry, Anil Aswani Abstract Many incentive design problems must contend with information asymmetries due to non-observation of efficiency (adverse selection) or non-observation of effort (moral hazard). And although a growing body of literature considers incentive design in control systems, the problem of designing incentives for control systems under information asymmetries has been less well-studied. This paper considers a model of moral hazard within control systems. In our model, the control system is described by an (affine) linear time-invariant (LTI) system with process noise. There is an agent who gets to choose (from between two choices) a linear state-feedback controller to apply to the LTI system, with one of the state-feedback controllers having a higher quadratic cost on the control inputs than the other. Our goal is to design a payment scheme that incentivizes the agent to choose the state-feedback controller that minimizes a quadratic cost on system states plus the time-discounted payment amount, subject to the understanding that the agent bears the control cost while being risk-averse with respect to their time-discounted payment. We formulate the problem as a constrained optimization, and prove that for a payment given after a fixed (but optimizable) time horizon the optimal payment scheme chooses the payment amount using a likelihood ratio hypothesis test. We numerically demonstrate our results by applying the derived optimal payment scheme to two examples: load frequency control (LFC) in power systems and wellness interventions for body weight loss. I INTRODUCTION Economic aspects of control systems are increasingly important given the growth of applications at the intersection of economics and control, like power [ 20 , 9 ] or transportation [ 19 , 13 ] systems. As such, an active body of literature within controls considers various problems of incentive design, in which a principal would like to design a scheme for payments (or some similar motivating force) to an agent to encourage the agent to take actions that are favorable for the principal. Though incentive design in economics focuses on asymmetries of information between participants [ 11 ] , the design of incentives in control systems can be challenging even in the absence of information asymmetries. In this work, we propose a principal-agent model for stochastic LTI systems with continuous outputs subject to moral hazard and show that a likelihood ratio test on the continuous output trajectories constitutes an optimal contract for incentivizing the agent’s hidden controller choice. I-A Incentive Design in Control Systems Much of the literature on incentive design for control systems focuses on the setting of perfect information, an early example of which is [ 7 ] . In these models, the principal is assumed to have perfect knowledge about the agent and their control actions. This line of work has extended to settings such as bilevel model predictive control (BiMPC) [ 16 , 15 ] to design incentives in situations similar to what occurs in hierarchical model predictive control (MPC), and this work has recently been generalized to design incentives in more complex hierarchical MPC structures [ 21 ] . I-B Information Asymmetry in Control Systems A closely-related line of literature [ 17 ] considers incentive design for control systems under various types of information asymmetry. Given the surge of data being generated by modern systems, more recent work has combined ideas from machine learning with control to design incentives under information asymmetry. An example of such are models combining a principal-agent framework with multiarmed bandits with hidden (to the principal) rewards [ 6 , 5 ] . The work most closely related to our model is [ 22 ] , which designs dynamic contracts with real-time and end-time compensation for stochastic control systems by solving an associated Hamilton Jacobi-Bellman (HJB) equation. Our work differs in a few notable ways: The most significant difference is that we propose a simpler contract that consists of a fixed payment time, two payment amounts, and regions of the observation-space corresponding to each payment amount (all of which are optimized over) for a setup where the agent can choose between only two state-feedback controllers. Other differences are that [ 22 ] considers continuous-time nonlinear models, whereas in our setup we focus on discrete-time linear models with linear state-feedback controllers. I-C Contribution and Outline We make two main contributions: For a model of moral hazard with a stochastic linear time-invariant (LTI) system in discrete-time and two payment levels, we show that the optimal contract depends on a likelihood ratio test. Similar results are known when outputs are discrete [ 11 , 18 ] ; however, our result considers continuous outputs. We also derive the distribution of the log likelihood ratio statistic under stochastic LTI dynamics, showing they take the form of generalized sums of chi-squared distributions. The remainder of this paper is organized as follows. Section II presents the system model and the contract design problem. In Section III , we theoretically characterize the structure of the optimal contract, and Section IV provides a practical numerical algorithm to compute the optimal contract. Lastly, Section V presents applications of the proposed contract design to load frequency control in power systems and a wellness program to incentivize body weight loss. II CONTRACT DESIGN PROBLEM In the problem we consider, there is a principal that wishes to control a dynamical system; however, the principal must pay an agent to choose control actions on their behalf. The principal incurs a state cost, and the agent incurs a control cost. The agent picks a controller from a choice of two state-feedback policies, with one of the state-feedback policies having a higher expected control cost than the other. The principal’s goal is to design a contract that maps any state trajectory to a payment amount, where the payment serves as a cost to the principal and a reward to the agent. II-A Control System and Costs II-A 1 System Dynamics The system the principal would like to control is described by a discrete-time linear time-invariant (LTI) system with process and measurement noise \displaystyle x_{k+1} \displaystyle=Ax_{k}+Bu_{k}+w_{k} (1) \displaystyle y_{k} \displaystyle=Cx_{k}+\epsilon_{k} (2) where x_{k}\in\mathbb{R}^{n} is the system state, y_{k}\in\mathbb{R}^{p} is the noisy output, u_{k}\in\mathbb{R}^{q} is the control input, the matrices have dimensions A\in\mathbb{R}^{n\times n} , B\in\mathbb{R}^{n\times q} , C\in\mathbb{R}^{p\times n} , the w_{k}\sim\mathcal{N}(\mu_{w},\Sigma_{w}) with \mu_{w}\in\mathbb{R}^{n} and \Sigma_{w}\in S^{n}_{+} (with S^{n}_{+} denoting the set of \mathbb{R}^{n\times n} positive semidefinite matrices) is independent and identically distributed (i.i.d.) jointly Gaussian process noise, and \epsilon_{k}\sim\mathcal{N}(0,\Sigma_{e}) with \epsilon_{k}\in\mathbb{R}^{p} and \Sigma_{e}\in S^{p}_{+} is i.i.d. jointly Gaussian measurement noise. Our model allows the process noise to have non-zero mean \mu_{w} because this allows us to include affine LTI systems in our results. The initial state x_{0} has a jointly Gaussian distribution x_{0}\sim\mathcal{N}(\mu_{0},\Sigma_{0}) with \mu_{0}\in\mathbb{R}^{n} and \Sigma_{0}\in S^{n}_{+} . We further assume that x_{0} , w_{t} , \epsilon_{t} for all t are independent. In our model, we do not require (A,C) to be observable because such an assumption is stronger than needed for our problem. We will instead make a related but weaker assumption about the distributions of the y_{0},y_{1},\ldots . This assumption will appear in the statements of our theorems. II-A 2 Agent Costs The agent chooses between two linear state-feedback

Read the complete text