Quasi-Ergodic Control of Multi-Periodic Autoregressive Processes: Formulation and Examples

Vyacheslav Kungurtsev · 2025

Read Quasi-Ergodic Control of Multi-Periodic Autoregressive Processes: Formulation and Examples by Vyacheslav Kungurtsev (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-24729.txt.

Introduction

Vyacheslav Kungurtsev formulates control of systems buffeted by season-like repeating noise, in a paper from twenty twenty-five. Energy and farm systems face weather and demand patterns that cycle with the calendar. Steering them well calls for foresight and caution about risk, yet classic scenario methods grow too heavy over long horizons.

The formulation forces the system's state distribution to repeat with the same period as the noise. That single move lets solutions be built from periodic building blocks, avoiding growth that explodes with time span. The author shows the setup on several examples that fit the frame. The paper offers the method as a tractable route for long-run control under repeating uncertainty.

Catalog record

CREATORVyacheslav Kungurtsev
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE42 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-24729

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Quasi-Ergodic Control of Multi-Periodic Autoregressive Processes: Formulation and Examples Vyacheslav Kungurtsev Abstract This work considers state dynamics driven by Periodic Autoregressive Moving Average noise, and control of the system over time. Such processes appear frequently in applications involving the environment, such as energy and agriculture. Managing these systems applying forecasts to make decisions that exhibit foresight and risk aversion while maximizing profits is a challenging control problem that can be computationally difficult for standard scenario-based methods. This paper presents a formulation that explicitly enforces time-periodicity of distribution of the state, facilitating the use of periodic stochastic process basis elements as a discretization. By enforcing periodicity explicitly, an ansatz for the solution can be formed that does not require exponential scaling with time. We provide a few examples that can be modeled with this new control formulation. 1 Introduction There are a number of processes with time-dynamics that follow a stochastic process that exhibits periodicity of multiple periods. This is easily seen with anything depending on weather - there is a natural geological cycle corresponding to the sun’s varying influence on the surface of the Earth across the 24 hours in a day as well as seasonal influence throughout the period of a year. Beyond this, many systems have endogenous mechanisms that can create additional periodicity through systems relying on corrective dynamics that consistently correct for overshoot and undershoot. This was first presented as a pioneering comprehensive analysis of business cycles by the economist Joseph A. Schumpeter in [ 25 ] . In this work, a combination of seasonal, regular boom-bust business cycles, and long run Kondratieff technological innovation-driven cycles are overlayed to describe the time-dynamics of aggregate economic output, investment and other macroeconomic quantities. Modeling real phenomena of such systems requires accurate and precise system identification. Naturally, there are a number of stochastic inputs into the dynamic process. This is epistemically represented through uncertainty-quantified (even if just by standard error computations) forecasts of the weather or economic spirits or other quantities unknown in the future. In statistical time series efforts to fit data to a model for forecasting, periodicity plays an important role in many such models. It appears in the modern day for, e.g., water resource management using statistical tools of Periodic Autoregressive Regression (PAR) [ 26 ] and later Periodic Autoregressive Moving Average Regression (PAMAR) [ 19 ] . The management and control of systems of this form is a challenging computational endeavor. Technically, this requires an accurate model representation of the system together with a scheme that approximates an ideal Dynamic Programming (DP) solution. In DP (see, e.g. [ 7 ] ) one performs a backwards recursion from some final time, obtaining a stochastic process defined on the uncertainty of all of the realizations of the random dynamic process up to that point and parametrized by the previous-time controls. One then inputs this solution into the next-to-last time step, and continues through what is called “backwards induction” up until reaching the initial time instant. In practice, however, most problems are intractable as far as exact solutions. Multistage Stochastic Programming approaches together with scenario generation, that samples future potential paths of stochastic realizations, provides a computational approximation. However, these direct discretizations suffer from a “curse of dimensionality” wherein exponential explosion with respect to decision and state variable dimension and stochastic discretization (that is, a finite sample of the noise at each time step) renders computational performance riddled with limitations. Yet the accuracy quickly degrades with a meaningful number of scenarios to properly quantify the uncertainty, yielding difficult choices of tradeoffs as far as the choice of model and forecast detail as well as solution algorithm to employ. Model Predictive Control (e.g. [ 13 ] ) is a framework for real-time decision making in physical processes. An optimal control problem defining the operation of some system for a finite horizon of future time is discretized, meaning the differential equations defining the dynamics are computed numerically at discrete time and space points. The resulting finite dimensional optimization problem is solved using appropriate software, and the optimal control choice at the first time step is implemented into the system. Subsequently the process evolves, and its state and any relevant parameters are measured or estimated, and a new optimal control problem is defined, now initialized at the current time step, with the horizon of the same length and thus extending one time step. This process is repeated, with the intention of resulting in a long term well performing and stable trajectory. In practical real time, one maintains an optimization problem describing the process up through a certain maximal time interval. Then, at regular intervals, one obtains novel measurements, truncates the (essentially infinite) horizon to a fixed, finite horizon, discretizes the continuous dynamics of the model, and solves a corresponidng mixed-integer non-linear optimization problem (MINLP), often simplifying the problem to form a mixed-integer linear optimization program (MILP). In control theory, this approach is known as constrained model predictive control (CMPC) of hybrid systems. When quantities in the system are uncertain, then the optimization problem is not well defined, as the solution depends on the realization of the uncertainty. Thus one has to compute some statistical agglomeration of the objective to defined a proper optimization problem. A standard choice is taking the expectation, over the distribution of the uncertainty, and so the problem becomes to minimize the expected cost. However, such an objective is risk neutral, and an operator may be more averse to large losses than favorable to large gains. One can minimize the volatility, or standard deviation, however this would unnecessarily penalize downward volatility. A number of risk measures [ 24 ] were developed in order to quantiy one-sided risk. They each satisfy certain axiomatic properties of risk measures, and different measures have their own specific features. A popular one for optimal control applications of the Conditional Value at Risk (CVaR), see, e.g. [ 18 ] . CVaR considers the probability mass expected beyond a certain quintile, and is parametrized by the quintle value. Thus it presents a natural interpretation of tail behavior. In this work we study the problem of dynamic control of such processes. To this effect we consider that, at the high level, one can obtain a quasi-ergodic solution offline and then formulate transient control problems with shorter time scales in real time to ensure close-to-ergodic operation. This ensures the simultaneous long run reliability while permitting flexibility towards addressing real-time risks and opportunities. We define the problem of interest as establishing a policy such that, with respect to a given forecast of a PAR or PAMAR phenomenon, the process follows a stationary, around a moving average, multi-periodic distributional orbit. The periods will, of course, correspond to those of the statistical quantities, and the decisions will be chosen so as to realize these probabilistic constraints while minimizing a cost that includes both an expectation and the upside risk of an economic objective, usually negative profit. 2 Background Here we review the primary computational methodologies that are related to the problem that we introduce. We provide a brief description, indicate the correspondence to the problem below, and present some references. 2.1 Dynamic Programming Dynamic Programming involves solving a stochastic control problem

Read the complete text