Isomorphic Dynamic Programs
John Stachurski, Junnan Zhang · 2026
Read Isomorphic Dynamic Programs by John Stachurski, Junnan Zhang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-22076.txt.
Introduction
John Stachurski and Junnan Zhang study links between dynamic programs using conjugacy ideas from dynamical systems theory. When two programs are connected by an order isomorphism, optimality properties pass from one formulation to the other. Applied to Epstein-Zin preferences with time shocks, this yields a sharp characterization of when it holds. The authors also show multiplicative Kreps-Porteus preferences and risk-sensitive ones are isomorphic, so the latter's results transfer to the former. Finally, such transformations can improve value function accuracy by two orders of magnitude.
Catalog record
| CREATOR | John Stachurski, Junnan Zhang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 70128 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.22076
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Isomorphic Dynamic Programs Thanks: The authors thank Yuchao Li, Shu Hu, and Jingni Yang for valuable comments and suggestions. Financial support from Schmidt Futures is gratefully acknowledged. The second author acknowledges support from NSFC Project 72303190. John Stachurski, Junnan Zhang Abstract . We study relationships between dynamic programs by applying conjugacy methods from dynamical systems theory. When two dynamic programs are connected by an order isomorphism, we show that optimality properties transmit from one formulation to the other. We apply these results to Epstein–Zin preferences with time preference shocks, obtaining a sharp characterization of when optimality holds. We also show that multiplicative Kreps–Porteus preferences and risk-sensitive preferences are isomorphic, so that well-known results for the latter carry over to the former. Finally, we demonstrate how isomorphic transformations can improve the numerical accuracy of value function approximations, with gains of two orders of magnitude in a multisector real business cycle model. 1. Introduction Dynamic programming is a major field of optimization with applications across a wide spectrum of scientific domains, including economics and finance (see, e.g., 11 , 57 , 47 , 34 , 9 , 13 ). In recent years, variations of the standard model have flourished. This is particularly true in economics and finance, as applied researchers extend dynamic models to get closer to the data. Some of these variations add features to the standard framework, including Epstein--Zin preferences, risk-sensitive preferences, adversarial agents, ambiguity, and hyperbolic discounting. 1 1 1 See, for example, 24 , 17 , 33 , 8 , 26 , 46 , 30 , or 20 . Other variations take an existing model and rearrange the structure and timing. These variations include the Q-factor and exponential risk-sensitive Q-factor formulations from Q-learning, and the expected value function models and integrated value function models from structural estimation. 2 2 2 See, for example, 38 , 50 , 27 , or 40 . Given this proliferation of variations and modifications, one significant issue is that each new formulation typically requires its own bespoke analysis to establish desirable optimality properties (e.g., existence of optimal policies, Bellman’s principle of optimality, or convergence of Howard policy iteration). In this paper, we address this issue from a new direction, by borrowing ideas from the field of dynamical systems. Since each policy operator defines a discrete-time dynamical system, tools from that field become directly applicable. In particular, we draw on notions of conjugacy. In dynamical systems and chaos theory, topological conjugacy is used to identify families of dynamical systems that have “equivalent” or related dynamics (see, e.g., 53 or 2 ). These ideas have proved enormously useful for categorizing different types of systems and allowing researchers to make deductions about a particular system from their knowledge of other related systems. 3 3 3 For example, 36 , 31 , and 48 characterize chaotic dynamical systems in economic models utilizing the shift homeomorphism. In a similar vein, 28 establish topological conjugacy between equilibrium economic dynamics and dynamical systems with known chaotic behaviors. Also see 6 and 23 . Specifically, we transfer these ideas to dynamic programming by studying order-theoretic conjugacy relationships between the policy operators that define a dynamic program. We call two dynamic programs linked in this way isomorphic ; under an order-reversing link, we call them anti-isomorphic . Our main result shows that verifying this single relationship is enough to transfer an entire package of optimality properties from one program to the other: existence and uniqueness of the value function, Bellman’s principle of optimality, existence of optimal policies, and convergence of Howard policy iteration. Solving one program therefore delivers a complete solution to the other, including recovery of the value function and optimal policies. The benefits of this approach are both theoretical and numerical. On the theoretical side, dynamic programs that are not easily analyzed can often be connected, via an isomorphism, to a program whose optimality properties are already established or more readily verified; the isomorphism then allows those properties to carry over to the original problem. We illustrate this in two settings that are not covered by standard contraction-based methods. First, for a dynamic program with Epstein–Zin utility and time preference shocks, we obtain an exact characterization of when optimality holds. Second, we show that multiplicative Kreps–Porteus preferences are isomorphic to risk-sensitive preferences, so that the well-developed contraction theory for the latter yields optimality results for the former. On the numerical side, within an isomorphism class one is free to work with whichever representative is best suited to computation. Exploiting this flexibility in the multisector real business cycle model of 42 , we obtain solutions that are, on average, two orders of magnitude more accurate than solving the original problem, by choosing a representative within the isomorphism class whose value function has lower curvature. This paper builds on the abstract dynamic programming framework of 51 . In that paper, individual dynamic programs are represented as families of policy operators acting on a partially ordered space. When dynamic programs are viewed in this way, studying conjugacy relationships between related families of policy operators becomes a natural idea, since each policy operator identifies a discrete time dynamical system. The main deviation from traditional dynamical systems methodology is that we use order-theoretic conjugacy relationships, rather than topological ones, since the key objects in optimization are order-theoretic and preserved by this relation. This paper contributes to a large and growing literature that studies the optimality properties of dynamic programs with nonstandard features, such as recursive utility ( 45 ; 14 ; 49 ) , risk sensitive preferences ( 8 ) , hyperbolic discounting ( 7 ; 4 ) , and Q-factors ( 43 ) . For example, our work relates to the literature on existence and uniqueness in dynamic programs with recursive preferences, such as 15 and 14 . Our approach complements this literature in two ways. First, rather than focusing on specific models, we propose a general framework that, under appropriate transformations, can simplify the analysis of such dynamic programs. Second, as an application of our theory, we provide exact necessary and sufficient conditions for optimality in dynamic programs with Epstein–Zin preferences and state dependent discounting. While not the primary focus of this paper, our work also connects to the literature on computational methods for solving dynamic economic models. These include traditional methods such as projection and perturbation ( 29 ; 10 ) , endogenous grid method ( 18 ; 5 ) , adaptive sparse grids ( 16 ) , and deep learning ( 3 ; 44 ) . A notable feature of our framework is that it can complement existing computation methods: any suitable method can be applied to an isomorphic dynamic program to improve numerical performance compared to solving the original problem. The structure of the paper is as follows. Section 2 introduces order conjugacy and discusses its properties. Sections 3 – 4 recall some definitions and optimality results for “abstract” dynamic programs, which are well-suited to our dynamical systems perspective. Section 5 introduces isomorphisms between abstract dynamic programs and shows how isomorphisms preserve optimality properties. Section 6 provides applications and Section 7 concludes. 2. Preliminaries This section introduces the key order-theoretic concepts needed for our analysis of abstract dynamic programs. Additional