Dynamic Lagrange Multipliers in a Non-concave Utility Framework

Yang Liu, Alexander Schied, Zhenyu Shen · 2026

Read Dynamic Lagrange Multipliers in a Non-concave Utility Framework by Yang Liu, Alexander Schied, Zhenyu Shen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-14924.txt.

Introduction

Liu, Schied, and Shen propose dynamic Lagrange multipliers for continuous-time portfolio selection with non-concave utility functions. Martingale duality dominates in complete markets, while dynamic programming can yield singular Hamilton-Jacobi-Bellman solutions. Their multiplier function equals the value function's dual point, exactly its partial derivative with respect to wealth. The multiplier process shows scaling through optimal wealth and pricing kernels, reading as a moving shadow price under the envelope theorem. Classical optimal results are recovered and validated in tests on non-concave utility examples.

Catalog record

CREATORYang Liu, Alexander Schied, Zhenyu Shen
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE74005
LICENSEhttp://creativecommons.org/publicdomain/zero/1.0/
RIGHTSCC0
SOURCEarXiv

Source: https://arxiv.org/abs/2604.14924

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Dynamic Lagrange Multipliers in a Non-concave Utility Framework Yang Liu, Alexander Schied, Zhenyu Shen Abstract In continuous-time portfolio selection for non-concave utility functions, the martingale duality approach is widely adopted in complete markets, while the dynamic programming approach may sometimes lead to singular solutions of the Hamilton-Jacobi-Bellman (HJB) equation. We propose “dynamic Lagrange multipliers” in a non-concave utility framework, bridging two approaches and demonstrating that the Lagrangian multiplier function (in the martingale duality approach) equals the conjugate dual point related to the value function (in dynamic programming), which is exactly its partial derivative with respect to wealth. Moreover, the dynamic multiplier process exhibits homogeneity via the optimal wealth and pricing kernel processes, offering intuitive economic interpretations as a dynamic shadow price of the envelope theorem. Finally, classical optimal results are recovered and numerically validated by non-concave utility examples. MSC(2010) : 91B16, 91G10. JEL Classifications : G11, C61. Keywords: Non-concave utility optimization; Dynamic Lagrange multipliers; Stochastic control; Martingale duality approach; Legendre-Fenchel transform; Dynamic programming. 1 Introduction Utility maximization is a fundamental problem in continuous-time portfolio selection. We begin with formulating the Merton 1969 ; Merton 1971 problem: \displaystyle\sup_{\boldsymbol{\pi}\in\mathcal{V}[0,T]}\mathbb{E}\left[U(X_{T})|X_{0}=x_{0}\right], (1) where T>0 is the terminal time horizon and \{X_{t}\}_{0\leqslant t\leqslant T} is the wealth process governed by \boldsymbol{\pi}=\{\boldsymbol{\pi}_{t}\}_{0\leqslant t\leqslant T} . For a fixed time t\in[0,T) , \mathcal{V}[t,T] denotes the set of admissible controls \boldsymbol{\pi} from time t to T . Here, x_{0} represents the initial wealth and U is the utility function. Under the standard framework with a strictly concave utility, the seminal works of Merton 1969 ; Merton 1971 pioneered the stochastic control approach to utility maximization. This approach formulates the problem within a dynamic programming framework, where solutions are derived through the Hamilton-Jacobi-Bellman (HJB) equation. It yields both the value function ( u(t,x) , representing the optimal expected utility) and the optimal portfolio strategy ( \boldsymbol{\Pi}(t,X_{t}^{*}) , expressed as a feedback control of the optimal wealth process \{X_{t}^{*}\}_{0\leqslant t\leqslant T} ). The martingale duality approach, developed in Pliska 1986 , Karatzas et al. 1987 , and Cox and Huang 1989 , offers an alternative approach and remains valid beyond Markovian market settings. This method utilizes the pricing kernel process \{\xi_{t}\}_{0\leqslant t\leqslant T} to establish a risk-neutral measure, employing duality analysis and martingale representation to characterize the optimal terminal wealth. The optimal wealth process and the portfolio process \{\boldsymbol{\pi}_{t}^{*}\}_{0\leqslant t\leqslant T} are then constructed through replication arguments. Financial practice often requires extensions beyond concave utilities. The best-known example are the S -shaped utility functions proposed by Markowitz 1952 and in the prospect theory of Kahneman and Tversky 1979 . Another example arises in hedge fund compensation structures. Convex schemes (e.g., call options in Carpenter 2000 and first-loss contracts in He and Kou 2018 ) are commonly employed to align hedge fund managers’ incentives with fund performance, but create non-concavities in objective functions with respect to terminal wealth. To address this, the prevailing methodology applies concavification techniques to transform the utility U into its concave envelope (the smallest concave function larger than or equal to U ), after which the martingale duality approach is implemented; see Carpenter 2000 , Reichlin 2013 , Bichuch and Sturm 2014 , Dong and Zheng 2020 , and Liang and Liu 2020 . In contrast, the dynamic programming approach faces analytical challenges due to the singularity in the associated HJB equations in such cases. Overall, these motivations and challenges have spurred extensive research in non-concave utility optimization; see Chen et al. 2019 , Nguyen and Stadje 2020 , Dai et al. 2022 , Liang et al. 2025 , Qian and Yang 2026 , and Qin et al. 2026 . Although both martingale duality and dynamic programming approaches yield identical solutions ( \boldsymbol{\pi}_{t}^{*}=\boldsymbol{\Pi}(t,X_{t}^{*}) ) in the classical framework, their analytical structures and economic interpretations differ fundamentally. The key distinction lies in their temporal focus: While the martingale method solves the portfolio problem in one step by optimizing a static terminal payoff, dynamic programming requires that optimality be verified locally and infinitesimally along the whole time horizon. In this paper, our aim is to bridge these approaches and establish their dynamic relationships. Our contribution is to demonstrate the relationship between the dynamic Lagrange multiplier function \mathcal{Y}(t,x) in the martingale duality method and the conjugate dual point \lambda(t,x) related to the value function in dynamic programming, under a framework of non-concave utilities. We establish two main results: (i) the dynamic Lagrange multiplier function equals the conjugate dual point, which is exactly the partial derivative of the value function with respect to wealth: \frac{\partial}{\partial x}u(t,x)=\lambda(t,x)=\mathcal{Y}(t,x) ; and (ii) the dynamic Lagrange multiplier process \lambda(t,X^{*}_{t}) exhibits homogeneity via the optimal wealth and the pricing kernel: \lambda(t,X^{*}_{t})=\lambda(0,x_{0})\xi_{t} . These results can be seen as the dynamic version of the envelope theorem (well-known in economics) related to the Lagrange multiplier (known as the shadow price). Furthermore, we derive the optimal portfolio in a feedback form using these dynamic conjugate relationships ( \boldsymbol{\pi}_{t}^{*}=\boldsymbol{\Pi}(t,X_{t}^{*}) ). Specifically, a key challenge in our duality analysis in the non-concave utility framework is that the function obtained via the Legendre-Fenchel transform (denoted by I in Equation ( 5 )) fails to be continuous, and consequently, it is not differentiable. To overcome this obstacle, we employ tools from distribution theory ( Stein and Shakarchi 2010 ), which allow us to handle such irregularities in a rigorous manner. The paper is structured as follows. Section 2 formulates the model setup and Section 3 introduces the tools of convex analysis. Section 4 presents the main theoretical results and Section 5 gives the detailed proof. Section 6 provides a numerical example that highlights the economic intuition. Additional proofs are deferred to the appendix. 2 Model Setting and Problem Formulation Consider the filtered probability space (\Omega,\{\mathcal{F}_{t}\}_{0\leqslant t\leqslant T},\mathbb{P}) satisfying the usual condition, in which \{\mathbf{W}_{t}\}_{0\leqslant t\leqslant T} is a d -dimensional standard Brownian motion. We assume that the market contains (d+1) assets, denoted by \{S_{i,t}\}_{0\leqslant t\leqslant T} , i=0,1,\ldots,d . Among these assets, \{S_{0,t}\}_{0\leqslant t\leqslant T} represents the risk-free asset (i.e., bond) and the others are risky assets (i.e., stocks) denoted by \{\mathbf{S}_{t}\}_{0\leqslant t\leqslant T}:=\{(S_{1,t},\ldots,S_{d,t})^{\top}\}_{0\leqslant t\leqslant T} . Let \boldsymbol{\mu}\in\mathbb{R}^{d} be a constant vector and \boldsymbol{\sigma}\in\mathbb{R}^{d\times d} be a constant matrix. We further assume that there exists \varepsilon>0 such that \boldsymbol{\boldsymbol{\eta}^{\top}\left(\boldsymbol{\sigma}\boldsymbol{\sigma}^{\top}\right)\boldsymbol{\eta}}\geqslant\varepsilon\|\boldsymbol{\eta}\|_{2}^{2}\hskip 11.74988pt\text{for any }\boldsymbol{\eta}\in\mathbb{R}^{d}, which implies that \boldsymbol{\sigma} is invertible. The assets satisfy the Black-Scholes model \mathrm{d}S_{0,t}=rS_{0,t}\mathrm{d}t,\hskip 11.74988pt\mathrm{d}S_{i,t}=\mu_{i}S_{i,t}\mathrm{d}t+\boldsymbol{\sigma}_{i}^{\top}S_{i,t}\mathrm{d}\mathbf{W}_{t},\hskip 11.74988pti=1,\ldots,d, where \boldsymbol{\sigma}_{i} denotes the i -th row of \boldsymbol{\sigma} . Let \mathbf{1}_{d}=(1,\ldots,1)^{\top}\in\mathbb{R}^{d} . Define the vector \boldsymbol{\theta}:=\boldsymbol{\sigma}^{-1}(\boldsymbol{\mu}-r\mathbf{1}_{d}) and the pricing kernel \{\xi_{t}\}_{0\leqslant t\leqslant T} by \xi_{t}=\exp\left\{-\left(r+\frac{\|\boldsymbol{\theta}\|_{2}^{2}}{2}\right)t-\boldsymbol{\theta}^{\top}\mathbf{W}_{t}\right\}, where \|\boldsymbol{\theta}\|_{2}=\left(\sum_{i=1}^{d}|\theta_{i}|^{2}\right)^{\frac{1}{2}} is the Euclidean norm of the vector. Finally, Harrison and Pliska 1981 and Chapter 18.5 of Shreve 2004 show that such a market is complete, i.e., every contingent claim can be hedged. In fact, all the results in this paper can be generalized to the case where the market coefficients are deterministic processes. Still, we let them be constant numbers/vectors for notational simplicity. Let \boldsymbol{\pi}=\{(\pi_{1,t},\ldots,\pi_{d,t})^{\top}\}_{0\leqslant t\leqslant T} denote the portfolio process, where the i -th component represents the money that the investor allocates to the i -th risky asset. A portfolio \boldsymbol{\pi}=\{\boldsymbol{\pi}_{t}\}_{0\leqslant t\leqslant T} is called admissible if \boldsymbol{\pi} is an \{\mathcal{F}_{t}\}_{0\leqslant t\leqslant T} -progressively measurable \mathbb{R}^{d} -valued process and \int_{0}^{T}\|\boldsymbol{\pi}_{t}\|_{2}^{2}\,\mathrm{d}t<\infty almost surely. Let \{X_{t}\}_{0\leqslant t\leqslant T}

Read the complete text