Robust Stochastic Outperformance under Kullback–Leibler Ambiguity

Ozan Hur · 2025

Read Robust Stochastic Outperformance under Kullback–Leibler Ambiguity by Ozan Hur (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-01346.txt.

Introduction

Ozan Hur studies a robust finance question: what is the worst-case chance that an asset Y beats a benchmark X, when Y's distribution is only known to lie near the benchmark's? Nearness is measured by Kullback-Leibler divergence, a standard gauge of how far one probability law sits from another. The problem takes a max-min form over ways of coupling the two outcomes.

Hur shows that problem has a tractable dual, reached through optimal transport, and its solution tilts the benchmark law exponentially. The answer forms a one-parameter family, with the parameter acting as a budget for the allowed information shift. As it grows, probability mass moves steadily from lower to higher outcomes. Because the method needs only the baseline distribution, Hur offers it as a tool for wide scenario generation and robust performance testing.

Catalog record

CREATOROzan Hur
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE14 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-01346

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Robust Stochastic Outperformance under Kullback–Leibler Ambiguity Thanks: This work was conducted entirely outside of my employment using only personal resources, it does not represent the views of my employer, and no proprietary or confidential information was used. Any affiliations are for identification only and do not imply endorsement. Ozan Hur Abstract We study the worst-case probability that Y Y outperforms a benchmark X X when the law of Y Y lies in a Kullback-Leibler neighbourhood of the benchmark. The max–min problem over couplings admits a tractable dual (via optimal transport), whose optimiser is an exponential tilt of the benchmark law. The resulting solution reduces to a one-parameter family indexed by regulizer λ \lambda , which controls the KL information budget and induces an increasing transfer of probability mass from lower to higher outcomes. The formulation can be evaluated from the baseline distribution and may serve as a distribution-wide scenario generation environment as well as a basis for robust performance assessment. Keywords: optimal transport; exponential tilting; stochastic dominance; stress testing. 1 Problem statement Our goal is to quantify robust stochastic outperformance when the reference law of one random variable is known exactly while the competing quantity is only known up to a Kullback–Leibler (KL) divergence constraint. Stochastic outperformance. Given two real-valued random variables X and Y defined on the same probability space, let \mathbb{P} be their joint law over \mathbb{R}^{2} . We say that Y outperforms X if \mathbb{P}\,\!\bigl(Y>X\bigr)>\tfrac{1}{2}. The threshold 1/2 marks the point at which the event \{Y>X\} becomes more likely than its complement and has been adopted in earlier work on probability dominance [ 13 ] . Model setup. Let (\Omega,\mathscr{F}) be a measurable space and fix a benchmark random variable X:\Omega\to\mathbb{R} whose law P\in\mathcal{P}(\mathbb{R}) is fully specified, with cumulative distribution function (c.d.f.) F . The competing random variable Y may follow any distribution Q within a KL ball of radius \varepsilon>0 around P , \mathcal{Q}_{\varepsilon}:=\bigl\{Q\ll P:\operatorname{D_{KL}}(Q\|P)\leq\varepsilon\bigr\},\qquad\operatorname{D_{KL}}(Q\|P)=\int\log\frac{dQ}{dP}\,dQ. (1) The KL ball captures statistical ambiguity such that larger \varepsilon allow greater deviations from the benchmark law, while \varepsilon=0 forces Q=P . Robust outperformance criterion. Because we seek a robust guarantee of outperformance, we compute the worst‑case probability of Y exceeding X over all couplings that share the given marginals. For P,Q\in\mathcal{P}(\mathbb{R}) let \Pi(P,Q):=\Bigl\{\gamma\in\mathcal{P}(\mathbb{R}^{2}):\gamma\circ X^{-1}=P,\;\gamma\circ Y^{-1}=Q\Bigr\},\qquad\mathbb{P}_{\gamma}(Y>X)=\int_{\mathbb{R}^{2}}I_{\{y>x\}}\,d\gamma(x,y). Our performance metric is the max–min value V_{\varepsilon}:=\max_{Q\in\mathcal{Q}_{\varepsilon}}\;\min_{\gamma\in\Pi(P,Q)}\mathbb{P}_{\gamma}(Y>X)>1/2, (2) where \mathcal{Q}_{\varepsilon} is the KL ball ( 1 ). The inner minimisation is an optimal‑transport problem with cost c(x,y)=I_{\{y>x\}} . A distribution Q^{\star} attaining the outer maximum is the least‑favourable law for Y within the KL ball, while a coupling \gamma^{\star} attaining the inner minimum realises the most adversarial dependence structure between X and Y . In this way V_{\varepsilon} provides a lower bound on the probability of outperformance that is immune to both distributional ambiguity and dependence uncertanity. Interpretation of robustness. Expression ( 2 ) answers the question: “What is the largest worst-case probability with which Y can be guaranteed to outperform X when nature may choose any distribution within \mathcal{Q}_{\varepsilon} ?” The outer maximiser selects the marginal of Y that that most favours outperformance, while the inner minimiser selects the scenario that make Y\leq X as likely as possible. Stochastic dominance perspective. The least-favourable choice of the distribution for Y that achieves our worst-case guarantee can be read as an order improvement relative to the benchmark law of X . In particular, the worst-case law puts more probability on higher outcomes than the benchmark, i.e., its CDF lies everywhere below the benchmark which is exactly first-order stochastic dominance (FSD). This reflects the explicit exponential-tilt solution, which moves probability mass upward an “increasing transfers” view of FSD [ 10 ] . Thus, the robust outperformance is not only a worst-case probability bound but also identifies a marginal that is “better in the FSD sense” than the baseline law, providing an order-based, distribution-wide perturbation. 2 Explicit solution by exponential tilting In line with [ 9 , Sec. 2] , we provide the next proposition. Proposition 2.1 (Dual formula) . Let P,Q\in\mathcal{P}(\mathbb{R}) have cumulative distribution functions F and G . Then the optimal transport cost T(P,Q)\;:=\;\min_{\gamma\in\Pi(P,Q)}\int_{\mathbb{R}^{2}}\!I_{\{y>x\}}\,\mathrm{d}\gamma(x,y) admits the one–dimensional representation T(P,Q)=\max_{a\in\mathbb{R}}\bigl[F(a)-G(a)\bigr]. Proof. The cost function c(x,y)=I_{\{y>x\}} is bounded and lower–semicontinuous on the Polish space \mathbb{R}\times\mathbb{R} . Hence, by [ 12 , Thm. 4.10] , an optimal coupling \gamma^{\star}\in\Pi(P,Q) exists that attains the infimum in the primal problem. Choose the dual potential \psi(y)=I_{\{y\leq a\}} . Because c(x,y)\leq\zeta(x)+\phi(y) with the integrable bounds \zeta\equiv 1 and \phi\equiv 0 , the conditions of [ 12 , Thm. 5.10 (iii)] are satisfied. Consequently, the Kantorovich dual supremum is attained, and we may replace \sup by \max . To compute the c -transform of \psi , observe that \psi^{c}(x):=\inf_{y\in\mathbb{R}}\bigl\{\psi(y)+c(x,y)\bigr\}=\inf_{y\in\mathbb{R}}\bigl(I_{\{y\leq a\}}+I_{\{y>x\}}\bigr)=I_{\{x\leq a\}}, where the last equality follows by distinguishing the cases x\leq a and x>a . Substituting the pair (\psi,\psi^{c}) into the dual formulation yields the claimed one–dimensional representation. ∎ Based on the previous propositon, the optimisation problem ( 2 ) can be written as V_{\varepsilon}=\max_{Q\in\mathcal{Q}_{\varepsilon}}\max_{a\in\mathbb{R}}\,[F(a)-G(a)]. Moreover, the order of maximisation may be interchanged because both variables are optimised over a joint product domain, V_{\varepsilon}=\max_{a\in\mathbb{R}}\max_{Q\in\mathcal{Q}_{\varepsilon}}[F(a)-G(a)]. (3) Proposition 2.2 (Exponential-tilt solution of the inner problem) . Fix a\in\mathbb{R} and consider the programme \min_{Q\ll P}\bigl\{Q((-\infty,a]):D_{\mathrm{KL}}(Q\|P)\leq\varepsilon\bigr\}. (4) (i) There exists a unique solution and it is an exponentially tilted measure \frac{\mathrm{d}Q_{\lambda,a}}{\mathrm{d}P}(x)=\frac{\exp\!\bigl[-I_{\{x\leq a\}}/\lambda\bigr]}{Z(\lambda,a)},\qquad Z(\lambda,a)=1-\bigl(1-e^{-1/\lambda}\bigr)F(a), (5) where \lambda>0 is the Lagrange multiplier. (ii) Under Q_{\lambda,a} , G_{\lambda,a}(a)=\frac{e^{-1/\lambda}F(a)}{Z(\lambda,a)},\qquad D_{\mathrm{KL}}\!\bigl(Q_{\lambda,a}\|P\bigr)=-\log Z(\lambda,a)-\frac{1}{\lambda}\,G_{\lambda,a}(a). (6) (iii) For each fixed a the map \lambda\mapsto D_{\mathrm{KL}}(Q_{\lambda,a}\|P) is continuous and strictly decreasing on (0,\infty) . Hence, for every \varepsilon>0 there is a unique \lambda(a) such that D_{\mathrm{KL}}(Q_{\lambda(a),a}\|P)=\varepsilon . Proof. Introduce the Lagrangian L(Q;\lambda):=Q((-\infty,a])+\lambda\bigl(D_{\mathrm{KL}}(Q\|P)-\varepsilon\bigr),\qquad\lambda\geq 0. Because the indicator loss I_{\{x\leq a\}} is bounded, it satisfies the light-tail Assumption 1 of [ 8 ] . Consequently, [ 8 , Thm. 2] guarantees existence of a minimiser, and [ 8 , Prop. 1] shows that the minimiser must be of the exponential-tilt form ( 5 ), proving (i) . Substituting ( 5 ) into the definitions of G and D_{\mathrm{KL}} yields ( 6 ), giving (ii) . Finally, differentiating the right-hand side of ( 6 ) with respect to \lambda shows the derivative is negative, establishing the monotonicity in (iii) . ∎ Remark 2.3 (Reduction to a single-variable maximisation) . For each a choose the unique \lambda(a) from Proposition 2.2 (iii) and set Q^{a}:=Q_{\lambda(a),a} . Then ( 3 ) reduces to maximising \phi_{\lambda(a)}(a):=F(a)-G_{\lambda(a),a}(a) over a\in\mathbb{R} . Remark 2.4 (Computational motivation for the fixed- \lambda dual) . In the radius‐constrained formulation, each candidate threshold a requires solving an inner problem to find the unique multiplier \lambda(a) satisfying \operatorname{D_{KL}}\!\bigl(Q_{\lambda,a}\|P\bigr)=\varepsilon . Although each inversion is inexpensive, repeating it over a fine grid of a -values renders the outer maximisation computationally burdensome. A widely used remedy, see [ 2 , 7 ] is to fix a single multiplier \lambda>0 once and dispense with the inner loop. The resulting dual reduces to the unconstrained maximisation of \phi_{\lambda}(a)\;:=\;F(a)-G_{\lambda,a}(a)\;=\;F(a)\,\frac{(1-F(a))(1-e^{-1/\lambda})}{1-F(a)+e^{-1/\lambda}F(a)},\qquad a\in\mathbb{R}. Proposition 2.5 (Existence (and uniqueness) of a maximiser of \phi_{\lambda} ) . Let F be the cumulative distribution function of P and fix \lambda>0 . (i) There exists at least one maximiser a^{\star}\in\mathbb{R} of \phi_{\lambda} . (ii) If F is strictly increasing, then the maximiser is unique. Proof. Set C:=1-e^{-1/\lambda}\in(0,1) and put x:=F(a)\in\mathrm{Range}(F)\subseteq[0,1] . Then \phi_{\lambda}(a)=h(x)

Read the complete text