WEIGHTED CKP INEQUALITIES INVOLVING RÉNYI DIVERGENCE POWERS

Sergey G. Bobkov 1, Devraj Duggal 2 · 2025

Read WEIGHTED CKP INEQUALITIES INVOLVING RÉNYI DIVERGENCE POWERS by Sergey G. Bobkov 1, Devraj Duggal 2 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-26002.txt.

Introduction

Sergey G. Bobkov and Devraj Duggal study inequalities that bound how far apart two probability measures can be. A probability measure assigns chances to events, and total variation distance is a standard way to measure the gap between two such assignments. Their weighted version gives some outcomes more importance than others, and they relate it to powers of Renyi divergence, a family of measures of difference between distributions.

Bobkov and Duggal consider Pinsker type inequalities, which are classic bounds of distance by divergence, in this weighted setting. They then apply the bounds to derive transport entropy inequalities, which link the cost of moving mass to an entropy gap, under moment type conditions on the distributions involved.

Catalog record

CREATORSergey G. Bobkov 1, Devraj Duggal 2
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE54 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2510-26002

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

WEIGHTED CKP INEQUALITIES INVOLVING RÉNYI DIVERGENCE POWERS Thanks: 1) School of Mathematics, University of Minnesota, Minneapolis, MN, USA, [email protected]. Thanks: 2) School of Mathematics, University of Minnesota, Minneapolis, MN, USA, [email protected]. Sergey G. Bobkov 1, Devraj Duggal 2 Abstract . Pinsker-type inequalities are considered for the weighted total variation distance between probability measures in terms of the Rényi divergence powers. They are applied in derivation of transport-entropy inequalities under moment-type conditions. 2010 Mathematics Subject Classification Primary 60E, 60F Contents: 1. Introduction 2. Rényi divergence powers 3. Transport-entropy inequalities 4. Linearization of Rényi divergence power 5. Uniquence of extremizer and its description 6. Hölder-type inequalities for densities 7. Proof of Theorems 4.1–4.2 8. Necessary and sufficient conditions. Moment bounds 9. Proof of Theorem 2.3 (the case \alpha\geq 2 ) 10. Proof of Theorem 2.3 (the case 1\leq\alpha\leq 2 ) 11. Pearson-Vajda distances. Proof of Theorems 2.1–2.2 1. Introduction Let (E,\mathcal{E},\mu) be a probability space, and \nu be a probability measure on E which is absolutely continuous with respect to \mu , for short, \nu<\!\!<\mu , with density f=d\nu/d\mu . The Pinsker’s, also called Csiszár-Kullback-Pinsker’s inequality, connects the total variation norm v=\|\nu-\mu\|_{\rm TV} between these measures with the informational divergence (Kullback-Leibler distance) D=D(\nu||\mu)=\int f\,\log f\,d\mu by means of the inequality \|\nu-\mu\|_{\rm TV}\leq\sqrt{2D}. (1.1) Often, the informational divergence is much easier treated in comparison with total variation, and then the inequality (1.1) is of particular use (for example, when both \mu and \nu are Gaussian measures on the Euclidean space). The square root function appearing on the right-hand side of (1.1) is not optimal. Various improvements in the form D\geq\Psi(v) , which we do not consider here, have been obtained by many authors, see Kullback [ 14 ] , [ 15 ] , Vajda [ 21 ] , Toussant [ 19 ] , Topsoe [ 18 ] , Fedotov, Harremoës and Topsoe [ 11 ] . Another way of sharpening, important for applications, is based on the replacement of v with the weighted total variation distance \|w(\nu-\mu)\|_{\rm TV}=\int w\,d|\nu-\mu|=\int w\,|f-1|\,d\mu, where w\geq 0 is a given measurable function on E (weight function). However, to get an anolog of (1.1) in this more general setting, one needs to require that w has certain integrability properties under the measure \mu . Interesting results in this direction were obtained by Bolley and Villani [ 6 ] who derived the bounds \|w(\nu-\mu)\|_{\rm TV}\leq\Big(1+\log\int e^{w^{2}}d\mu\Big)^{1/2}\sqrt{2D} (1.2) and, as another variant, \|w(\nu-\mu)\|_{\rm TV}\leq\Big(\frac{3}{2}+\log\int e^{2w}d\mu\Big)\Big(\sqrt{D}+\frac{1}{2}\,D\Big). (1.3) Choosing w=1 , (1.2) yields (1.1) with an additional factor of \sqrt{2} . The point of (1.3) is that a weaker integrability assumption is required from w in comparison with (1.2), although this is achieved at the expense of an additional D -term in the last brackets. Bolley and Villani call (1.2)-(1.3) weighted CKP inequalities. They applied these results to derive transport-entropy bounds in metric measure spaces where the metrics have proper exponential moments under \mu . Later on, the inequality (1.2) was also used in [ 2 ] in the study of the central limit theorem with respect to the relative Fisher information. 2. Rényi Divergence Powers The purpose of this paper is to explore weighted CKP inequalities under weaker moment conditions posed on the weight function w . This naturally requires to involve stronger informational distances in place of D such as the Rényi divergence powers, which are also known under the name “Tsallis distances”. Keeping the same setting as before, the Rényi divergence of order \alpha>1 between \nu and \mu is defined by D_{\alpha}=D_{\alpha}(\nu||\mu)=\frac{1}{\alpha-1}\,\log\int f^{\alpha}\,d\mu, provided that \nu<\!\!<\mu has density f=d\nu/d\mu , and D_{\alpha}(\nu||\mu)=\infty otherwise. This quantity is related to the Rényi’s entropy like the Kullback-Leibler divergence D is related to Shannon’s entropy. Correspondingly, by analogy with entropy power, the Rényi divergence power or the Tsallis distance is given by T_{\alpha}=T_{\alpha}(\nu||\mu)=\frac{1}{\alpha-1}\,\left[\int f^{\alpha}\,d\mu-1\right]. (2.1) These quantites are non-decreasing in \alpha with limit T_{1}=D_{1}=D (once T_{\alpha} is finite for some \alpha>1 ) and are connected by T_{\alpha}=\frac{1}{\alpha-1}\,\big[e^{(\alpha-1)D_{\alpha}}-1\big]\geq D_{\alpha}. Hence, they are of the same order, when these distances are small, although their role in various relations might be different. We refer an interested reader to [ 9 ] , [ 10 ] , [ 3 ] for an account of basic properties of these informational functionals. In the sequel, we denote by \|u\|_{p}=\Big(\int|u|^{p}\,d\mu\Big)^{1/p} the L^{p}(\mu) -norm of a measurable function u on E , and by \beta=\frac{\alpha}{\alpha-1} the conjugate power. We aim to derive several CKP bounds on the weighted total variation distance in terms of the L^{\beta} -norms of the weighed function w and the Rényi divergence power as defined in (2.1). Recall that the probability measure \mu on E is fixed, while \nu may be arbitrary. Theorem 2.1. If 1<\alpha\leq 2 , then \|w(\nu-\mu)\|_{\rm TV}\leq\frac{16}{3}\,\|w\|_{\beta}\,\max\big\{\sqrt{T_{\alpha}},T_{\alpha}^{1/\alpha}\big\}. (2.2) If \alpha\geq 2 , then \|w(\nu-\mu)\|_{\rm TV}\leq 3^{\alpha}\,\|w\|_{\beta}\,T_{\alpha}^{1/\alpha}. (2.3) As an alternative variant, we also have: Theorem 2.2. Putting \beta^{*}=\max(\beta,2) , \|w(\nu-\mu)\|_{\rm TV}\leq C_{\beta}\,\|w\|_{2\beta^{*}-2}\,\sqrt{T_{\alpha}}. (2.4) Here one may take C_{\beta}=2 for \alpha\geq 2 and C_{\beta}=4\,\beta^{\beta} for \alpha<2 . Note that in the limit case \alpha\rightarrow 1 , the inequalitiy (2.2) with w=1 returns us to the Pinsker inequality (1.1) with an additional numerical factor. The proof Theorem 2.1 is rather simple and involves an application of Pearson-Vajda informational distances which are closely related to T_{\alpha} (cf. Section 11). As for Theorem 2.2, the argument is based on the linearization of the Rényi divergence power developed in [ 4 ] . Here we will recall and refine this argument, and provide some missing technical details. Another intermediate step in derivation of (2.4) deals with relations of the form \Big|\int u\,d\nu\Big|\leq K\sqrt{T_{\alpha}}, (2.5) which are required to hold for a fixed function u\in L^{1}(\mu) with \mu -mean zero in the class of all probability measures \nu<\!\!<\mu . An interesting question of independent interest is how one can describe or estimate the best constant K in (2.5). The next assertion which was essentially obtained, but not properly emphasized in [ 4 ] gives an answer in terms of the quantities K_{p}=K_{p}(u) defined by K_{p}^{2p-2}\,=\,\sup_{r>0}\,\Big[r^{p-2}\int_{|u|\geq r}|u|^{p}\,d\mu\Big],\quad p\geq 2. (2.6) In particular, K_{2}=\|u\|_{2} is the usual L^{2} -norm. Theorem 2.3. a) Let 1<\alpha\leq 2 . The best value of K in (2.5) satisfies c_{\beta}K_{\beta}\leq K\leq C_{\beta}K_{\beta}, (2.7) holding with c_{\beta}=\frac{1}{4}\,\beta^{-\beta} and C_{\beta}=2\beta^{\beta} . b) For \alpha\geq 2 , the best value of K satisfies \sqrt{\frac{2}{\alpha}}\,\|u\|_{2}\leq K\leq\|u\|_{2}. For completeness, we will inlcude the proof of this theorem (polishing some steps in the original argument). Note that one may relate K_{p} to the Lebesgue norms, assuming that \|u\|_{2p-2} is finite. In this case, by Markov’s inequality, for all r>0 , \int_{|u|\geq r}|u|^{p}\,d\mu\leq\frac{1}{r^{p-2}}\,\|u\|_{2p-2}^{2p-2} and hence (2.6) yields K_{p}(u)\leq\|u\|_{2p-2}. (2.8) Corollary 2.4. The best value of K in the inequality (2.5) satisfies K\leq C_{\beta}\,\|u\|_{2\beta^{*}-2},\quad\beta^{*}=\max(\beta,2). (2.9) Here one may take C_{\beta}=1 for \alpha\geq 2 and C_{\beta}=2\beta^{\beta} for \alpha<2 . 3. Transport-Entropy Inequalities Theorems 2.1-2.2 can be applied in the derivation of transport-entropy inequalities. Such inequalities provide upper bounds for the Kantorovich distances between probability distributions in terms of informaton-theoretic distances. Let (E,\rho) be a separable metric space endowed with the \sigma -algebra \mathcal{E} of Borel subsets in E . The Kantorovich transport distance of order p\geq 1 between Borel probability measures \mu and \nu on E is defined by W_{p}(\mu,\nu)=\Big(\inf\int\!\!\int\rho(x,y)^{p}\,d\pi(x,y)\Big)^{1/p}, where the infimum is running

Read the complete text