Free denoising via overlap measures and c c -freeness techniques

Maxime Fevrier, Alexandru Nica, Kamil Szpojankowski · 2024

Read Free denoising via overlap measures and c c -freeness techniques by Maxime Fevrier, Alexandru Nica, Kamil Szpojankowski (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-20792.txt.

Description

Abstract . We study the problem of free denoising . For free selfadjoint random variables a , b a,b , where we interpret a a as a signal and b b as noise, we find E ⁡ ( a | a + b ) E(a\,|\,a+b) .

Catalog record

CREATORMaxime Fevrier, Alexandru Nica, Kamil Szpojankowski
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE138 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-20792

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Free denoising via overlap measures and c c -freeness techniques Thanks: AN: research supported by a Discovery Grant from NSERC, Canada. Thanks: KSz: This research was funded in part by National Science Centre, Poland WEAVE-UNISONO grant BOOMER 2022/04/Y/ST1/00008. For the purpose of Open Access, the authors have applied a CC-BY public copyright licence to any Author Accepted Manuscript (AAM) version arising from this submission. Maxime Fevrier, Alexandru Nica, Kamil Szpojankowski Abstract . We study the problem of free denoising . For free selfadjoint random variables a , b a,b , where we interpret a a as a signal and b b as noise, we find E ⁡ ( a | a + b ) E(a\,|\,a+b) . To that end, we study a probability measure μ a , a + b ( ov ) \mu^{(\mathrm{ov})}_{a,a+b} on ℝ 2 \mathbb{R}^{2} which we call the overlap measure . We show that μ a , a + b ( ov ) \mu^{(\mathrm{ov})}_{a,a+b} is absolutely continuous with respect to the product measure μ a × μ a + b \mu_{a}\times\mu_{a+b} . The Radon-Nikodym derivative gives direct access to E ⁡ ( a | a + b ) E(a\,|\,a+b) . We show that analogous results hold in the case of multiplicative noise when a , b a,b are positive and the aim is to find E ⁡ ( a | a 1 / 2 ​ b ​ a 1 / 2 ) E(a\,|\,a^{1/2}ba^{1/2}) . In a parallel development we show that, for a general selfadjoint expression P ⁡ ( a , b ) P(a,b) made with a a and b b , finding E ⁡ ( a | P ⁡ ( a , b ) ) E(a\,|\,P(a,b)) is equivalent to finding the distribution of P ⁡ ( a , b ) P(a,b) in a certain two-state probability space ( 𝒜 , φ , χ ) (\mathcal{A},\varphi,\chi) , where a , b a,b are c-free with respect to ( φ , χ ) (\varphi,\chi) in the sense of Bożejko-Leinert-Speicher. We discuss how free denoising (which is set in the framework of an abstract W ∗ W^{*} -probability space) relates to the notion of “matrix denoising” previously discussed in the random matrix literature. 1. Introduction 1.1. Problem description. In this paper we consider some instances (primarily the additive instance and the multiplicative instance) of a problem which could go under the name of free denoising . The setting for free denoising involves two freely independent selfadjoint random variables a,b in a tracial W^{*} -probability space \left(\mathcal{A},\varphi\right) , where a is viewed as signal (it is “the random variable of interest”), while b is viewed as noise. In the additive version of the free denoising problem we assume that the sum a+b is given, and our goal is to find the best approximation of a by an element h(a+b)\in\mathcal{A} , where h is a real-valued Borel function on the spectrum of a+b . The multiplicative version of the problem goes in the same vein, but where a,b are now assumed to be positive and the task is to approximate a by an element h(\,a^{1/2}ba^{1/2}\,) . In full generality, the random variable c\in\mathcal{A} which is assumed to be given is some selfadjoint expression c=P(a,b) formed with a and b (instead of a+b or a^{1/2}ba^{1/2} one could have, for instance, a quadratic expression such as P(a,b)=i(ab-ba) or P(a,b)=ab+ba ). When viewed as an approximation problem with respect to the ||\cdot||_{2} -norm associated to the trace \varphi , the above mentioned problem is turned into the one of understanding what is the conditional expectation E\bigl(a\mid P(a,b)\bigr) , where E\bigl(\cdot\mid P(a,b)\bigr):\mathcal{A}\to\mathcal{B} is the unique \varphi -preserving conditional expectation onto the von Neumann algebra \mathcal{B}\subseteq\mathcal{A} generated by P(a,b) . In Sections 6 and 7 of the present paper we provide explicit formulas for such conditional expectations, holding in the two main cases under consideration, E(a\,|\,a+b) and respectively E\left(a\,|\,a^{1/2}ba^{1/2}\right) . Then, for a general c=P(a,b) , Section 8 of the paper puts into evidence an alternative approach to free denoising which is found by relating it to the notion of “conditionally free independence” of Bożejko-Leinert-Speicher [ 15 ] . In the appendix we explain that the methodology described in this paper also works in the case of the multiplication of two freely independent unitaries. 1.2. Motivation: analogies with classical probability. In order to put things into perspective, we note here that free denoising is the free probabilistic counterpart of a well-known formalism of classical probability, concerning conditional expectations (taken in usual “commutative” sense) \mathbb{E}(X\,|\,Y) , where (X,Y) is a random vector in \mathbb{R}^{2} . Under fairly general conditions (see e.g. the survey paper [ 17 ] ), the distribution \sigma of (X,Y) can be disintegrated with respect to the 1-dimensional distribution \nu of Y , leading to a family of 1-dimensional distributions (\mu_{t})_{t\in\mathbb{R}} such that for a bounded Borel function f:\mathbb{R}^{2}\to\mathbb{C} we have (1.1) \int_{\mathbb{R}^{2}}f(s,t)\,d\sigma(s,t)=\int_{\mathbb{R}}\,\Bigl[\,\int_{\mathbb{R}}f(s,t)\,d\mu_{t}(s)\,\bigr]\,d\nu(t). In this setting, one gets that \mathbb{E}(X\,|\,Y)=h(Y) , where we put (1.2) h(t)=\int_{\mathbb{R}}s\,d\mu_{t}(s),\ \ t\in\mathbb{R}. The preceding formula shows that, in general, the initial data needed in order to find \mathbb{E}(X\,|\,Y) is the full joint distribution \sigma of X and Y . But there exist cases when the said conditional expectation can be expressed solely in terms of Y and its distribution. To illustrate this, let us focus, in analogy to the previous subsection, on the case where Y=X+Z with X,Z independent (in the commutative sense) and Z\sim\mathcal{N}(0,\sigma^{2}) . The distribution of Y is then sure to have a density f_{Y} with respect to Lebesgue measure, and the well-known Tweedie’s formula in statistics (see [ 26 ] ) says that in this case one has (1.3) \displaystyle\mathbb{E}(X\,|\,Y)=Y+\sigma^{2}g(Y),\ \mbox{ where $g(t)=\tfrac{d}{dt}\log(f_{Y}(t))$.} For the free analogue of the above mentioned development, we will use a sibling of the notion of joint distribution which we call “overlap measure” (Section 1.4 below). The methodology developed in connection to this yields, in particular, both an additive and a multiplicative free analogue for Tweedie’s formula ( 1.3 ), where the formula arising in the additive analogue is of the same nature as ( 1.3 ). More precisely, for this additive analogue we pick a,b\in\mathcal{A} to be freely independent and selfadjoint (like at the beginning of Section 1.1 above), and we assume that the distribution of b is the Wigner semicircle law with variance \sigma^{2} . We then find that E(a\,|\,a+b)=h(a+b) for the function h:\mathbb{R}\to\mathbb{R} defined by (1.4) h(t)=t-2\pi\,\sigma^{2}\,H_{\mu\boxplus\nu}(t), where H_{\mu\boxplus\nu} is the Hilbert transform of the measure \mu\boxplus\nu . It is remarkable that, analogous to the classical case, the right-hand side of ( 1.4 ) depends only on the distribution \mu\boxplus\nu of a+b . The details of the derivation of ( 1.4 ) are presented in Example 6.7 below. We mention that this formula had been spotted in the physics literature, via a method called “the replica trick” (see [ 16 ] ). The multiplicative free analogue of Tweedie’s formula is presented in Example 1.6 below. As it turns out, this free analogue had also been spotted in previous research literature on random matrices, in [ 21 ] . 1.3. Relation to subordination functions. Let a,b be freely independent selfadjoint elements in a W^{*} -probability space (\mathcal{A},\varphi) . In [ 13 ] , Biane showed how

Read the complete text