The smallest singular value for rectangular random matrices with Lévy entries
Yi HAN · 2024
Read The smallest singular value for rectangular random matrices with Lévy entries by Yi HAN (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-06246.txt.
Introduction
Yi Han determines how small the smallest singular value of a large random rectangle can be when its entries have infinite variance. For well-behaved entries, classic results pin the scaled value to a clean limit. Heavy-tailed Lévy entries, whose extremes dominate, broke those arguments entirely.
For symmetric entries with power-law tails, Han traps the smallest singular value between two bounds differing only by logarithmic factors. The lower bound is new and answers, in weaker form, a problem posed by earlier authors. The same bound survives adding any fixed matrix, however large its norm. A diverging aspect ratio case is also treated. Earlier anti-concentration methods had only reached a much weaker lower bound.
Catalog record
| CREATOR | Yi HAN |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 88 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-06246
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
The smallest singular value for rectangular random matrices with Lévy entries Yi HAN Abstract . Let X = ( x i j ) ∈ ℝ N × n X=(x_{ij})\in\mathbb{R}^{N\times n} be a rectangular random matrix with i.i.d. entries (we assume N / n → 𝐚 > 1 N/n\to\mathbf{a}>1 ), and denote by σ m i n ( X ) \sigma_{min}(X) its smallest singular value. When entries have mean zero and unit second moment, the celebrated work of Bai-Yin and Tikhomirov show that n − 1 2 σ m i n ( X ) n^{-\frac{1}{2}}\sigma_{min}(X) converges almost surely to 𝐚 − 1 . \sqrt{\mathbf{a}}-1. However, little is known when the second moment is infinite. In this work we consider symmetric entry distributions satisfying ℙ ( | x i j | > t ) ≍ t − α \mathbb{P}(|x_{ij}|>t)\asymp t^{-\alpha} for some α ∈ ( 0 , 2 ) \alpha\in(0,2) , and prove that σ m i n ( X ) \sigma_{min}(X) can be determined up to a log factor with high probability: for any D > 0 D>0 , with probability at least 1 − n − D 1-n^{-D} we have C 1 n 1 α ( log n ) 2 ( α − 2 ) α ≤ σ m i n ( X ) ≤ C 2 n 1 α ( log n ) α − 2 2 α C_{1}n^{\frac{1}{\alpha}}(\log n)^{\frac{2(\alpha-2)}{\alpha}}\leq\sigma_{min}(X)\leq C_{2}n^{\frac{1}{\alpha}}(\log n)^{\frac{\alpha-2}{2\alpha}} for some constants C 1 , C 2 > 0 C_{1},C_{2}>0 . The upper bound was derived in a recent work of Bao, Lee and Xu [ 7 ] but the lower bound is new and answers a problem posed in that paper in a weaker form. This appears to be the first determination of σ m i n ( X ) \sigma_{min}(X) in the α \alpha -stable case with a correct leading order of n n , as previous anti-concentration arguments only yield lower bound n 1 2 n^{\frac{1}{2}} . The same lower bound holds for σ m i n ( X + B ) \sigma_{min}(X+B) for any fixed rectangular matrix B B with no assumption on its operator norm. The case of diverging aspect ratio is also computed. 1. Introduction This paper is concerned with the smallest singular value of a rectangular random matrix with i.i.d. entries. A classical theorem of Bai and Yin [ 5 ] is as follows: Theorem 1.1 . [ [ 5 ] ] Let X=(x_{ij})\in\mathbb{R}^{N\times n} with independent, identically distributed (i.i.d.) entries x_{ij} satisfying \mathbb{E}[x_{ij}]=0 , \mathbb{E}[|x_{ij}|^{2}]=1 , \mathbb{E}[|x_{ij}|^{4}]<\infty . Assume that the aspect ratio satisfies N/n\to\mathbf{a} as n\to\infty for some \mathbf{a}>1 . Then almost surely n^{-1/2}\sigma_{min}(X)\to\sqrt{\mathbf{a}}-1,\quad\text{ as }n\to\infty, where \sigma_{min}(X) denotes the smallest singular value of X . Under the assumptions of Theorem 1.1 , n^{-\frac{1}{2}}\sigma_{max}(X) also converges almost surely to \sqrt{\mathbf{a}}+1 , where \sigma_{max}(X) is the largest singular value of X . The empirical spectral measure of N^{-1}X^{*}X converges to the Marchenko-Pastur law with aspect parameter 1/\mathbf{a} [ 30 ] and when x_{ij} are sub-Gaussian, Tracy-Widom fluctuations of \sigma_{min}(X) and \sigma_{max}(X) are proven in [ 35 ] , [ 18 ] . For regularly varying entry tails with exponent \alpha\in(0,4) , assuming centering when \alpha\geq 2 , suitably rescaled extreme singular values converge to a Poisson point process, while the rescaled largest singular value has a Fréchet limit [ 4 ] . Recently, [ 22 ] determined the law of \sigma_{max}(X) when \mathbb{P}(|x_{ij}|\geq t)\sim t^{-4} . It remained an open problem for some time whether the finite fourth moment condition is necessary for a.s. convergence of n^{-1/2}\sigma_{min}(X) to \sqrt{\mathbf{a}}-1 , until Tikhomirov finally removed the fourth moment condition in [ 38 ] . Theorem 1.2 . [ [ 38 ] ] The claim of Theorem 1.1 is true without assuming \mathbb{E}[|x_{ij}|^{4}]<\infty. Recently, [ 8 ] investigated the finer asymptotics of \sigma_{min}(X) when \mathbb{P}(|x_{ij}|\geq t)\sim t^{-\alpha} , \alpha\in(2,4) and obtained three different scaling limits in different ranges of \alpha . Having a good understanding of \sigma_{min}(X) when x_{ij} has a finite second moment, a natural question is to study \sigma_{min}(X) when x_{ij} has heavier tail, say they have a regularly varying tail with \mathbb{P}(|x_{ij}|\geq t)\sim t^{-\alpha} for some \alpha\in(0,2) . In this direction only partial progress has been achieved so far. A lower bound for \sigma_{min}(X) has been derived in [ 37 ] without assuming any moment condition on x_{ij} , and is purely based on anti-concentration properties: Theorem 1.3 . [ [ 37 ] ](Informal statement) For any \delta>1 and N\geq\delta n , consider a rectangular random matrix X=(X_{ij})\in\mathbb{R}^{N\times n} with i.i.d. entries that are uniformly anti-concentrated (measured in terms of Lévy concentration function ( 3.1 )). Then we can find u,v>0 such that, for any non-random B\in\mathbb{R}^{N\times n} , we have \mathbb{P}(\sigma_{min}(X+B)\leq u\sqrt{n})\leq\exp(-vn). Applying Theorem 1.3 to a rectangular matrix X with \alpha -stable distribution, we deduce that with very high probability \sigma_{min}(X)\geq C\sqrt{n} for some C>0 . However, one may expect that this bound significantly underestimates the magnitude of \sigma_{min}(X) when \alpha\in(0,2) , as we will prove that \sigma_{min}(X) should be of order n^{\frac{1}{\alpha}} modulo some log factor. A closely related setting is square Lévy matrices, where the correct asymptotics of \sigma_{min}(X) is recently derived in Louvaris [ 28 ] . Specifically, Theorem 1.4 . [ [ 28 ] ] For \alpha\in(0,2) Let \sigma be defined by equation (1.2) in [ 28 ] . let Z be a random variable following a (0,\sigma) \alpha -stable law in the sense that \mathbb{E}[e^{itZ}]=\exp(-\sigma^{\alpha}|t|^{\alpha})\text{ for all }t\in\mathbb{R}. Let D_{n}(\alpha)=(d_{ij})_{1\leq i,j\leq n} be a squared random matrix with i.i.d. entries, each entry has the law n^{-\frac{1}{\alpha}}Z . Then there is a countable set \mathcal{A}\subset(0,2) such that for all \alpha\in(0,2)\setminus\mathcal{A} , we have \mathbb{P}(n\xi\sigma_{min}(D_{n}(\alpha))\leq r)=1-\exp(-\frac{r^{2}}{2}-r)+\mathcal{O}_{r}(n^{-c}) for some c>0 , where \xi is a constant depending only on \alpha defined in [ 28 ] , eq. (1.4). Here \mathcal{O}_{r}(n^{-c}) denotes a quantity bounded in absolute value by C(r)n^{-c} where C(r)>0 is a constant depending only on r>0 . Theorem 1.4 generalizes the celebrated universality result of Tao and Vu [ 36 ] for the least singular value of i.i.d. (light-tailed) matrices to i.i.d. Lévy matrices. Now we turn back to a rectangular matrix with i.i.d. stable distribution. In this regime, the spectral measure was characterized in [ 10 ] , which is a heavy-tail analogue of the Marchenko-Pastur distribution and, in contrast to the Marchenko-Pastur law, has a nonzero mass in any neighborhood of zero. Not much has been known since then. A recent investigation [ 7 ] identified a change from localized to delocalized eigenvector statistics as we switch from \alpha\in(0,2) to \alpha>2 , but the asymptotics of \sigma_{min}(X) remain elusive. Meanwhile, the proof methods in these existing works (in particular on squared Lévy matrices [ 2 ] , [ 1 ] , [ 28 ] ) do not easily generalize to this heavy-tail rectangular setting. 1.1. Two-side least singular value estimates The main contribution of this paper is a lower bound for \sigma_{min}(X) that is asymptotically sharp up to a log factor. Theorem 1.5 . Fix \alpha\in(0,2), \delta>1 , and