Estimation in linear high dimensional Hawkes processes: a Bayesian approach

Judith Rousseau, Vincent Rivoirard, Déborah Sulem ) · 2025

Read Estimation in linear high dimensional Hawkes processes: a Bayesian approach by Judith Rousseau, Vincent Rivoirard, Déborah Sulem ) (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-24182.txt.

Introduction

Judith Rousseau and two co-authors study Bayesian estimation for high dimensional Hawkes processes, which model events that trigger further events over time. In the sparse regime they consider, each component of the process depends on far fewer interaction functions than the total dimension. They ask how well Bayesian methods recover both the intensity functions and the parameters themselves.

The authors prove bounds for two loss measures: an empirical distance between intensity functions and a norm on the parameters, covering background rates and interaction functions. These are the first results to control the parameter norm in this setting and the first study of Bayesian procedures for high dimensional Hawkes processes, giving a base for sparse event modeling.

Catalog record

CREATORJudith Rousseau, Vincent Rivoirard, Déborah Sulem )
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE70 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2510-24182

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Estimation in linear high dimensional Hawkes processes: a Bayesian approach Judith Rousseau, Vincent Rivoirard, Déborah Sulem ) Abstract In this paper we study the frequentist properties of Bayesian approaches in linear high dimensional Hawkes processes in a sparse regime where the number of interaction functions acting on each component of the Hawkes process is much smaller than the dimension. We consider two types of loss function: the empirical L 1 L_{1} distance between the intensity functions of the process and the L 1 L_{1} norm on the parameters (background rates and interaction functions). Our results are the first results to control the L 1 L_{1} norm on the parameters under such a framework. They are also the first results to study Bayesian procedures in high dimensional Hawkes processes. 1 Introduction Multivariate Hawkes processes have been widely used both in machine learning and statistics as a versatile model for dependent point processes, with a wide range of applications such as neurosciences, social sciences and finance. A K dimensional Hawkes process N=(N^{1},\cdots,N^{K}) is a marked point process whose intensity process \lambda_{t}=(\lambda_{t}^{k})_{k=1}^{K} is defined by (1.1) \lambda_{t}^{(k)}(f_{k})=\nu_{k}+\sum_{\ell=1}^{K}\int_{t-A}^{t^{-}}h_{\ell k}(t-s)dN^{\ell}(s),\quad f_{k}=(\nu_{k},h_{\ell k},\ell\leq K),\quad t\in\mathbb{R} with \nu_{k}\in\mathbb{R}_{+} is called the background rate on N^{k} and h_{\ell k}:\mathbb{R}_{+}\rightarrow\mathbb{R}_{+} is the interaction function from N^{\ell} on N^{k} , for \ell,k\in[K]=\{1,\cdots,K\} . Recall that \lambda_{t}^{(k)}dt=P(N^{k}\text{ has a jump in }[t,t+dt)|\mathcal{G}_{t}) where \mathcal{G}_{t} is the history of N up to time t . Typically one observes N over a time period [0,T] and the aim is to estimate the true parameter f^{0}=(f_{1}^{0},\cdots,f_{k}^{0}) , or functionals of f^{0} such as the graph of interactions or equivalently its adjacency matrix \Delta(f^{0}) whose components are \Delta_{\ell k}(f^{0})=\mathbf{1}_{\|h_{\ell k}^{0}\|_{1}>0} . Algorithms and statistical methods have been proposed and studied over the last decade or so but only recently theoretical properties have been derived when the dimension K of the Hawkes process is large. The high dimension of the process poses both theoretical and computational challenges due to the fact that the K^{2} interaction functions need to be estimated in addition to the K background rates. This question is crucial, for example in neuroscience, where we are able to record the activity of a large number of neurons simultaneously. To address such challenges it is natural to consider a sparse regime where f can be parametrized by a much lower dimensional parameter and there exist different types of sparsity regimes considered in the literature. A first type of sparsity is defined by assuming that for all k\in[K] only a small number of interaction functions h_{\ell k} are non null, as in [ 3 ] , [ 2 ] and [ 16 ] , while an alternative type of sparsity consists in assuming that f can be represented by a low dimensional tensor, as in [ 1 ] and [ 15 ] . In all but the last paper the results do not allow to directly control the difference between the estimator \hat{f} and the true parameter f^{0} , when such an estimator is proposed, but either control the empirical L_{2} distance d_{2,T}(\hat{f}_{k},f_{k}^{0})=T^{-1}\int_{0}^{T}(\lambda_{t}^{(k)}(\hat{f}_{k})-\lambda_{t}^{(k)}(f_{k}^{0}))^{2}dt or estimate a superset containing \{(\ell,k);\|h_{\ell k}\|_{1}>0\} or in the case of [ 16 ] , under a parametric assumptions on the h_{\ell,k} , estimate h_{\ell,k} for a given (\ell,k) . As will appear from our results the rates obtained in [ 16 ] seem suboptimal, but it is to be noted that these rates are not the main objective of [ 16 ] . Therefore the question of the (i) possiblity to estimate f in high dimensions and (ii) the best achievable rates of convergence in direct norms on f is still open, notably when non parametric assumptions are made on the interaction functions h_{\ell k} . Also, none of the methods cited above are Bayesian. Bayesian nonparametric estimation of multivariate Hawkes processes has been studied theoretically by [ 6 ] and [ 14 ] but these papers deal with the fixed K case and the dependence of K in their rates is exponential. In this paper we study a family of Bayesian approaches to the nonparametric and parametric estimation of high dimensional linear Hawkes processes. We derive posterior contraction rates, which in turns imply the same convergence rates for some Bayesian estimators of f . We study two types of loss functions, the empirical L_{1} loss, in a similar spirit to [ 1 ] and [ 2 ] (see Theorem 2.6 ) and the direct L_{1} loss on f (see Theorem 2.10 ), for which we obtain the oracle rate - up to \log T or \log K terms, i.e. rates that would be obtained if we knew the graph of interactions, i.e. \Delta(f^{0}) . Then we study a number of prior families for which we derive the posterior contraction rates under various smoothness conditions on the true interaction functions h_{\ell k}^{0} . 2 Bayesian inference for high dimensional Hawkes process 2.1 High dimensional Hawkes processes We observe a multivariate Hawkes process N=(N^{1},\cdots,N^{K}) where K is possibly large and whose intensity process \lambda_{t}=(\lambda_{t}^{(k)})_{k=1}^{K} is defined in ( 1.1 ) and depends on f=(f_{1},\cdots,f_{K}) . Then the log-likelihood of N at f is given by, see [ 5 ] , (2.1) L_{T}(f)=\sum_{k=1}^{K}L_{T,k}(f_{k}),\quad L_{T,k}(f_{k})=\int_{0}^{T}\lambda^{(k)}(f_{k})dN_{t}^{k}-\int_{0}^{T}\lambda^{(k)}(f_{k})dt. Throughout the paper we assume that the supports of the intensity functions h_{\ell k} are included in [0,A] where A>0 is a given constant. We denote by \rho(f) the matrix in \mathbb{R}_{+}^{K\times K} defined by \rho_{\ell k}(f)=\int_{0}^{A}h_{\ell k}(x)dx , is the mass of h_{\ell k} . When there is no ambiguity we will write \rho in place of \rho(f) . Throughout the paper we assume that the true generating process is a Hawkes process as defined in ( 1.1 ) with parameter f^{0}=(f_{k}^{0})_{k\in[K]} such that the process is stationary, i.e. the spectral radius SpR(\rho^{0})<1 with \rho^{0}=\rho(f^{0}) . We write \mathbb{P}_{0}(\cdot) (resp. \mathbb{E}_{0}(\cdot) ) for the probability distribution of N associated to f^{0} (resp. for any expectation associated to \mathbb{P}_{0} ). We are interested in the estimation of f^{0} in the case where K is large but under sparsity assumptions on \rho^{0} and we focus on Bayesian estimation procedures. Before introducing the family of Bayesian approaches we consider, we present the three main hypotheses on f^{0} that will be considered throughout the paper. Hypothesis 2.1 . We assume that there exist 1>c>0 and R_{\infty},R_{1}<\infty such that \rho^{0}=\rho(f^{0}) verifies: for all n\geq 1 |\hskip-1.0pt|\hskip-1.0pt|(\rho^{0})^{n}|\hskip-1.0pt|\hskip-1.0pt|_{\infty}=\max_{\ell\leq K}\sum_{k=1}^{K}((\rho^{0})^{n})_{\ell,k}\leq R_{\infty}c^{n},\quad|\hskip-1.0pt|\hskip-1.0pt|(\rho^{0})^{n}|\hskip-1.0pt|\hskip-1.0pt|_{1}=|\hskip-1.0pt|\hskip-1.0pt|(\rho^{0Tr})^{n}|\hskip-1.0pt|\hskip-1.0pt|_{\infty}\leq R_{1}c^{n} where \rho^{0Tr}=\rho(f_{0})^{Tr} is the transpose of \rho^{0} and |\hskip-1.0pt|\hskip-1.0pt|M|\hskip-1.0pt|\hskip-1.0pt|_{\infty} (resp. |\hskip-1.0pt|\hskip-1.0pt|M|\hskip-1.0pt|\hskip-1.0pt|_{1} ) is the operator norm of the matrix M related to the norm \|\cdot\|_{\infty} (resp. \|\cdot\|_{1} ). Hypothesis 2.2 . We denote S_{0}(k)=\{\ell,\rho_{\ell k}^{0}>0\}\subset[K] and S_{0} the list made of the sets S_{0}(k) , k\in[K] . There exists s_{0}<\infty such that for all k , |S_{0}(k)|\leq s_{0} , where |S_{0}(k)| is the cardinal of S_{0}(k) . Hypothesis 2.3 . There exist \bar{h}_{0},c_{0},c_{1}<\infty and A>0 such that \sup_{x>A}h_{\ell k}^{0}(x)=0 , \max_{\ell,k}\|h_{\ell,k}^{0}\|_{\infty}\leq\bar{h}_{0}<\infty,\quad c_{0}\leq\inf_{k}\nu_{k}^{0}\leq\sup_{k}\nu_{k}^{0}\leq c_{1}. These constants do not depend on K and T . A consequence of Hypotheses 2.1 and 2.3 is that we can bound uniformly \mu_{k}^{0}=\mathbb{E}_{0}(\lambda_{t}^{(k)}f_{k}^{0})) and \mathbb{E}_{0}(\lambda_{t}^{(k)}f_{k}^{0})^{2}) and some exponential moments of N^{k}([0,B)) for B>0 . Lemma 2.4 . Assume that Hypotheses 2.1 - 2.3 hold , then \displaystyle\mu_{k}^{0} \displaystyle=E_{0}[\lambda_{0}^{(k)}(f_{k}^{0})]\leq\frac{c_{1}(1-c+R_{1})}{1-c}=:C_{0}<\infty;\quad\mathbb{E}_{0}[\lambda_{0}^{(k)}(f_{k}^{0})^{2}]\leq C_{0}^{2}+\frac{C_{0}\bar{h}_{0}R_{\infty}R_{1}c}{1-c}=:\bar{C}_{0} \displaystyle\mathbb{E}_{0}[e^{tN^{k}(0,B)}] \displaystyle\leq e^{t\gamma B},\quad\forall 0\leq t\leq t(c):=\frac{\log(1+c)-\log(2c)}{1+\frac{2R_{\infty}}{1-c}},\quad\gamma=\frac{2C_{0}R_{1}}{1-c} Proof 1 (Proof of

Read the complete text