Importance Weighted Variational Inference without the Reparameterization Trick Kamélia Daudel, Minh-Ngoc Tran, Cheng Zhang Abstract Importance weighted variational inference (VI) approximates densities known up to a normalizing constant by optimizing bounds that tighten with the number of Monte Carlo samples N N . Standard optimization relies on reparameterized gradient estimators, which are well-studied theoretically yet restrict both the choice of the data-generating process and the variational approximation. While REINFORCE gradient estimators do not suffer from such restrictions, they lack rigorous theoretical justification. In this paper, we provide the first comprehensive analysis of REINFORCE gradient estimators in importance weighted VI, leveraging this theoretical foundation to diagnose and resolve fundamental deficiencies in current state-of-the-art estimators. Specifically, we introduce and examine a generalized family of variational inference for Monte Carlo objectives (VIMCO) gradient estimators. We prove that state-of-the-art VIMCO gradient estimators exhibit a vanishing signal-to-noise ratio (SNR) as N N increases, which prevents effective optimization. To overcome this issue, we propose the novel VIMCO- ⋆ \star gradient estimator and show that it averts the SNR collapse of existing VIMCO gradient estimators by achieving a N \sqrt{N} SNR scaling instead. We demonstrate its superior empirical performance compared to current VIMCO implementations in challenging settings where reparameterized gradients are typically unavailable. K eywords REINFORCE gradients \cdot Importance-Weighted Auto-Encoder \cdot Signal-to-Noise Ratio 1 Introduction Sampling from a density known up to a normalizing constant is a fundamental problem in statistics. Classical approaches rely on Markov chain Monte Carlo (MCMC) methods ( 29 ; 15 ) , which provide asymptotically exact samples but can be computationally demanding in large-scale or high-dimensional settings. These challenges have motivated the development of variational inference (VI), a class of statistical inference methods that recast sampling as an optimization problem and offer substantial computational advantages ( 19 ; 3 ) . More precisely, VI seeks the closest approximation to an unknown target density within a tractable family of probability densities \mathcal{Q} by maximizing a variational bound. The most traditional variational bound is the evidence lower bound (ELBO), although its optimization has been known to lead to biased variational approximations that place excessive probability mass near the mode ( 25 ; 28 ; 32 ; 4 ; 27 ) . To mitigate these issues, variational bounds based on importance weighting principles and tighter than the ELBO have been proposed. A prominent example is the importance weighted autoencoder (IWAE) bound ( 5 ) , which was subsequently extended by 8 under the name VR-IWAE bound to include a parameter \alpha and smoothly interpolate between the ELBO ( \alpha\to 1 ) and IWAE bound ( \alpha=0 ). A common way to optimize such variational bounds is to perform stochastic gradient ascent (SGA), therefore an active line of research in importance weighted VI has focused on the design and analysis of gradient estimators, with particular attention given to their bias, variance, and computational efficiency. Two main approaches to gradient estimation have emerged in VI ( 34 ) : reparameterized gradient estimators ( 21 ) and REINFORCE gradient estimators ( 49 ) . Reparameterized gradient estimators rely on the assumption that gradients of expectations can be re-expressed in a convenient form by writing random variables as differentiable transformations of parameter-independent noise ( 21 ) . While reparameterized gradient estimators are widely used in importance weighted VI ( 5 ; 25 ; 8 ; 46 ) and extensively studied ( 9 ; 38 ; 42 ; 12 ) , a major limitation of these estimators is that their construction restricts both the choice of the data-generating process and the variational family. For example, they are not compatible with discrete latent variables and, more broadly, are often not applicable to many practically challenging problems, including likelihood-free inference ( 50 ; 36 ) , state-space models ( 13 ) and Bayesian phylogenetic ( 17 ) . In contrast, REINFORCE gradient estimators do not require the differentiability assumptions inherent to reparameterized gradient estimators. Despite their potential to tackle complex problems beyond the scope of reparameterization-based methods, the development, analysis, and widespread adoption of REINFORCE gradient estimators is considerably less prevalent in importance weighted VI compared to their reparameterized counterparts. A notable exception is 33 , who derived the REINFORCE gradient of the IWAE bound and proposed unbiased estimators of it that incorporate variance reduction techniques. These estimators, referred to as Variational Inference for Monte Carlo objectives (VIMCO) gradient estimators, continue to be regarded as state-of-the-art in recent studies (see, for instance 18 ; 7 ; 41 ) , yet no theoretical analysis has been provided to justify their use. In this work, we argue that the limited methodological development and usage of REINFORCE gradient estimators in importance weighted VI is driven, in part, by the absence of a comprehensive theoretical understanding. To address this gap, we establish the first rigorous analyses that examine the properties of REINFORCE gradient estimators within the importance weighted VI setting, yielding new insights into their practical behavior. Crucially, our analyses show that bridging this theoretical gap exposes fundamental deficiencies that govern existing gradient estimators. Building on these results, we develop theoretically-sound, computationally efficient and general-purpose REINFORCE gradient estimators. Their effectiveness is demonstrated over challenging examples where they provably improve upon existing approaches. The remainder of this paper is organized as follows. After reviewing the basics of importance weighted VI in Section 2 , we devote Section 3 to the construction and analysis of REINFORCE gradient estimators in importance weighted VI. This core section is articulated around three primary contributions. (i) Construction of a general family of REINFORCE gradient estimators. Taking the works of 33 ; 9 as a point of departure, we define a family of VIMCO gradient estimators for the VR-IWAE bound parameterized by the number of Monte Carlo samples N , a hyperparameter \alpha\in[0,1) , and a flexible control variate function f_{-i}^{(\alpha)} . We motivate this family of estimators through two theoretical results. 1 , which characterizes the asymptotic behavior of the gradient of the VR-IWAE bound as N\to\infty , shows that unbiased estimators of this quantity point asymptotically in a theoretically-grounded direction that outperforms standard ELBO-based optimization in terms of bias (the lower \alpha , the better). Furthermore, 2 establishes that, without proper variance-reduction techniques, REINFORCE gradient estimators of the VR-IWAE bound are unusable in practice as N increases. Together, 1 and 2 imply that the success of REINFORCE gradient estimators in importance weighted VI is contingent on suitable variance-reduction mechanisms, warranting a deeper investigation into the choice of the control variate function f_{-i}^{(\alpha)} . (ii) In-depth study of REINFORCE gradient estimators leading to methodological improvement. We begin by examining the setting where f_{-i}^{(\alpha)} is defined as either the arithmetic mean (AM) or geometric mean (GM); we call the resulting gradient estimators VIMCO-AM and VIMCO-GM, respectively. These estimators notably recover those implemented in 33 as a special case ( \alpha=0 ). As N increases, 3 and 4 then show that the use of control variates in the VIMCO-AM and VIMCO-GM gradient estimators is an effective strategy for variance reduction purposes. However, we find that this reduction in variance can be deceptive. Indeed, as N increases, we further obtain from 3 and 4 that the VIMCO-AM and VIMCO-GM gradient estimators with \alpha=0 , that is, the gradient estimators from 33 , fail to learn the variational parameters due to a vanishing signal-to-noise ratio (SNR). Considering \alpha\in(0,1) in the VIMCO-AM and VIMCO-GM gradient estimators offers a straightforward but partial solution to mitigate this fundamental issue, as it excludes the case \alpha=0 . Remarkably, we propose and analyze an optimal choice of f_{-i}^{(\alpha)} that fully resolves the SNR decay issue as N grows for all \alpha\in[0,1) . Specifically, 5 provides a key insight into the required structure of such a control variate. 6 materializes this insight by showing that the gradient estimator asssociated to the optimal choice for f_{-i}^{(\alpha)} and denoted by VIMCO- \star enjoys a SNR that scales as \sqrt{N} when \alpha=0 . (iii) Translating methodological improvement into a practical importance weighted VI algorithm. Our earlier analyses, which shed light on the role of (N,f_{-i}^{(\alpha)}) , also clarify the role of the hyparameter \alpha : it is responsible for a bias-variance trade-off in our gradient estimators. While small values of \alpha , and in particular \alpha=0 , lead to a small bias, they may result in a large variance when the variational approximation is inaccurate. As a result, we propose several complementary approaches in Section 3.3 designed to navigate the trade-offs between bias, variance, and computational efficiency. Section 4 presents empirical evidence supporting our claims. Directions for future research are outlined in Section 5 . Deferred results, proofs and experiments can be found in the appendix. 2 Background We start by reviewing the basics of variational inference. Variational inference (VI). Consider a statistical model with joint distribution p_{\theta}(x,z) parameterized by \theta=(\theta_{1},\ldots,\theta_{a})\in\Theta\subseteq\mathbb{R}^{a} , where x is an observation and z is a latent variable valued in a latent space \mathsf{Z} . Sampling from the posterior density p_{\theta}(z|x) is impossible for many models of interest, which in turn impedes usual inference tasks such as finding the optimal \theta\in\Theta that maximizes the marginal log likelihood. To overcome this difficulty, VI methods typically solve an optimization problem involving a probability density q_{\phi}(z|x) parameterized by \phi=(\phi_{1},\ldots,\phi_{b})\in\Phi\subseteq\mathbb{R}^{b} whose distribution is easier to sample from compared to the posterior density p_{\theta}(z|x) . For instance, in the context of maximum likelihood estimation (MLE), VI methods optimize a variational bound – that is a lower bound on the marginal log likelihood – in lieu of optimizing the marginal log likelihood itself, with the most traditional variational bound being the Evidence Lower BOund (ELBO) \displaystyle\mathrm{ELBO}(\theta,\phi;x)=\mathbb{E}_{z\sim q_{\phi}(\cdot|x)}\left(\log w_{\theta,\phi}(z;x)\right)\quad\mbox{where}\quad w_{\theta,\phi}(z;x)=\frac{p_{\theta}(x,z)}{q_{\phi}(z|x)}\penalty\ ,\penalty\ z\in\mathsf{Z}. (1) Denoting the marginal log likelihood by \ell(\theta;x) , the property \mathrm{ELBO}(\theta,\phi;x)\leq\ell(\theta;x) follows from Jensen’s inequality with equality being reached for p_{\theta}(\cdot|x)=q_{\phi}(\cdot|x) , which provides the basis for using the ELBO as a surrogate objective function to the marginal log likelihood. In what follows, we use MLE as a running example to set notation. However, the framework also applies to Bayesian inference, in which the main inferential goal is to approximate the posterior distribution of the model parameters. As we shall see, our experimental section includes applications in both MLE and Bayesian inference settings. Importance weighted variational bounds. Importance weighted variational bounds are generalizations of the ELBO that rely on importance sampling ideas. Two notable examples are the importance weighted auto-encoder (IWAE) bound ( 5 ) \displaystyle\ell^{(\mathrm{IWAE})}_{N}(\theta,\phi;x)=\mathbb{E}_{z_{j}\overset{\mathrm{i.i.d.}}{\sim}q_{\phi}(\cdot|x)}\left(\log\left(\frac{1}{N}\sum_{j=1}^{N}w_{\theta,\phi}(z_{j};x)\right)\right),\quad N\in\mathbb{N}^{\star} and the Variational Rényi-IWAE (VR-IWAE) bound ( 8 ) : for all \alpha\in[0,1) , \displaystyle\ell^{(\alpha)}_{N}(\theta,\phi;x)=\frac{1}{1-\alpha}\mathbb{E}_{z_{j}\overset{\mathrm{i.i.d.}}{\sim}q_{\phi}(\cdot|x)}\left(\log\left(\frac{1}{N}\sum_{j=1}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}\right)\right),\quad N\in\mathbb{N}^{\star}. (2) Both variational bounds recover the ELBO when N=1 (or when \alpha\to 1 for the VR-IWAE bound), with the VR-IWAE bound generalizing the IWAE bound ( \alpha=0 ). A desirable property of the IWAE and VR-IWAE bounds is that increasing N (or also decreasing \alpha in the VR-IWAE bound case) tightens these bounds in the sense that: for all \alpha,\alpha^{\prime}\in[0,1) such that \alpha\leq\alpha^{\prime} and all N\in\mathbb{N}^{*} , \displaystyle\mathrm{ELBO}(\theta,\phi;x)\leq\ell^{(\alpha)}_{N}(\theta,\phi;x)\leq\ell^{(\alpha)}_{N+1}(\theta,\phi;x)\leq\ell(\theta;x), (3) \displaystyle\mathrm{ELBO}(\theta,\phi;x)\leq\ell^{(\alpha^{\prime})}_{N}(\theta,\phi;x)\leq\ell^{(\alpha)}_{N}(\theta,\phi;x)\leq\ell(\theta;x). (4) A common way to optimize importance weighted VI bounds is to perform stochastic gradient ascent (SGA) by deriving unbiased gradient estimators of these bounds thanks to the reparameterization trick assumption ( 21 ; 5 ; 8 ) . Under this assumption, there exist a function f and a density q such that z=f(\varepsilon,\phi;x)\sim q_{\phi}(\cdot|x) , where z is a continuous latent variable, q is independent of \phi and the mapping \phi\mapsto f(\varepsilon,\phi;x) is differentiable almost surely for \varepsilon\sim q . The properties of reparameterized gradient in importance weighted VI have garnered increasing attention in the literature ( 9 ; 8 ; 46 ; 38 ; 42 ; 12 ; 52 ) . In particular, existing theoretical and empirical results show that the tuning of (N,\alpha) in reparameterized gradient estimators of the VR-IWAE bound yields improvements compared to the ELBO (N=1) and IWAE bound (\alpha=0) cases (see, e.g., 9 ) . Beyond the reparameterization trick in importance weighted VI. A main shortcoming of reparameterized gradient estimators is that the reparameterization trick assumption limits the choice of the data-generating process as well as the choice of the variational family. For instance, the reparameterization trick assumption is not compatible with discrete random latent variables. Other examples where the reparameterization trick can generally not be applied include likelihood-free inference ( 50 ; 36 ) and state-space models ( 26 ) . The standard approach in such instances is to use REINFORCE gradients ( 34 ; 49 ) , as they do not assume that the reparameterization trick is available. Focusing on importance weighted VI, the REINFORCE gradient of the IWAE bound with respect to a one-dimensional component \psi of (\theta_{1},\ldots,\theta_{a},\phi_{1},\ldots,\phi_{b}) is derived in 33 and reads \partial_{\psi}\ell^{(\mathrm{IWAE})}_{N}(\theta,\phi;x)=\mathbb{E}_{z_{j}\overset{\mathrm{i.i.d.}}{\sim}q_{\phi}(\cdot|x)}\left(\sum_{j=1}^{N}\frac{w_{\theta,\phi}(z_{j};x)}{\sum_{\ell=1}^{N}w_{\theta,\phi}(z_{\ell};x)}\partial_{\psi}\log w_{\theta,\phi}(z_{j};x)\right)\\ +\mathbb{E}_{z_{j}\overset{\mathrm{i.i.d.}}{\sim}q_{\phi}(\cdot|x)}\left(\left(\sum_{i=1}^{N}\partial_{\psi}\log q_{\phi}(z_{i}|x)\right)\log\left(\frac{1}{N}\sum_{j=1}^{N}w_{\theta,\phi}(z_{j};x)\right)\right). (5) The IWAE bound is then optimized in 33 via SGA using the Variational Inference for Monte Carlo objectives (VIMCO) gradient estimator \displaystyle\psi\text{-}g_{N}^{(\mathrm{IWAE},\mathrm{VIMCO})}(\theta,\phi;x)=\sum_{j=1}^{N}\frac{w_{\theta,\phi}(z_{j};x)}{\sum_{\ell=1}^{N}w_{\theta,\phi}(z_{\ell};x)}\partial_{\psi}\log w_{\theta,\phi}(z_{j};x) (6) \displaystyle+\sum_{i=1}^{N}{\partial_{\psi}\log q_{\phi}(z_{i}|x)\left[\log\left(\frac{1}{N}\sum_{j=1}^{N}w_{\theta,\phi}(z_{j};x)\right)-\log\left(\frac{1}{N}\left(\sum_{\overset{j=1}{j\neq i}}^{N}w_{\theta,\phi}(z_{j};x)+f_{-i}(z_{1:N},\theta,\phi;x)\right)\right)\right]}, where f_{-i} is a function of z_{1:N}=(z_{1},\ldots,z_{N}) , \theta , \phi and x that outputs a random variable which does not depend on z_{i} , so that the VIMCO gradient estimator is an unbiased gradient estimator of \partial_{\psi}\ell^{(\mathrm{IWAE})}_{N}(\theta,\phi;x) . Specifically, 33 consider two choices of f_{-i} in practice: the arithmetic mean and the geometric mean, which correspond to taking f_{-i}(z_{1:N},\theta,\phi;x)=(N-1)^{-1}\sum_{{j=1},{j\neq i}}^{N}w_{\theta,\phi}(z_{j};x) and f_{-i}(z_{1:N},\theta,\phi;x)=\exp((N-1)^{-1}\sum_{{j=1},{j\neq i}}^{N}\log w_{\theta,\phi}(z_{j};x)) respectively. They observe empirically that the geometric mean performs slightly better compared to the arithmetic mean. However, 33 do not provide a theoretical analysis motivating either of these two choices, although they remain the state-of-the art choices in the existing literature (see, e.g., 18 ; 7 ; 41 ) . In this paper, we generalize the REINFORCE gradient of the IWAE bound ( 5 ) to the VR-IWAE bound, before proposing novel and general-purpose gradient estimators of this gradient whose effectiveness is demonstrated through theoretical analysis and empirical evaluation. Our work bridges the theoretical gap left in 33 and leads to substantial improvements over the methodology introduced therein. 3 Importance Weighted VI without Reparameterizing We begin this section by providing the analytical expression for the REINFORCE gradient of the VR-IWAE bound. Letting \alpha\in[0,1) , \psi\in\{\theta_{1},\ldots,\theta_{a},\phi_{1},\ldots,\phi_{b}\} and differentiating \ell^{(\alpha)}_{N}(\theta,\phi;x) w.r.t. \psi , the REINFORCE gradient of the VR-IWAE bound is given by \partial_{\psi}\ell^{(\alpha)}_{N}(\theta,\phi;x)=\mathbb{E}_{z_{j}\overset{\mathrm{i.i.d.}}{\sim}q_{\phi}(\cdot|x)}\left(\sum_{j=1}^{N}\frac{w_{\theta,\phi}(z_{j};x)^{1-\alpha}}{\sum_{\ell=1}^{N}w_{\theta,\phi}(z_{\ell};x)^{1-\alpha}}\partial_{\psi}\log w_{\theta,\phi}(z_{j};x)\right)\\ +\frac{1}{1-\alpha}\mathbb{E}_{z_{j}\overset{\mathrm{i.i.d.}}{\sim}q_{\phi}(\cdot|x)}\left(\left(\sum_{i=1}^{N}\partial_{\psi}\log q_{\phi}(z_{i}|x)\right)\log\left(\frac{1}{N}\sum_{j=1}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}\right)\right). (7) The expression ( 7 ) naturally gives rise to the construction of unbiased estimators, enabling a direct route to algorithmic implementation. For instance, letting z_{1},\ldots,z_{N} be i.i.d. samples generated from q_{\phi}(\cdot|x) , an immediate unbiased estimator of \partial_{\psi}\ell^{(\alpha)}_{N}(\theta,\phi;x) is \psi\text{-}g_{N}^{(\alpha,\mathrm{NAIVE})}(\theta,\phi;x)=\sum_{j=1}^{N}W_{\theta,\phi}^{(1-\alpha)}(z_{j};x)\partial_{\psi}\log w_{\theta,\phi}(z_{j};x)\\ +\frac{1}{1-\alpha}\left(\sum_{i=1}^{N}\partial_{\psi}\log q_{\phi}(z_{i}|x)\right)\log\left(\frac{1}{N}\sum_{j=1}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}\right) (8) where we have defined \displaystyle W_{\theta,\phi}^{(1-\alpha)}(z_{j};x)=\frac{w_{\theta,\phi}(z_{j};x)^{1-\alpha}}{\sum_{\ell=1}^{N}w_{\theta,\phi}(z_{\ell};x)^{1-\alpha}},\quad j=1\ldots N. As we will elaborate on in a later subsection, several other key unbiased estimators of \partial_{\psi}\ell^{(\alpha)}_{N}(\theta,\phi;x) can be built based on ( 7 ). Our first aim in this section is to investigate the behavior of the REINFORCE gradient of the VR-IWAE bound ( 7 ) as a function of its hyperparameters (N,\alpha) in order to identify its structural properties. We will then turn to the derivation and study of unbiased estimators of this gradient, examining their efficiency and exploring their practical viability. This will in particular permit us to assess how the tuning of (N,\alpha) in these estimators offers advantages over the cases N=1 (ELBO) and \alpha=0 (IWAE). 3.1 Asymptotics for the Gradient of the VR-IWAE Bound In the following, we let x be a fixed observation, \alpha\in[0,1) , \Theta\subseteq\mathbb{R}^{a} and \Phi\subseteq\mathbb{R}^{b} be two open subsets, and we assume that for all \theta\in\Theta,\phi\in\Phi , the assumption below holds: (A4) \int p_{\theta}(x,z)\nu(\mathrm{d}z)<\infty , \int q_{\phi}(z|x)\nu(\mathrm{d}z)=1 and q_{\phi}(z|x),p_{\theta}(z|x)>0 for \nu -a.e. z . Here \nu is a \sigma -finite measure on the space of latent variables \mathsf{Z} . Typically, \nu could be the Lebesgue measure on \mathbb{R}^{d} , the Lebesgue measure restricted to a subset of \mathbb{R}^{d} or the counting measure when z has discrete support. To avoid specifying the dominating measure, we use the notation \mathbb{E} throughout the paper. If the probability distribution of the involved random variables has not been specified beforehand, we use a subscript to the symbol \mathbb{E} to indicate their densities with respect to \nu as we did in Section 2 . We also assume that the mappings \theta\mapsto p_{\theta}(x) , (z,\theta)\mapsto p_{\theta}(z|x) , and (z,\phi)\mapsto q_{\phi}(z|x) are differentiable on \Theta , \mathsf{Z}\times\Theta and \mathsf{Z}\times\Phi , respectively. Finally we let z\sim q_{\phi}(\cdot|x) and z_{1},z_{2},\ldots be i.i.d. copies of z . Let us investigate the asymptotic behavior of \partial_{\psi}\ell^{(\alpha)}_{N}(\theta,\phi;x) as N\to\infty when we do not make the reparameterization trick assumption, with the aim of elucidating the role of its hyperparameters (N,\alpha) . To guide our intuition, we appeal to 9 , Theorem 1 which shows that: as N\to\infty , \displaystyle\partial_{\psi}\ell^{(\alpha)}_{N}(\theta \displaystyle,\phi;x)\overset{\mathrm{(REP)}}{=}\partial_{\psi}\mathrm{VR}^{(\alpha)}(\theta,\phi;x)-\frac{1}{2N}\partial_{\psi}[\gamma^{(\alpha)}(\theta,\phi;x)^{2}]+o\left(\frac{1}{N}\right) (9) with \displaystyle\mathrm{VR}^{(\alpha)}(\theta,\phi;x)=\frac{1}{1-\alpha}\log\left(\mathbb{E}\left(w_{\theta,\phi}(z;x)^{1-\alpha}\right)\right) (10) \displaystyle\gamma^{(\alpha)}(\theta,\phi;x)^{2}=\frac{1}{1-\alpha}\mathbb{V}\left(\frac{w_{\theta,\phi}(z;x)^{1-\alpha}}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})}\right), (11) where \overset{\mathrm{(REP)}}{=} indicates that the equality is valid under the reparameterization trick assumption. A notable insight from ( 9 ) is that this result should be independent of the reparameterization trick assumption. In fact, it is already independent of the reparameterization trick assumption when \psi\in\{\theta_{1},\ldots,\theta_{a}\} since this assumption only affects the learning of \phi . This in particular implies that the case \psi\in\{\theta_{1},\ldots,\theta_{a}\} in ( 7 ) is analyzed in ( 9 ) by ( 9 ), unlike the case \psi\in\{\phi_{1},\ldots,\phi_{b}\} . We therefore restrict ourselves to the case where \psi\in\{\phi_{1},\ldots,\phi_{b}\} in the following, which introduces the additional difficulty that the second term in the right-hand side of ( 7 ) does not cancel when \psi\in\{\phi_{1},\ldots,\phi_{b}\} contrary to the case \psi\in\{\theta_{1},\ldots,\theta_{a}\} . Hence, we are interested in capturing the behavior of ( 7 ) when \psi\in\{\phi_{1},\ldots,\phi_{b}\} by establishing a result of the form ( 9 ) that circumvents the reparameterization trick assumption. To do so, we rely on the following assumptions. (A5) There exist \mu>1 and N\in\mathbb{N}^{\star} such that \mathbb{E}(|N^{-1}\sum_{i=1}^{N}w_{\theta,\phi}(z_{i};x)^{1-\alpha}|^{-\mu})<\infty . (A h ) We have that \mathbb{E}(w_{\theta,\phi}(z;x)^{(1-\alpha)h})<\infty . ( \tilde{\mathrm{\sf{A}}}_{h^{\prime}} ) We have that \mathbb{E}\left(\left|\partial_{\psi}\left(\log q_{\phi}(z|x)\right)\right|^{h^{\prime}}\right)<\infty . (A5) is a common assumption that already appears in 9 ; 8 ; 38 and that is fully discussed in 9 . (Ah) and ( ~ A h ′ ) are moment conditions in which h and h^{\prime} are positive exponents to be precised. We now present our first result. Theorem 1 Let \psi\in\{\phi_{1},\ldots,\phi_{b}\} . Assume (A5) , (Ah) and ( ~ A h ′ ) with h\geq 4 , h^{\prime}>2 . Then, as N\to\infty : \displaystyle\partial_{\psi}\ell^{(\alpha)}_{N}(\theta,\phi;x)=\partial_{\psi}\mathrm{VR}^{(\alpha)}(\theta,\phi;x)+o(1). (12) Further assuming that h\geq 8 and h^{\prime}\geq 4 , we have: as N\to\infty , \displaystyle\partial_{\psi}\ell^{(\alpha)}_{N}(\theta,\phi;x)=\partial_{\psi}\mathrm{VR}^{(\alpha)}(\theta,\phi;x)-\frac{1}{2N}\partial_{\psi}[\gamma^{(\alpha)}(\theta,\phi;x)^{2}]+o\left(\frac{1}{N}\right). (13) The proof of 1 is deferred to Section A.1 . 1 characterizes the behavior of the REINFORCE gradient of the VR-IWAE bound as N\to\infty for all \psi\in\{\phi_{1},\ldots,\phi_{b}\} . As we anticipated, the asymptotic behavior for \partial_{\psi}\ell^{(\alpha)}_{N}(\theta,\phi;x) described in ( 9 ) is independent of the reparameterization trick assumption when \psi\in\{\phi_{1},\ldots,\phi_{b}\} . Importantly, the proof technique differs substantially depending on whether this assumption is made or not since establishing 1 requires us to capture the behavior of the second term in the right-hand side of ( 7 ) (this type of term does not appear when the reparameterization trick assumption holds, see also 2 in the appendix for further comments on the proof details). In addition, 1 is the first asymptotic result in importance weighted VI which bypasses the reparameterization trick assumption and studies REINFORCE gradients taken with respect to \psi\in\{\phi_{1},\ldots,\phi_{b}\} as N\to\infty . For all \psi\in\{\phi_{1},\ldots,\phi_{b}\} , we have thus obtained that the REINFORCE gradient of the VR-IWAE bound converges to \partial_{\psi}\mathrm{VR}^{(\alpha)}(\theta,\phi;x) at a fast 1/N rate as N\to\infty , where the quantity \mathrm{VR}^{(\alpha)}(\theta,\phi;x) is exactly the targeted marginal log likelihood \ell(\theta;x) when \alpha=0 and corresponds otherwise to the Variational-Rényi (VR) bound ( 25 ) . We now discuss the methodological implications of 1 . 1 predicts that unbiased REINFORCE gradient estimators of the VR-IWAE bound based on ( 7 ) can be used to maximize the VR bound w.r.t. \phi when \alpha\in(0,1) . This in turn is expected to lead to better variational approximations of the posterior density than those based on the ELBO ( 25 ; 28 ; 32 ; 4 ; 27 ) . Furthermore, \partial_{\psi}\ell^{(\alpha)}_{N}(\theta,\phi;x) points in the direction which minimizes \gamma^{(0)}(\theta,\phi;x)^{2}=\mathbb{V}\left({p_{\theta}(z|x)}/{q_{\phi}(z|x)}\right) when \alpha=0 and \psi\in\{\phi_{1},\ldots,\phi_{b}\} (as \partial_{\psi}\mathrm{VR}^{(0)}(\theta,\phi;x)=\partial_{\psi}\ell(\theta;x)=0 ). The optimal \phi which minimizes \mathbb{V}\left({p_{\theta}(z|x)}/{q_{\phi}(z|x)}\right) is well-known to lead to the optimal importance sampling distribution in terms of estimating the marginal log likelihood ( 37 ; 38 ) . The minimization of \gamma^{(0)}(\theta,\phi;x)^{2} w.r.t. \phi drives q_{\phi}(\cdot|x) toward a mass-covering regime, thereby capturing regions of the posterior that the ELBO would typically neglect ( 43 ) . Hence, 1 motivates running SGA schemes based on ( 7 ) in order to learn the parameter \phi by maximizing the VR bound w.r.t. \phi when \alpha\in(0,1) and by minimizing \mathbb{V}\left({p_{\theta}(z|x)}/{q_{\phi}(z|x)}\right) w.r.t \phi when \alpha=0 . This approach is further motivated by the fact that we cannot readily propose unbiased REINFORCE gradient estimators of the VR bound to learn \phi since differentiating ( 10 ) w.r.t to \psi\in\{\phi_{1},\ldots,\phi_{b}\} yields \displaystyle\partial_{\psi}\mathrm{VR}^{(\alpha)}(\theta,\phi;x)=\frac{\alpha}{1-\alpha}\mathbb{E}\left(\frac{w_{\theta,\phi}(z;x)^{1-\alpha}}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})}\partial_{\psi}\log q_{\phi}(z|x)\right), (14) and the same conclusion holds for \gamma^{(0)}(\theta,\phi;x)^{2} . Note that ( 9 ) complements 1 and covers the learning of the parameter \theta , with SGA schemes based on ( 7 ) learning \theta via the maximization of the VR bound when \alpha\in(0,1) and of the marginal log likelihood when \alpha=0 . Consequently, identifying unbiased REINFORCE gradient estimators of the VR-IWAE bound will lead to unbiased SGA schemes that are expected to yield improved empirical results compared to SGA schemes based on the ELBO ( N=1 ). The next step is to establish a principled framework for designing such estimators. Achieving this will be central to the development of effective importance weighted VI algorithms based on the REINFORCE gradient of the VR-IWAE bound. 3.2 Estimating the Gradient of the VR-IWAE Bound We now seek to derive and study unbiased REINFORCE gradient estimators of the VR-IWAE bound. The first estimator we consider is \psi\text{-}g_{N}^{(\alpha,\mathrm{NAIVE})}(\theta,\phi;x) defined in ( 8 ) and we will assess the asymptotic efficiency of this estimator. Once more, the second term in the right-hand side of ( 8 ) cancels when \psi\in\{\theta_{1},\ldots,\theta_{a}\} . This case is already studied in 9 and we concentrate on the case \psi\in\{\phi_{1},\ldots,\phi_{b}\} in the following. We begin with a lemma focusing on the variance of the first term in the right-hand side of ( 8 ). Lemma 1 Let \psi\in\{\phi_{1},\ldots,\phi_{b}\} . Assume (A5) , (Ah) and ( ~ A h ′ ) with h,h^{\prime}>4 . Then, as N\to\infty , \mathbb{V}\left(\sum_{j=1}^{N}W_{\theta,\phi}^{(1-\alpha)}(z_{j};x)\partial_{\psi}\log w_{\theta,\phi}(z_{j};x)\right)\\ =\frac{1}{N}\mathbb{V}\left(\frac{w_{\theta,\phi}(z;x)^{1-\alpha}}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})}\left[\partial_{\psi}\log q_{\phi}(z|x)-\mathbb{E}\left(\frac{w_{\theta,\phi}(z;x)^{1-\alpha}}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})}\partial_{\psi}\log q_{\phi}(z|x)\right)\right]\right)+o\left(\frac{1}{N}\right). The proof of 1 is deferred to Section B.1 . We next study the variance of the second term in the right-hand side of ( 8 ) and use it to deduce the asymptotic behavior of \mathbb{V}(\psi\text{-}g_{N}^{(\alpha,\mathrm{NAIVE})}(\theta,\phi;x)) as N\to\infty when \psi\in\{\phi_{1},\ldots,\phi_{b}\} . Theorem 2 Let \psi\in\{\phi_{1},\ldots,\phi_{b}\} . Assume (A5) , (Ah) and ( ~ A h ′ ) with h>8 , h^{\prime}>4 . Then, as N\to\infty , \mathbb{V}\left(\left(\sum_{i=1}^{N}\partial_{\psi}\log q_{\phi}(z_{i}|x)\right)\log\left(\frac{1}{N}\sum_{j=1}^{N}{w_{\theta,\phi}(z_{j};x)^{1-\alpha}}\right)\right)\\ =N\mathbb{V}\left(\partial_{\psi}\log q_{\phi}(z|x)\right)\left(\log\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})\right)^{2}+o(N) and \displaystyle\mathbb{V}(\psi\text{-}g_{N}^{(\alpha,\mathrm{NAIVE})}(\theta,\phi;x))=\frac{N}{(1-\alpha)^{2}}\mathbb{V}\left(\partial_{\psi}\log q_{\phi}(z|x)\right)\left(\log\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})\right)^{2}+o(N). The proof of 2 is deferred to Section B.2 . 2 shows that the variance of the NAIVE gradient estimator ( 8 ) scales linearly with N when \psi\in\{\phi_{1},\ldots,\phi_{b}\} , which is a highly undesirable property for an importance weighted VI gradient estimator. Another way to express this negative result is through the Signal-to-Noise Ratio (SNR). Recalling that for a random variable X the SNR is given by \mathrm{SNR}[X]=|\mathbb{E}(X)|/\sqrt{\mathbb{V}(X)} , SNRs are used to evaluate whether the mean dominates the standard deviation. An unbiased gradient estimator is expected to be accurate if the SNR is high (so that the target dominates the additive stochastic error) and noisy otherwise. Pairing up ( 13 ) from 1 with 2 yields for all \psi\in\{\phi_{1},\ldots,\phi_{b}\} : as N\to\infty , \displaystyle\mathrm{SNR}[\psi\text{-}g_{N}^{(\alpha,\mathrm{NAIVE})}(\theta,\phi;x)]=\frac{1}{\sqrt{N}}\frac{|\partial_{\psi}\mathrm{VR}^{(\alpha)}(\theta,\phi;x)-\frac{1}{2N}\partial_{\psi}[\gamma^{(\alpha)}(\theta,\phi;x)^{2}]+o\left(\frac{1}{N}\right)|}{\sqrt{\frac{1}{(1-\alpha)^{2}}\mathbb{V}\left(\partial_{\psi}\log q_{\phi}(z|x)\right)\left(\log\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})\right)^{2}+o(1)}} meaning that when \psi\in\{\phi_{1},\ldots,\phi_{b}\} the SNR scales (i) as 1/\sqrt{N} if \partial_{\psi}\mathrm{VR}^{(\alpha)}(\theta,\phi;x)\neq 0 and (ii) as 1/{N^{3/2}} if \partial_{\psi}\mathrm{VR}^{(\alpha)}(\theta,\phi;x)=0 (as we mentioned earlier this situation arises when \alpha=0 ). Hence, the NAIVE gradient estimator defined in ( 8 ) is unusable in practice. Nevertheless, we know from 1 and 2 that the second term in the right-hand side of ( 8 ) is the one responsible for the large variance of the NAIVE gradient estimator when \psi\in\{\phi_{1},\ldots,\phi_{b}\} . This result suggests appealing to variance reduction schemes for the second term of this estimator in order to improve its asymptotic variance. Motivated by the work of 33 , we consider a variance-reduction strategy that adds per-sample baselines to the NAIVE gradient estimator ( 8 ) and extends the VIMCO gradient estimator of the IWAE bound ( 6 ) to the VR-IWAE bound. Namely, for all \alpha\in[0,1) and all \psi\in\{\theta_{1},\ldots,\theta_{a},\phi_{1},\ldots,\phi_{b}\} , we define the VIMCO gradient estimator of the VR-IWAE bound w.r.t. \psi as \psi\text{-}g_{N}^{(\alpha,\mathrm{VIMCO})}(\theta,\phi;x)=\sum_{j=1}^{N}W_{\theta,\phi}^{(1-\alpha)}(z_{j};x)\partial_{\psi}\log w_{\theta,\phi}(z_{j};x)\\ -\frac{1}{1-\alpha}\sum_{i=1}^{N}{\partial_{\psi}\log q_{\phi}(z_{i}|x)\log\left(1-W_{\theta,\phi}^{(1-\alpha)}(z_{i};x)+\frac{f_{-i}^{(\alpha)}(z_{1:N},\theta,\phi;x)}{\sum_{j=1}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}}\right)}, (15) where f_{-i}^{(\alpha)} denotes a nonnegative function of z_{1:N} , \theta , \phi and x that outputs a random variable which does not depend on z_{i} for all i=1\ldots N . Observing that for all i=1\ldots N -\log\left(1-W_{\theta,\phi}^{(1-\alpha)}(z_{i};x)+\frac{f_{-i}^{(\alpha)}(z_{1:N},\theta,\phi;x)}{\sum_{j=1}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}}\right)\\ =\log\left(\frac{1}{N}\sum_{j=1}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}\right)-\log\left(\frac{1}{N}\left(\sum_{\overset{j=1}{{j\neq i}}}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}+f_{-i}^{(\alpha)}(z_{1:N},\theta,\phi;x)\right)\right), the estimator ( 15 ) recovers ( 6 ) when \alpha=0 . Furthermore, it is an unbiased REINFORCE gradient estimator of the VR-IWAE bound w.r.t. \psi thanks to the use of the per-sample baseline \log(\sum_{{j=1},{j\neq i}}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}+f_{-i}^{(\alpha)}(z_{1:N},\theta,\phi;x)) for all i=1\ldots N . We now study its asymptotic variance when \psi\in\{\phi_{1},\ldots,\phi_{b}\} for key choices of f_{-i}^{(\alpha)}(z_{1:N},\theta,\phi;x) that will encompass and improve on the ones used in practice by 33 , starting with the case of the arithmetic mean. 3.2.1 Arithmetic mean (AM) gradient estimator Let \psi\text{-}g_{N}^{(\alpha,\mathrm{VIMCO\text{-}AM})}(\theta,\phi;x) denote the VIMCO gradient estimator which corresponds to taking f_{-i}^{(\alpha)}(z_{1:N},\theta,\phi;x)=(N-1)^{-1}\sum_{{j=1},{j\neq i}}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha} for all i=1\ldots N in ( 15 ). The theorem below captures its asymptotic variance as N\to\infty when \psi\in\{\phi_{1},\ldots,\phi_{b}\} . Theorem 3 Let \psi\in\{\phi_{1},\ldots,\phi_{b}\} . Assume (A5) , (Ah) and ( ~ A h ′ ) with h>8 , h^{\prime}>4 . Then, as N\to\infty , \displaystyle\mathbb{V}\left(\psi\text{-}g_{N}^{(\alpha,\mathrm{VIMCO\text{-}AM})}(\theta,\phi;x)\right)=\frac{1}{N}\psi\text{-}V^{(\alpha,\mathrm{VIMCO\text{-}AM})}(\theta,\phi;x)+o\left(\frac{1}{N}\right) where \psi\text{-}V^{(\alpha,\mathrm{VIMCO\text{-}AM})}(\theta,\phi;x)=\frac{1}{(1-\alpha)^{2}}\mathbb{V}\left(\alpha\frac{w_{\theta,\phi}(z;x)^{1-\alpha}}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})}\biggl[\partial_{\psi}\log q_{\phi}(z|x)\right.\\ \left.-\mathbb{E}\left(\frac{w_{\theta,\phi}(z;x)^{1-\alpha}}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})}\partial_{\psi}\log q_{\phi}(z|x)\right)\biggr]-\partial_{\psi}\log q_{\phi}(z|x)\right). The proof of 3 is deferred to Section B.3 . 3 shows that introducing per-sample baselines in the NAIVE gradient estimator ( 8 ) as done in the gradient estimator \psi\text{-}g_{N}^{(\alpha,\mathrm{VIMCO\text{-}AM})}(\theta,\phi;x) provably leads to a substantial variance reduction phenomenon. 33 foresaw that the use of per-sample baselines could lead to a large variance reduction phenomenon in the particular case of the IWAE bound ( \alpha=0 ). Their intuition when proposing VIMCO gradient estimators was that (i) the NAIVE gradient estimator of the IWAE bound (obtained by taking \alpha=0 in ( 8 )) should not be used in practice due to its high variance (ii) introducing global baselines could address the variance of the NAIVE gradient estimator of the IWAE bound and (iii) further variance reduction could be achieved by introducing baselines that ensure all samples in a set of N samples do not have the same learning signal. They concluded that one should rely on per-sample baselines and appeal to VIMCO gradient estimators of the IWAE bound of the form ( 6 ). The claims described above appeared in 33 without proof. Our work bridges the theoretical gap left in their work for the IWAE bound and applies to the general VR-IWAE bound. Indeed, 2 demonstrates that the NAIVE gradient estimator ( 8 ) should not be used in practice due to its high asymptotic variance when \psi\in\{\phi_{1},\ldots,\phi_{b}\} . As for 3 , it is the first theoretical result showcasing how the use of per-sample baselines is an effective strategy for variance reduction purposes in importance weighted VI. As a side remark, we note that the VIMCO-AM gradient estimator can be constructed as the logical estimator with per-sample baselines to build from an intermediate estimator with a global baseline and a higher asymptotic variance (see 3 in the appendix for details). 3.2.2 Geometric mean (GM) gradient estimator Let \psi\text{-}g_{N}^{(\alpha,\mathrm{VIMCO\text{-}GM})}(\theta,\phi;x) denote the VIMCO gradient estimator which corresponds to taking f_{-i}^{(\alpha)}(z_{1:N},\theta,\phi;x)=\exp((N-1)^{-1}\sum_{{j=1},{j\neq i}}^{N}\log[w_{\theta,\phi}(z_{j};x)^{1-\alpha}]) for all i=1\ldots N in ( 15 ). The following theorem studies its asymptotic variance as N\to\infty when \psi\in\{\phi_{1},\ldots,\phi_{b}\} . Theorem 4 Let \psi\in\{\phi_{1},\ldots,\phi_{b}\} . Assume (A5) , (Ah) and ( ~ A h ′ ) with h>8,h^{\prime}>8 . Further assume that \mathbb{E}(|\log w_{\theta,\phi}(z;x)|^{h^{\prime\prime}})<\infty and \mathbb{E}(|\log w_{\theta,\phi}(z;x)\partial_{\psi}\log q_{\phi}(z|x)|^{h^{\prime\prime\prime}})<\infty with h^{\prime\prime}>4 and h^{\prime\prime\prime}>8 . Then, as N\to\infty , \displaystyle\mathbb{V}\left(\psi\text{-}g_{N}^{(\alpha,\mathrm{VIMCO\text{-}GM})}(\theta,\phi;x)\right)=\frac{\psi\text{-}V^{(\alpha,\mathrm{VIMCO\text{-}GM})}(\theta,\phi;x)}{N}+o\left(\frac{1}{N}\right) with \psi\text{-}V^{(\alpha,\mathrm{VIMCO\text{-}GM})}(\theta,\phi;x)=\frac{1}{(1-\alpha)^{2}}\mathbb{V}\left(\alpha\frac{w_{\theta,\phi}(z;x)^{1-\alpha}}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})}\biggl[\partial_{\psi}\log q_{\phi}(z|x)\right.\\ \left.-\mathbb{E}\left(\frac{w_{\theta,\phi}(z;x)^{1-\alpha}}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})}\partial_{\psi}\log q_{\phi}(z|x)\right)\biggr]-\frac{\exp[(1-\alpha)\mathbb{E}(\log w_{\theta,\phi}(z;x))]}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})}\partial_{\psi}\log q_{\phi}(z|x)\right). The proof of 4 is deferred to Section B.4 . 4 shows that the VIMCO-GM gradient estimator significantly improves on the NAIVE gradient estimator ( 8 ) in terms of asymptotic variance and futher demonstrates how subtracting a well-chosen per-sample baseline is an effective strategy for variance reduction purposes in importance weighted VI. Furthermore, 3 and 4 yield that the comparison between the VIMCO-AM and the VIMCO-GM gradient estimators boils down asymptotically to the comparison between the two quantities \psi\text{-}V^{(\alpha,\mathrm{VIMCO\text{-}AM})}(\theta,\phi;x) and \psi\text{-}V^{(\alpha,\mathrm{VIMCO\text{-}GM})}(\theta,\phi;x) . The case \alpha=0 is particularly interpretable here, since Jensen’s inequality implies \displaystyle\psi\text{-}V^{(0,\mathrm{VIMCO\text{-}GM})}(\theta,\phi;x) \displaystyle=\left(\frac{\exp[\mathbb{E}(\log w_{\theta,\phi}(z;x))]}{\mathbb{E}(w_{\theta,\phi}(z;x))}\right)^{2}\psi\text{-}V^{(0,\mathrm{VIMCO\text{-}AM})}(\theta,\phi;x) \displaystyle\leq\psi\text{-}V^{(0,\mathrm{VIMCO\text{-}AM})}(\theta,\phi;x), so that the asymptotic variance of the VIMCO-GM gradient estimator is provably lower than the one of the VIMCO-AM gradient estimator when \alpha=0 and \psi\in\{\phi_{1},\ldots,\phi_{b}\} . This result notably provides a theoretical justification for the empirical observations reported in 33 , according to which the VIMCO-GM gradient estimator performs slightly better empirically than the VIMCO-AM one when \alpha=0 (IWAE setting). Furthermore, we argue that 3 and 4 yield a much deeper understanding of REINFORCE gradient estimators with per-sample baselines that goes beyond the considerations made in 33 . Indeed, casting the results we obtained in terms of SNRs, we get from 1 , 3 and 4 that for all \psi\in\{\phi_{1},\ldots,\phi_{b}\} and all \alpha\in[0,1) : as N\to\infty , \displaystyle\mathrm{SNR}[\psi\text{-}g_{N}^{(\alpha,\mathrm{VIMCO\text{-}AM})}(\theta,\phi;x)]=\sqrt{N}\dfrac{\left|\partial_{\psi}\mathrm{VR}^{(\alpha)}(\theta,\phi;x)-\frac{1}{2N}\partial_{\psi}[\gamma^{(\alpha)}(\theta,\phi;x)^{2}]+o\left(\frac{1}{N}\right)\right|}{\sqrt{\psi\text{-}V^{(\alpha,\mathrm{VIMCO\text{-}AM})}(\theta,\phi;x)}+o(1)} (16) \displaystyle\mathrm{SNR}[\psi\text{-}g_{N}^{(\alpha,\mathrm{VIMCO\text{-}GM})}(\theta,\phi;x)]=\sqrt{N}\dfrac{\left|\partial_{\psi}\mathrm{VR}^{(\alpha)}(\theta,\phi;x)-\frac{1}{2N}\partial_{\psi}[\gamma^{(\alpha)}(\theta,\phi;x)^{2}]+o\left(\frac{1}{N}\right)\right|}{\sqrt{\psi\text{-}V^{(\alpha,\mathrm{VIMCO\text{-}GM})}(\theta,\phi;x)}+o(1)}. (17) Consequently, when \psi\in\{\phi_{1},\ldots,\phi_{b}\} , the SNR of the VIMCO-AM and VIMCO-GM gradient estimators scale as \sqrt{N} for all \alpha\in(0,1) while they scale as 1/\sqrt{N} for \alpha=0 . This result is remarkable since it shows that the use of the VIMCO-AM and VIMCO-GM gradient estimators with \alpha=0 as done in 33 can be detrimental to the process of learning \phi by degrading the SNR of these gradient estimators as N increases. Moreover, taking \alpha\in(0,1) in the VIMCO-AM and VIMCO-GM gradient estimators overcomes this issue, which highlights how the tuning of \alpha in the VR-IWAE bound can lead to more effective REINFORCE gradient estimators within importance weighted VI. We have thus obtained that (i) selecting \alpha\in(0,1) ensures a proper learning of \phi as N increases for the VIMCO-AM and VIMCO-GM gradient estimators and (ii) asymptotically, comparing these two gradient estimators amounts to comparing \psi\text{-}V^{(\alpha,\mathrm{VIMCO\text{-}AM})}(\theta,\phi;x) and \psi\text{-}V^{(\alpha,\mathrm{VIMCO\text{-}GM})}(\theta,\phi;x) . Yet, apart from the case \alpha=0 which itself suffers from degrading SNRs as N increases, it remains unclear when – if ever – one estimator prevails over the other. This leads us to the next subsection. 3.2.3 Beyond the VIMCO-AM and VIMCO-GM gradient estimators The VIMCO-AM and VIMCO-GM gradient estimators are but two options within the family of REINFORCE gradient estimators of the VR-IWAE bound that appeal to per-sample baselines ( 15 ). Our claim is that we can further exploit ( 15 ) to derive novel gradient estimators which outperform the VIMCO-AM and VIMCO-GM gradient estimators. The theorem below encapsulates the central insight which will permit us to do so. Theorem 5 Let \psi\in\{\phi_{1},\ldots,\phi_{b}\} . Assume (A5) , (Ah) and ( ~ A h ′ ) with h>8 , h^{\prime}>4 . Furthermore, assume that f_{-i}^{(\alpha)}(z_{1:N},\theta,\phi;x) is constant and equal to \eta\geq 0 for all i=1\ldots N in ( 15 ). Then, as N\to\infty , \displaystyle\mathbb{V}\left(\psi\text{-}g_{N}^{(\alpha,\mathrm{VIMCO})}(\theta,\phi;x)\right)=\frac{\psi\text{-}V^{(\alpha,\mathrm{VIMCO})}(\theta,\phi;x)}{N}+o\left(\frac{1}{N}\right), where \psi\text{-}V^{(\alpha,\mathrm{VIMCO})}(\theta,\phi;x)=\frac{1}{(1-\alpha)^{2}}\mathbb{V}\left(\alpha\frac{w_{\theta,\phi}(z;x)^{1-\alpha}}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})}\biggl[\partial_{\psi}\log q_{\phi}(z|x)\right.\\ \left.-\mathbb{E}\left(\frac{w_{\theta,\phi}(z;x)^{1-\alpha}}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})}\partial_{\psi}\log q_{\phi}(z|x)\right)\biggr]-\frac{\eta\partial_{\psi}\log q_{\phi}(z|x)}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})}\right). The proof of this result is deferred to Section B.5 . 5 considers the simplified setting where f_{-i}^{(\alpha)}(z_{1:N},\theta,\phi;x) is constant for all i=1\ldots N in ( 15 ), in which case the asymptotic behavior of \mathbb{V}(\psi\text{-}g_{N}^{(\alpha,\mathrm{VIMCO})}(\theta,\phi;x)) as N\to\infty is known when \psi\in\{\phi_{1},\ldots,\phi_{b}\} . Crucially, we recover quantities from our earlier analyses of the VIMCO-AM and VIMCO-GM gradient estimators for selected values of \eta : denoting \eta^{(\alpha,\mathrm{AM})}=\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha}) and \eta^{(\alpha,\mathrm{GM})}=\exp[(1-\alpha)\mathbb{E}(\log w_{\theta,\phi}(z;x))] , we have that \displaystyle\psi\text{-}V^{(\alpha,\mathrm{VIMCO})}(\theta,\phi;x)=\begin{cases}\psi\text{-}V^{(\alpha,\mathrm{VIMCO\text{-}AM})}(\theta,\phi;x)&\mbox{if $\eta=\eta^{(\alpha,\mathrm{AM})}$}\\ \psi\text{-}V^{(\alpha,\mathrm{VIMCO\text{-}GM})}(\theta,\phi;x)&\mbox{if $\eta=\eta^{(\alpha,\mathrm{GM})}$}.\\ \end{cases} We can thus revisit the VIMCO-AM and VIMCO-GM gradient estimators through the angle of 5 by observing that the choices of f_{-i}^{(\alpha)}(z_{1:N},\theta,\phi;x) made in these estimators are the almost sure limit of a specific value of \eta , that is, \eta^{(\alpha,\mathrm{AM})} and \eta^{(\alpha,\mathrm{GM})} respectively. As it turns out, the optimal value of \eta in 5 can be found. More precisely, it is not equal to either \eta^{(\alpha,\mathrm{AM})} or \eta^{(\alpha,\mathrm{GM})} and assuming that {\mathbb{V}(\partial_{\psi}\log q_{\phi}(z|x))}>0 it reads \displaystyle\eta^{(\alpha,\star)}=\frac{\mathbb{C}\mathrm{ov}\left(\alpha w_{\theta,\phi}(z;x)^{1-\alpha}\biggl[\partial_{\psi}\log q_{\phi}(z|x)-\mathbb{E}\left(\frac{w_{\theta,\phi}(z;x)^{1-\alpha}}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})}\partial_{\psi}\log q_{\phi}(z|x)\right)\biggr],\partial_{\psi}\log q_{\phi}(z|x)\right)}{\mathbb{V}(\partial_{\psi}\log q_{\phi}(z|x))} (18) with \eta^{(\alpha,\star)}\geq 0 (the covariance term in ( 18 ) is nonnegative since the Cauchy-Schwartz inequality yields \mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha}\partial_{\psi}\log q_{\phi}(z|x))^{2}\leq\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})\mathbb{E}\left(w_{\theta,\phi}(z;x)^{1-\alpha}\partial_{\psi}\log q_{\phi}(z|x)^{2}\right) ). This brings us to consider the novel estimator given for all \alpha\in[0,1) and all \psi\in\{\theta_{1},\ldots,\theta_{b},\phi_{1},\ldots,\phi_{b}\} by \psi\text{-}g_{N}^{(\alpha,\mathrm{VIMCO\text{-}\star})}(\theta,\phi;x)=\sum_{j=1}^{N}W_{\theta,\phi}^{(1-\alpha)}(z_{j};x)\partial_{\psi}\log w_{\theta,\phi}(z_{j};x)\\ -\frac{1}{1-\alpha}\sum_{i=1}^{N}{\partial_{\psi}\log q_{\phi}(z_{i}|x)\log\left(1-W_{\theta,\phi}^{(1-\alpha)}(z_{i};x)+\frac{f_{-i}^{(\alpha,\star)}(z_{1:N},\theta,\phi;x)}{\sum_{j=1}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}}\right)} (19) where f_{-i}^{(\alpha,\star)}(z_{1:N},\theta,\phi;x) is assumed to converge almost surely to \eta^{(\alpha,\star)} and to not depend on z_{i} for all i=1\ldots N . For instance, and in line with the per-sample baselines used for the VIMCO-AM and VIMCO-GM gradient estimator, we can set \displaystyle f_{-i}^{(\alpha,\star)}(z_{1:N},\theta,\phi;x)=\alpha\penalty\ \frac{a_{-i,1,2}^{(\alpha)}(z_{1:N},\theta,\phi;x)-\frac{a_{-i,1,1}^{(\alpha)}(z_{1:N},\theta,\phi;x)^{2}}{a_{-i,1,0}^{(\alpha)}(z_{1:N},\theta,\phi;x)}}{a_{-i,0,2}^{(\alpha)}(z_{1:N},\theta,\phi;x)-(a_{-i,0,1}^{(\alpha)}(z_{1:N},\theta,\phi;x))^{2}} (20) where we have defined for all i=1\ldots N and all nonegative integer k and \ell \displaystyle a_{-i,k,\ell}^{(\alpha)}(z_{1:N},\theta,\phi;x)=\frac{1}{N-1}\sum_{j=1,j\neq i}^{N}(w_{\theta,\phi}(z_{j};x)^{1-\alpha})^{k}(\partial_{\psi}\log q_{\phi}(z_{j}|x))^{\ell}. In the spirit of control variates, another option is to estimate \eta^{(\alpha,\star)} using the z -sample generated at the previous iteration of the VI optimization procedure (that is, the previous iteration of the SGA scheme based on the VIMCO- \star gradient estimator). The choices of f_{-i}^{(\alpha,\star)}(z_{1:N},\theta,\phi;x) we just described can in principle be analyzed using proof techniques similar to those developed for the VIMCO-AM and VIMCO-GM gradient estimators. Yet, the derivations are lengthy and the resulting characterization is expected to be consistent with earlier findings, in the sense that when \alpha\in(0,1) and \psi\in\{\phi_{1},\ldots,\phi_{b}\} the following holds as N\to\infty \displaystyle\mathbb{V}(\psi\text{-}g_{N}^{(\alpha,\mathrm{VIMCO\text{-}\star})}(\theta,\phi;x))=\frac{\psi\text{-}V^{(\alpha,\mathrm{VIMCO\text{-}\star})}(\theta,\phi;x)}{N}+o\left(\frac{1}{N}\right), (21) where \psi\text{-}V^{(\alpha,\mathrm{VIMCO\text{-}\star})}(\theta,\phi;x)=\psi\text{-}V^{(\alpha,\mathrm{VIMCO})}(\theta,\phi;x) with \eta=\eta^{(\alpha,\star)} for all \alpha\in(0,1) . For this reason, the derivations are not included in the paper and we focus instead on the take-away message from ( 21 ), which is that the VIMCO- \star gradient estimator enjoys the best asymptotic efficiency by design compared to the VIMCO-AM and VIMCO-GM ones when \alpha\in(0,1) . Note that we intentionally left out the case \alpha=0 in ( 21 ). When \alpha=0 , \eta^{(\alpha,\star)}=0 , so that no approximation of \eta^{(\alpha,\star)} is needed and we can directly take f_{-i}^{(\alpha,\star)}(z_{1:N},\theta,\phi;x)=0 in ( 19 ). Besides advantageous computational considerations (which are discussed later in Section 3.3 ), the case \alpha=0 is of primary interest in the VIMCO- \star gradient estimator since, as established in the next theorem, the behavior of this gradient estimator substantially departs from the earlier results we established for the VIMCO-AM and VIMCO-GM ones when \alpha=0 . Theorem 6 Let \psi\in\{\phi_{1},\ldots,\phi_{b}\} . Assume (A5) , (Ah) and ( ~ A h ′ ) with h>12 , h^{\prime\prime}>4 . Then, as N\to\infty , \displaystyle\mathbb{V}\left(\psi\text{-}g_{N}^{(0,\mathrm{VIMCO\text{-}\star})}(\theta,\phi;x)\right)=\frac{\psi\text{-}V^{(0,\mathrm{VIMCO\text{-}\star})}(\theta,\phi;x)}{N^{3}}+o\left(\frac{1}{N^{3}}\right) where \psi\text{-}V^{(0,\mathrm{VIMCO\text{-}\star})}=\mathbb{V}\left(\frac{w_{\theta,\phi}(z;x)^{2}\partial_{\psi}\log q_{\phi}(z|x)}{2\mathbb{E}(w_{\theta,\phi}(z;x))^{2}}\right.\left.-w_{\theta,\phi}(z;x)\frac{\mathbb{E}(w_{\theta,\phi}(z;x)^{2}\partial_{\psi}\log q_{\phi}(z|x))}{\mathbb{E}(w_{\theta,\phi}(z;x))^{3}}\right). The proof of 6 is deferred to Section B.6 . 6 shows that the variance of our novel VIMCO- \star gradient estimator converges to 0 at a 1/N^{3} convergence rate when \alpha=0 and \psi\in\{\phi_{1},\ldots,\phi_{b}\} . For all \psi\in\{\phi_{1},\ldots,\phi_{b}\} , 1 and 6 then yield: as N\to\infty , \displaystyle\mathrm{SNR}[\psi\text{-}g_{N}^{(0,\mathrm{VIMCO\text{-}\star})}(\theta,\phi;x)]=\sqrt{N}\dfrac{|\frac{1}{2}\partial_{\psi}[\gamma^{(0)}(\theta,\phi;x)^{2}]+o\left(1\right)|}{\sqrt{\psi\text{-}V^{(0,\mathrm{VIMCO\text{-}\star})}(\theta,\phi;x)}+o(1)}. (22) The VIMCO- \star gradient estimator benefits from increasing N when \alpha=0 and \psi\in\{\phi_{1},\ldots,\phi_{b}\} : its SNR rate scales as \sqrt{N} thanks to its variance decaying at a fast 1/N^{3} rate and compensating for the fact that its expectation decays at a 1/N rate. The SNR rate ( 22 ) is in stark contrast with the 1/\sqrt{N} SNR rates for the VIMCO-AM and VIMCO-GM gradient estimators derived in ( 16 ) and ( 17 ) respectively when \alpha=0 . When \alpha=0 and \psi\in\{\phi_{1},\ldots,\phi_{b}\} , the VIMCO- \star gradient estimator points in expectation in the direction that minimizes \mathbb{V}\left({p_{\theta}(z|x)}/{q_{\phi}(z|x)}\right) w.r.t \phi and resolves the counterintuitive behavior of the state-of-the-art estimators proposed in 33 (which are obtained by taking \alpha=0 in the VIMCO-AM and VIMCO-GM gradient estimators). Our asymptotic analyses suggest that the VIMCO- \star gradient estimator is the REINFORCE gradient estimator of the VR-IWAE bound which, unlike the VIMCO-AM and VIMCO-GM gradient estimators, fully leverages the importance weighted VI framework. We can reinforce this conclusion by considering the setting where we are at optimality, that is, q_{\phi}(\cdot|x)=p_{\theta}(\cdot|x) . Letting f_{-i}^{(\alpha,\star)}(z_{1:N},\theta,\phi;x) in ( 19 ) be as in ( 20 ) (or using its control variates-based alternative), it holds that: for all N\in\mathbb{N}^{\star} , all \alpha\in[0,1) and all \psi\in\{\phi_{1},\ldots,\phi_{b}\} , \displaystyle\mathbb{V}\left(\psi\text{-}g_{N}^{(\alpha,\mathrm{VIMCO\text{-}AM})}(\theta,\phi;x)\right)=\mathbb{V}\left(\psi\text{-}g_{N}^{(\alpha,\mathrm{VIMCO\text{-}GM})}(\theta,\phi;x)\right)=\frac{1}{N}\mathbb{V}(\partial_{\psi}\log q_{\phi}(z|x)) (23) \displaystyle\mathbb{V}\left(\psi\text{-}g_{N}^{(\alpha,\mathrm{VIMCO\text{-}\star})}(\theta,\phi;x)\right)=\frac{1}{N}\left[1+\frac{N}{1-\alpha}\log\left(1-\frac{1-\alpha}{N}\right)\right]^{2}\mathbb{V}(\partial_{\psi}\log q_{\phi}(z|x)). (24) The non-asymptotic results ( 23 ) and ( 24 ) indicate that the variance of the VIMCO- \star gradient estimator is significantly lower than the variance of the VIMCO-AM and VIMCO-GM ones at optimality for all N>2 , all \alpha\in[0,1) and all \psi\in\{\phi_{1},\ldots,\phi_{b}\} . As a result, we anticipate the VIMCO- \star gradient estimator to outperform the VIMCO-AM and VIMCO-GM ones as the variational distribution starts to closely match the posterior distribution and/or N increases. To the best of our knowledge, the VIMCO- \star estimator is the first REINFORCE gradient estimator within the importance weighted VI framework whose use is theoretically supported accross all values of \alpha\in[0,1) not only in terms of asymptotic efficiency as N\to\infty but also in terms of non-asymptotic efficiency at optimality. 3.3 Practical considerations The theoretical results we established for the VIMCO gradient estimator of the VR-IWAE bound ( 15 ) permit to identify key quantities of interest whose behavior as a function of (N,\alpha) determines how this gradient estimator learns the parameter \phi . Our theoretical results can be paired up with the ones obtained for the learning of \theta in 9 to obtain practical guidance for empirically selecting (N,\alpha,f_{-i}^{(\alpha)}) in ( 15 ). More specifically, 1 and Theorem 1 from 9 (see ( 9 )) suggest increasing N beyond N=1 (ELBO) and taking \alpha=0 in order to learn (\theta,\phi) . Indeed, when \alpha=0 , the gradient estimator ( 15 ) points in expectation at a quick 1/N rate in the direction which maximizes the marginal log likelihood w.r.t. \theta , while simultaneously optimizing q_{\phi}(\cdot|x) toward the optimal importance sampling density ( 37 ) . Doing so also tightens the VR-IWAE bound by ( 3 ) and ( 4 ). 6 , 4 , 4 , 5 and 3 and Theorem 2 from 9 demonstrate that increasing N yields a variance reduction phenomenon for the gradient estimator ( 15 ) in many instances, which further motivates increasing N in practice so long as this variance reduction occurs sufficiently rapidly to avoid vanishing SNRs. These results also indicate that the case \alpha=0 is not guaranteed to achieve the lowest asymptotic variance within the range \alpha\in[0,1) for the gradient estimator ( 15 ). This can be attributed to complex dependencies in \alpha appearing in quantities such as \psi\text{-}V^{(\alpha,\mathrm{VIMCO\text{-}\star})} when \psi\in\{\theta_{1},\ldots,\theta_{a}\} the asymptotic variance of the gradient estimator ( 15 ) scales as \psi\text{-}V^{(\alpha)}(\theta,\phi;x)/N where \psi\text{-}V^{(\alpha)}(\theta,\phi;x) depends nontrivially on \alpha , see 9 . In addition, the non-asymptotic variance of the VIMCO- \star gradient estimator decreases monotonically as \alpha increases at optimality when \psi\in\{\phi_{1},\ldots,\phi_{b}\} by ( 24 ), which illustrates how setting \alpha=0 does not generally lead to the lowest variance for the gradient estimator ( 15 ). At this stage, we see that the choice of (N,\alpha,f_{-i}^{(\alpha)}) controls two distinct mechanisms. Firstly, increasing N reduces the bias of the VR-IWAE bound relative to the marginal log-likelihood and the variance of its gradient estimator ( 15 ). While these gains can be accompanied by a decay of the SNR as N increases, this effect is not inherent to N itself (nor \alpha ): selecting f_{-i}^{(\alpha)} appropriately leads to SNRs that scale as \sqrt{N} . Secondly, the parameter \alpha governs a bias-variance trade-off. Although small values of \alpha , and in particular \alpha=0 , are preferable from a bias standpoint, they may lead to a large variance in the early stages of the optimization procedure when the variational approximation is inaccurate. A natural strategy is therefore to (i) select f_{-i}^{(\alpha)} in the gradient estimator ( 15 ) such that its SNR scales at a fast \sqrt{N} rate and (ii) initialize the resulting algorithm to account for a potentially high mismatch between the posterior density and its variational approximation. We elaborate on the aspects (i) and (ii) below. 3.3.1 Selecting f_{-i}^{(\alpha)} in the VIMCO gradient estimator ( 15 ) The VIMCO- \star gradient estimator ( 19 ) is the preferred choice over the VIMCO-AM and VIMCO-GM ones: for all \alpha\in[0,1) , this estimator is designed to have the best asymptotic variance within the framework of ( 15 ), it enjoys an asymptotic SNR rate that scales as \sqrt{N} and its non-asymptotic variance decays quicker than 1/N with N at optimality. We now adress the issue of the computational cost to evaluate this estimator. One core advantage of the VIMCO- \star gradient estimator lies in its ease of implementation and computational efficiency when \alpha=0 as ( 19 ) then reads \psi\text{-}g_{N}^{(0,\mathrm{VIMCO\text{-}\star})}(\theta,\phi;x)=\sum_{j=1}^{N}\left[W_{\theta,\phi}^{(0)}(z_{j};x)\partial_{\psi}\log w_{\theta,\phi}(z_{j};x)\right.\\ \left.-\log(1-W_{\theta,\phi}^{(0)}(z_{j};x))\partial_{\psi}\log q_{\phi}(z_{j}|x)\right]. A computational bottleneck may arise when \alpha\in(0,1) since estimating \eta^{(\alpha,\star)} in ( 18 ) in a cheap yet accurate manner becomes central to the VIMCO- \star approach in this case. The two options we suggested, namely ( 20 ) and a control variates alternative, both use a z -samples of size N . A direct way to bring down the computational cost is to use a subsample of size N_{0}0 , all three gradient estimators exhibit an \sqrt{N} scaling of the SNR. In contrast, when \alpha=0 , only VIMCO- \star retains the \sqrt{N} SNR scaling, whereas the SNR of VIMCO-AM and VIMCO-GM decays at the slow rate of 1/\sqrt{N} . In addition, larger values of \alpha lead to faster convergence to the asymptotic regime, in the sense that smaller values of N are sufficient to achieve the predicted SNR scaling. Across all values of \alpha , VIMCO- \star consistently attains the highest SNR among the three estimators. VIMCO-GM generally outperforms VIMCO-AM in terms of SNR, although this advantage diminishes as \alpha increases. Figure 2 displays the results for the case \phi=0.1 . As in the distant regime, all gradient estimators closely follow their theoretical asymptotic predictions for sufficiently large N . Compared with the distant setting, the performance gap between VIMCO-AM and VIMCO-GM is substantially reduced, whereas VIMCO- \star continues to outperform the other two estimators by a wide margin across all values of \alpha . The case \alpha=0 is particularly illuminating in the near-optimal regime \phi=0.1 . Indeed, the magnitude of the gradient is small in this regime, which exacerbates the instability of the VIMCO-AM and VIMCO-GM gradient estimates due to their comparatively high variance. This instability presents a practical challenge for evaluating the SNR when \alpha=0 , addressed in Figure 2 by computing the SNR using the mean gradient estimates obtained from VIMCO- \star when \alpha=0 (since all the estimators considered are unbiased and thus share an identical expectation). Figure 3 further examines the behavior of the gradient estimators in the case \alpha=0 . We first consider the near-optimal regime where \phi=0.1 . As discussed above, VIMCO-AM and VIMCO-GM fail to yield reliable gradient estimates in this regime, whereas VIMCO- \star produces stable and accurate estimates that closely match the theoretical prediction of a 1/N convergence rate. As for the standard deviations, VIMCO-AM and VIMCO-GM both exhibit a 1/\sqrt{N} rate, while VIMCO- \star achieves the faster rate of 1/N^{3/2} . Consequently, relative to VIMCO- \star , the gradients obtained from VIMCO-AM and VIMCO-GM are substantially noisier, limiting their effectiveness as optimization directions, particularly when the variational approximation is close to the target distribution. The right panel of Figure 3 reports the absolute difference |\phi-\theta| along the optimization trajectories of the three methods. Although all methods behave similarly in the initial phase, the trajectories driven by VIMCO-AM and VIMCO-GM quickly plateau upon entering the near-optimal region. In contrast, optimization based on VIMCO- \star continues to make progress until reaching machine precision. 4.2 Variational Bayesian inference for State-Space models Letting \{x_{t}\}_{t\geq 1} be a time series of observations, state-space models (SSMs) use a sequence of latent variables \{y_{t}\}_{t\geq 1} to explain the dynamics of the observations by assuming that: for all t\geq 1 , x_{t}|y_{t}\sim g_{t}(x_{t}|y_{t},z) , where y_{t} follow a Markov chain y_{t}|y_{t-1}\sim f_{t}(y_{t}|y_{t-1},z) , t\geq 2 with initial state y_{1}\sim\mu_{z} and z denotes the model parameters. Given a training data set x=x_{1:T} of size T and denoting y=y_{1:T} , the likelihood function \displaystyle p(x|z)=\int p(x|y,z)p(y|z)\mathrm{d}y \displaystyle\mbox{where}\quad p(x|y,z)=\prod_{t=1}^{T}g_{t}(x_{t}|y_{t},z),\;\;p(y|z)=\mu_{z}(y_{1})\prod_{t=2}^{T}f_{t}(y_{t}|y_{t-1},z), is intractable except for a few trivial cases, making it challenging to perform Bayesian inference about z . Nevertheless, this issue can be circumvented by constructing an unbiased particle filter estimator \widehat{p}_{\mathrm{PF}}(x|z) of the intractable likelihood p(x|z) ( 11 ) . A VI approach can then be employed, in which the target density is an approximation of the posterior density p(z|x) where the likelihood has been replaced by its unbiased estimator \widehat{p}_{\mathrm{PF}}(x|z) ( 45 ) . As the particle filter estimator \widehat{p}_{\mathrm{PF}}(x|z) is often not differentiable with respect to z ( 26 ) , this prevents the use of reparameterized gradient estimators in VI methods. We consider the stochastic volatility model, an important example within the class of state space models, and our goal is to approximate the parameter posterior p(z|x) (rather than the latent variable posterior p_{\theta}(z|x) ) using importance weighted VI \displaystyle x_{t}|y_{t} \displaystyle\sim\mathcal{N}(0,\exp(y_{t})) \displaystyle y_{t}|y_{t-1} \displaystyle\sim\mathcal{N}\left(\beta_{0}+\beta_{1}(y_{t-1}-\beta_{0}),\sigma^{2}\right),\;\;t\geq 2,\;\;y_{1}\sim\mathcal{N}\left(\beta_{0},\frac{\sigma^{2}}{1-\beta_{1}^{2}}\right), with \beta_{0}\in\mathbb{R} , \beta_{1}\in(-1,1) and \sigma^{2}>0 . More precisely, following 45 , we use the daily exchange rates for the Australian Dollar/U.S. Dollar from 5/1/2010 to 31/12/2013 (further details, including the prior and the particle filter algorithm, can be found in their paper). The target density is the posterior density p(z|x) in which the likelihood has been replaced by its unbiased estimator \widehat{p}_{\mathrm{PF}}(x|z) and the transformed parameters are z=(\beta_{0},\log((1-\beta_{1})/(1+\beta_{1})),\log\sigma^{2})\in\mathbb{R}^{3} . The variational approximation q_{\phi}(z|x) is a Gaussian \mathcal{N}(x;\mu,\Sigma) where \phi=(\mu,\Sigma) belongs to the product manifold \mathbb{R}^{d}\otimes\mathbb{S}^{d}_{++} and \mathbb{S}^{d}_{++} is the manifold of positive definite matrices. We then apply the manifold VI algorithm of 44 adapted to the VR-IWAE bound framework to optimize \phi (which compared to traditional SGA amounts to first projecting VIMCO gradient estimates w.r.t. \Sigma on the tangent spaces to get Riemannian gradients, before updating \phi ). We report the data analysis results for the original parameters \beta_{0} , \beta_{1} and \sigma^{2} . Figure 4 shows the marginal posterior estimates obtained by using the VIMCO- \star gradient estimator with N=500 and the annealing strategy for \alpha described in Section 3.3.2 . It compares those marginals to the ones obtained by using the standard ELBO version of the manifold VI algorithm from ( 45 ) and the pseudo-marginal MCMC (PMCMC) method of 1 . As PMCMC can sample from the exact posterior even when the likelihood function is replaced by a non-negative and unbiased estimator, it can be seens as the ground truth. Observe then that the ELBO approach substantially underestimates the posterior variance, while our VR-IWAE bound approach corrects this underestimation and produces estimates that align more closely with the PMCMC benchmark. Figure 4: Final marginal posterior estimates in the Variational Bayesian SSMs example. Additional empirical results deferred to Section C.2 show that the SNR of the VIMCO-AM, VIMCO-GM and VIMCO- \star gradient estimators match the theoretical behavior predicted in Section 3.2 as N increases for various values of \alpha and \phi , which also translates into a faster convergence of the algorithms that use the VIMCO- \star gradient estimator over the ones based on the VIMCO-AM and VIMCO-GM gradient estimators. 4.3 Variational Bayesian Phylogenetic Inference Let Y=\{Y_{1},Y_{2},\ldots,Y_{m}\}\in\Omega^{n\times m} be an alignment of molecular sequences from n taxa and m sites, where \Omega denotes the set of possible nucleotide or amino-acid characters. A phylogenetic model specifies a bifurcating tree topology \tau , which encodes the ancestral relationships among the taxa, together with non-negative branch lengths q that quantify the amount of evolutionary change along the edges. Character evolution along the tree is governed by a continuous-time Markov substitution process and for a given tree (\tau,q) , the likelihood for a single site p(Y_{i}|\tau,q) is obtained by marginalizing over the unobserved character states at internal nodes. The full likelihood p(Y|\tau,q)=\prod_{i=1}^{m}p(Y_{i}|\tau,q) factorizes across sites and can be evaluated in linear time in the number of taxa using the pruning algorithm ( 14 ) . Given a proper prior p(\tau,q) , Bayesian phylogenetics then amount to estimating the posterior distribution \displaystyle p(\tau,q|Y)\propto p(Y|\tau,q)p(\tau,q). To that end, variational Bayesian phylogenetic inference (VBPI) posits a variational family for the joint posterior p(\tau,q|Y) using the product Q_{\phi}(\tau)Q_{\psi}(q|\tau) , where Q_{\phi}(\tau) is a variational distribution over tree topologies and Q_{\psi}(q|\tau) a conditional distribution over branch lengths ( 54 ; 55 ; 56 ) . Since the tree topology is a discrete latent variable, VBPI methods cannot entirely rely on reparameterized gradients. For this reason, existing VBPI methods such as 54 ; 55 have employed REINFORCE gradient estimators of the IWAE bound based on the per-sample control variates techniques of 33 . We will thus assess the empirical performance of our novel gradient estimator VIMCO- \star against the established VBPI benchmarks, that is, against the VIMCO-AM and VIMCO-GM gradient estimators when \alpha=0 . Following the approaches of 54 ; 55 , and notably appealing to an annealing strategy for the likelihood as described in Section 3.3.2 (see Section C.3 for further implementation details), we conduct experiments on DS1, which is commonly used to evaluate Bayesian phylogenetic methods ( 23 ; 16 ; 24 ; 48 ; 54 ; 51 ; 22 ; 30 ) . We run 10 single-chain MrBayes ( 40 ) for one billion iterations, thinning every 1000 iterations and discarding the first 25\% as burn-in. The resulting samples serve as our ground truth reference for evaluating posterior estimates. The topology parameters \phi are learnt using either the VIMCO- \star , VIMCO-AM and VIMCO-GM gradient estimators with N=10 , and we use the reparameterization trick to learn the branch length parameters \psi . The results are collected after 400,000 parameter updates. Figure 5: Performance of VIMCO- \star , VIMCO-AM and VIMCO-GM as the topological gradient estimator for VBPI on DS1. Figure 5 shows the KL divergence from the variational approximations to the ground truth posterior over iterations. Although all methods behave similarly at the beginning, VIMCO- \star ultimately yields the most accurate variational approximation. Note that in this case ( \alpha=0 ) the only difference between VIMCO- \star and VIMCO-AM is that VIMCO- \star omits the extra factor \log\frac{N}{N-1} , which demonstrates the power of gradient estimates with a higher signal-to-noise ratio (Theorem 6 ). 5 Discussion The versatility of VIMCO gradient estimators opens several compelling research directions. One promising direction involves developing theoretically grounded annealing schedules analogous to those established in the Sequential Monte Carlo literature, see, e.g. 10 and strategies to minimize computational cost while retaining the advantages of the VIMCO- \star gradient estimator. Furthermore, our work provides an asymptotic characterization of VIMCO gradient estimators that complements established results under the reparameterization trick assumption ( 9 ; 38 ; 46 ) , thereby facilitating a principled comparison between these two paradigms. A first significant implication of our results is that the VIMCO- \star gradient estimator with \alpha=0 achieves an asymptotic SNR rate of O(\sqrt{N}) for the learning of \phi , markedly outperforming the O(1/\sqrt{N}) rate of the standard reparameterized IWAE gradient estimator ( 38 ) . This finding challenges the prevailing heuristic that reparameterized gradient estimators are inherently superior to REINFORCE-based alternatives. In fact, the asymptotic SNR rate of the VIMCO- \star gradient estimator matches that of the more sophisticated doubly-reparameterized gradient estimator ( 46 ; 9 ) . Future research focusing on the behavior of the leading constants within these asymptotic rates is thus expected to further refine the understanding of these two fundamental estimation frameworks. Lastly, we anticipate that the assumptions we made throughout the paper are likely conservative and could be significantly weakened in future work, further generalizing the algorithmic framework introduced here. Appendix A Deferred proofs for Section 3.1 In the following, \psi\in\{\phi_{1},\ldots,\phi_{b}\} , z\sim q_{\phi}(\cdot|x) and z_{1},z_{2},\ldots are i.i.d. copies of z . A.1 Proof of 1 We start by capturing the behavior as N\to\infty of the first term in the right-hand side of ( 7 ). We then capture the behavior as N\to\infty of the second term in this right-hand side, before pairing both results together to get 1 . A.1.1 Behavior as N\to\infty of the first term in the right-hand side of ( 7 ) We have the following proposition. Proposition 1 Let \psi\in\{\phi_{1},\ldots,\phi_{b}\} and assume (A5) , (Ah) and ( ~ A h ′ ) with h,h^{\prime}>2 . Then: as N\to\infty , \displaystyle\mathbb{E}\left(\sum_{j=1}^{N}W_{\theta,\phi}^{(1-\alpha)}(z_{j};x)\partial_{\psi}\log w_{\theta,\phi}(z_{j};x)\right)=-\frac{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha}\partial_{\psi}\log q_{\phi}(z|x))}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})}+o(1). (26) Further assuming that h,h^{\prime}\geq 4 , we have: as N\to\infty , \mathbb{E}\left(\sum_{j=1}^{N}W_{\theta,\phi}^{(1-\alpha)}(z_{j};x)\partial_{\psi}\log w_{\theta,\phi}(z_{j};x)\right)\\ =-\frac{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha}\partial_{\psi}\log q_{\phi}(z|x))}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})}-\frac{R_{1}^{(\alpha)}(\theta,\phi;x)}{N}+o\left(\frac{1}{N}\right) (27) where R_{1}^{(\alpha)}(\theta,\phi;x):=\frac{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha}\partial_{\psi}\log q_{\phi}(z|x))\mathbb{E}(w_{\theta,\phi}(z;x)^{2(1-\alpha)})}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})^{3}}\\ -\frac{\mathbb{E}(w_{\theta,\phi}(z;x)^{2(1-\alpha)}\partial_{\psi}\log q_{\phi}(z|x))}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})^{2}}. Proof. First note that since \psi\in\{\phi_{1},\ldots,\phi_{b}\} , it holds that \displaystyle\mathbb{E}\left(\sum_{j=1}^{N}W_{\theta,\phi}^{(1-\alpha)}(z_{j};x)\partial_{\psi}\log w_{\theta,\phi}(z_{j};x)\right)=-\mathbb{E}\left(\sum_{j=1}^{N}W_{\theta,\phi}^{(1-\alpha)}(z_{j};x)\partial_{\psi}\log q_{\phi}(z_{j}|x)\right). Set X=w_{\theta,\phi}(z;x)^{1-\alpha}\partial_{\psi}\log q_{\phi}(z|x) , Y=w_{\theta,\phi}(z;x)^{1-\alpha} as well as \overline{X}_{N}=\frac{1}{N}\sum_{j=1}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}\partial_{\psi}\log q_{\phi}(z_{j}|x)\quad\mbox{and}\quad\overline{Y}_{N}=\frac{1}{N}\sum_{j=1}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}. Under (A5) , (Ah) and ( ~ A h ′ ) with h,h^{\prime}>2 , ( 81 ) from 7 holds and: as N\to\infty , \displaystyle\mathbb{E} \displaystyle\left(\sum_{j=1}^{N}W_{\theta,\phi}^{(1-\alpha)}(z_{j};x)\partial_{\psi}\log q_{\phi}(z_{j}|x)\right)=\frac{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha}\partial_{\psi}\log q_{\phi}(z|x))}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})}+o(1) (as \mathbb{E}(Y^{h})<\infty with h>2 and \mathbb{E}(|X|^{\tilde{h}})<\infty with \tilde{h}>1 by the Cauchy-Schwartz inequality). Further assuming assuming that h\geq 6 and h^{\prime}\geq 3 , ( 83 ) from 7 holds and: as N\to\infty , \displaystyle\mathbb{E} \displaystyle\left(\sum_{j=1}^{N}W_{\theta,\phi}^{(1-\alpha)}(z_{j};x)\partial_{\psi}\log q_{\phi}(z_{j}|x)\right)=\frac{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha}\partial_{\psi}\log q_{\phi}(z|x))}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})} \displaystyle\qquad\qquad\qquad\qquad+\frac{1}{N}\frac{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha}\partial_{\psi}\log q_{\phi}(z|x))\mathbb{V}(w_{\theta,\phi}(z;x)^{1-\alpha})}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})^{3}} \displaystyle\qquad\qquad\qquad\qquad-\frac{1}{N}\frac{\mathbb{C}\mathrm{ov}\left(w_{\theta,\phi}(z;x)^{1-\alpha}\partial_{\psi}\log q_{\phi}(z|x),w_{\theta,\phi}(z;x)^{1-\alpha}\right)}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})^{2}}+o\left(\frac{1}{N}\right). (as \mathbb{E}(Y^{h})<\infty with h\geq 4 and \mathbb{E}(|X|^{\tilde{h}})<\infty with \tilde{h}=2 by the Cauchy-Schwartz inequality). Observing that \frac{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha}\partial_{\psi}\log q_{\phi}(z|x))\mathbb{V}(w_{\theta,\phi}(z;x)^{1-\alpha})}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})^{3}}\\ =\frac{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha}\partial_{\psi}\log q_{\phi}(z|x))\mathbb{E}(w_{\theta,\phi}(z;x)^{2(1-\alpha)})}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})^{3}}-\frac{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha}\partial_{\psi}\log q_{\phi}(z|x))}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})} and that \frac{\mathbb{C}\mathrm{ov}\left(w_{\theta,\phi}(z;x)^{1-\alpha}\partial_{\psi}\log q_{\phi}(z|x),w_{\theta,\phi}(z;x)^{1-\alpha}\right)}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})^{2}}\\ =\frac{\mathbb{E}(w_{\theta,\phi}(z;x)^{2(1-\alpha)}\partial_{\psi}\log q_{\phi}(z|x))}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})^{2}}-\frac{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha}\partial_{\psi}\log q_{\phi}(z|x))}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})} yieds the desired result ( 27 ). ∎ A.1.2 Behavior as N\to\infty of the second term in the right-hand side of ( 7 ) We first provide a useful lemma. Lemma 2 For all r>0 , and all k\in\mathbb{N}^{\star} , it holds that \displaystyle\left|\log r-\left[\sum_{i=1}^{k}(-1)^{i-1}\frac{(r-1)^{i}}{i}\right]\right|\leq\frac{|r-1|^{k+1}}{k+1}\left(1+\frac{1}{r}\right). (28) Proof. Set f(t)=\log(1+t(r-1)) for all t\in[0,1] and write that \displaystyle f(1)-f(0)-\sum_{i=1}^{k}\frac{f^{(i)}(0)}{i!} \displaystyle=\int_{0}^{1}\left(f^{\prime}(t)-\sum_{i=1}^{k}\frac{t^{i-1}}{(i-1)!}f^{(i)}(0)\right)\mathrm{d}t. (29) Next we use that: for all i=1\ldots k and all t\in[0,1] , \displaystyle f^{(i)}(t)=(-1)^{i-1}(i-1)!\left(\frac{r-1}{1+t(r-1)}\right)^{i} which follows easily by induction and we obtain that \displaystyle f^{\prime}(t)=\frac{r-1}{1+t(r-1)} \displaystyle\sum_{i=1}^{k}\frac{t^{i-1}}{(i-1)!}f^{(i)}(0)=(r-1)\sum_{i=1}^{k}(-t(r-1))^{i-1}=(r-1)\left[\frac{1-(-t(r-1))^{k}}{1+t(r-1)}\right]. Consequently, we deduce from ( 29 ) that \displaystyle\log r-\left[\sum_{i=1}^{k}(-1)^{i-1}\frac{(r-1)^{i}}{i}\right] \displaystyle=(-1)^{k}(r-1)^{k+1}\int_{0}^{1}\frac{t^{k}}{1+t(r-1)}\mathrm{d}t. The proof is concluded by using that \displaystyle\int_{0}^{1}\frac{t^{k}}{1+t(r-1)}\mathrm{d}t\leq\begin{cases}\frac{1}{(k+1)r}&\mbox{if $r\leq 1$}\\ \frac{1}{k+1}&\mbox{otherwise.}\end{cases} ∎ Remark 1 Our proof borrows elements from 6 , Lemma 5 . The main differences are that their result (i) controls \left|\log r-\left[\sum_{i=1}^{k}(-1)^{i-1}\frac{(r-1)^{i}}{i}\right]\right| for k\in\{1,2\} only and (ii) they handle integrals of the form \int_{0}^{1}\frac{t^{k}}{1+t(r-1)}\mathrm{d}t by using the following upper bound \displaystyle\left|\int_{0}^{1}\frac{t^{k}}{1+t(r-1)}\mathrm{d}t\right|\leq|(r-1)^{-1}\log r|,\quad k\in\{1,2\}. We next present the following proposition. Proposition 2 Let \psi\in\{\phi_{1},\ldots,\phi_{b}\} and assume (A5) , (Ah) with h\geq 4 and ( ~ A h ′ ) with h^{\prime}\geq 2 . Then, as N\to\infty : \mathbb{E}\left(\left(\sum_{i=1}^{N}\partial_{\psi}\log q_{\phi}(z_{i}|x)\right)\log\left(\frac{1}{N}\sum_{j=1}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}\right)\right)\\ =\frac{\mathbb{E}\left(w_{\theta,\phi}(z;x)^{1-\alpha}\partial_{\psi}\log q_{\phi}(z|x)\right)}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})}+o(1). (30) Further assuming that h\geq 8 , we have: as N\to\infty , \mathbb{E}\left(\left(\sum_{i=1}^{N}\partial_{\psi}\log q_{\phi}(z_{i}|x)\right)\log\left(\frac{1}{N}\sum_{j=1}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}\right)\right)\\ =\frac{\mathbb{E}\left(w_{\theta,\phi}(z;x)^{1-\alpha}\partial_{\psi}\log q_{\phi}(z|x)\right)}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})}+\frac{R_{2}^{(\alpha)}(\theta,\phi;x)}{N}+o\left(\frac{1}{N}\right) (31) where R_{2}^{(\alpha)}(\theta,\phi;x)=\frac{\mathbb{E}\left(w_{\theta,\phi}(z;x)^{1-\alpha}\partial_{\psi}\log q_{\phi}(z|x)\right)\mathbb{E}(w_{\theta,\phi}(z;x)^{2(1-\alpha)})}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})^{3}}\\ -\frac{1}{2}\frac{\mathbb{E}\left(w_{\theta,\phi}(z;x)^{2(1-\alpha)}\partial_{\psi}\log q_{\phi}(z|x)\right)}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})^{2}}. Proof of 2 . Let X=\partial_{\psi}\log q_{\phi}(z|x) , Y={w_{\theta,\phi}(z;x)^{1-\alpha}}/{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})} and \displaystyle\overline{X}_{N}=\frac{1}{N}\sum_{i=1}^{N}\partial_{\psi}\log q_{\phi}(z_{i}|x)\quad\mbox{and}\quad\overline{Y}_{N}=\frac{1}{N}\sum_{j=1}^{N}\frac{w_{\theta,\phi}(z_{j};x)^{1-\alpha}}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})}. The quantity of interest we want to study then reads \mathbb{E}(N\overline{X}_{N}\log\overline{Y}_{N}) , with \mathbb{E}(X)=\mathbb{E}(Y-1)=0 and thus \mathbb{E}(\overline{X}_{N})=\mathbb{E}(\overline{Y}_{N}-1)=0 . To analyze this quantity, we will use a Taylor expansion of \log\overline{Y}_{N} and to control the remainder term. First observe that \displaystyle\mathbb{E}\left(\overline{X}_{N}(\overline{Y}_{N}-1)\right) \displaystyle=\frac{\mathbb{E}(X(Y-1))}{N}=\frac{\mathbb{E}(XY)}{N} \displaystyle\mathbb{E}(\overline{X}_{N}(\overline{Y}_{N}-1)^{2}) \displaystyle=\frac{1}{N^{2}}\mathbb{E}\left(X(Y-1)^{2}\right)=\frac{1}{N^{2}}\left[\mathbb{E}(XY^{2})-2\mathbb{E}(XY)\right] \displaystyle\mathbb{E}(\overline{X}_{N}(\overline{Y}_{N}-1)^{3}) \displaystyle=\frac{3}{N^{2}}\mathbb{E}\left(XY\right)\mathbb{V}(Y)+\frac{1}{N^{3}}\left[\mathbb{E}(X(Y-1)^{3})-3\mathbb{E}\left(XY\right)\mathbb{V}(Y)\right]. It follows that \displaystyle\mathbb{E}\left(N\overline{X}_{N}(\overline{Y}_{N}-1)\right)=\mathbb{E}(XY) (32) and we also have \mathbb{E}\left(N\overline{X}_{N}\left[(\overline{Y}_{N}-1)-\frac{(\overline{Y}_{N}-1)^{2}}{2}+\frac{(\overline{Y}_{N}-1)^{3}}{3}\right]\right)=\mathbb{E}(XY)\\ +\frac{1}{N}\left[\mathbb{E}\left(XY\right)\mathbb{E}(Y^{2})-\frac{1}{2}\mathbb{E}(XY^{2})\right]+\frac{1}{3N^{2}}\left[\mathbb{E}(X(Y-1)^{3})-3\mathbb{E}\left(XY\right)\mathbb{V}(Y)\right] (33) since \mathbb{V}(Y)=\mathbb{E}(Y^{2})-\mathbb{E}(Y)^{2}=\mathbb{E}(Y^{2})-1 . We now prove ( 30 ) and ( 31 ) separately. (i) Proof of ( 30 ). We will show that \displaystyle R_{N}:=\mathbb{E}\left(N\overline{X}_{N}\left\{\log\overline{Y}_{N}-{(\overline{Y}_{N}-1)}\right\}\right)=o(1). (34) Paired up with ( 32 ), this will imply \displaystyle\mathbb{E}\left(N\overline{X}_{N}\log\overline{Y}_{N}\right)=\mathbb{E}(XY)+o(1), (35) which is exactly the first result from 2 . Let us thus show ( 34 ). Using ( 28 ) from 2 with r=\overline{Y}_{N} and k=1 , we get \displaystyle|R_{N}|\leq\frac{N}{2}\mathbb{E}\left(|\overline{X}_{N}||\overline{Y}_{N}-1|^{2}\left(1+\frac{1}{\overline{Y}_{N}}\right)\right). Consequently, \displaystyle|R_{N}|\leq\frac{N}{2}\left(\mathbb{E}\left(|\overline{X}_{N}||\overline{Y}_{N}-1|^{2}\right)+\mathbb{E}\left(|\overline{X}_{N}|\frac{(\overline{Y}_{N}-1)^{2}}{\overline{Y}_{N}}\right)\right) and using the Cauchy-Schwartz inequality, we get \displaystyle|R_{N}|\leq\frac{N}{2}\mathbb{E}\left(|\overline{X}_{N}|^{2}\right)^{\frac{1}{2}}\left[\mathbb{E}\left(|\overline{Y}_{N}-1|^{4}\right)^{\frac{1}{2}}+\mathbb{E}\left(\frac{|\overline{Y}_{N}-1|^{4}}{\overline{Y}_{N}^{2}}\right)^{\frac{1}{2}}\right]. Next using 5 with a=\overline{Y}_{N} , b=1 , \mu_{0}=4 and \eta_{0}\in(2,4) paired up with the fact that |a+b|^{1/2}\leq|a|^{1/2}+|b|^{1/2} for all a,b\in\mathbb{R} , we have \displaystyle\mathbb{E}\left(\frac{|\overline{Y}_{N}-1|^{4}}{\overline{Y}_{N}^{2}}\right)^{\frac{1}{2}}\leq\mathbb{E}\left(\left|\overline{Y}_{N}-1\right|^{\eta_{0}}\;\overline{Y}_{N}^{2-\eta_{0}}\right)^{\frac{1}{2}}+\mathbb{E}\left(\frac{\left|\overline{Y}_{N}-1\right|^{\eta_{0}}}{\overline{Y}_{N}^{2}}\right)^{\frac{1}{2}}. Using the Holder’s inequality, we then get that: for all p,q>1 with 1/p+1/q=1 \displaystyle\mathbb{E}\left(\frac{|\overline{Y}_{N}-1|^{4}}{\overline{Y}_{N}^{2}}\right)^{\frac{1}{2}}\leq\mathbb{E}\left(\left|\overline{Y}_{N}-1\right|^{p\eta_{0}}\right)^{\frac{1}{2p}}\left(\mathbb{E}\left(\overline{Y}_{N}^{q(2-\eta_{0})}\right)^{\frac{1}{2q}}+\mathbb{E}\left({\overline{Y}_{N}^{-2q}}\right)^{\frac{1}{2q}}\right). At this stage, we have thus obtained that \displaystyle|R_{N}|\leq\frac{N}{2}\mathbb{E}\left(|\overline{X}_{N}|^{2}\right)^{\frac{1}{2}}\left[\mathbb{E}\left(|\overline{Y}_{N}-1|^{4}\right)^{\frac{1}{2}}+\mathbb{E}\left(\left|\overline{Y}_{N}-1\right|^{p\eta_{0}}\right)^{\frac{1}{2p}}\left(\mathbb{E}\left(\overline{Y}_{N}^{q(2-\eta_{0})}\right)^{\frac{1}{2q}}+\mathbb{E}\left({\overline{Y}_{N}^{-2q}}\right)^{\frac{1}{2q}}\right)\right] Under our assumptions, we can then apply ( 85 ) from 8 with (Z,\overline{Z}_{N})=(X,\overline{X}_{N}) and (Z,\overline{Z}_{N})=(Y-1,\overline{Y}_{N}-1) respectively, which gives \displaystyle\sup_{N\in\mathbb{N}^{\star}}N^{\frac{1}{2}}\mathbb{E}(|\overline{X}_{N}|^{2})^{\frac{1}{2}}<\infty \displaystyle\sup_{N\in\mathbb{N}^{\star}}N\mathbb{E}\left(|\overline{Y}_{N}-1|^{4}\right)^{\frac{1}{2}}<\infty \displaystyle\sup_{N\in\mathbb{N}^{\star}}N^{\frac{\eta_{0}}{4}}\mathbb{E}\left(|\overline{Y}_{N}-1|^{p\eta_{0}}\right)^{\frac{1}{2p}}<\infty. where in the last display we have used that \eta_{0}\in(2,4) . To conclude the proof, we use that under (A5) we have by 6 : for all \mu>0 : as N\to\infty , \mathbb{E}((\overline{Y}_{N})^{-\mu})=O(1) . (ii) Proof of ( 31 ). We will show that \displaystyle R_{N}:=\mathbb{E}\left(N\overline{X}_{N}\left\{\log\overline{Y}_{N}-\left[(\overline{Y}_{N}-1)-\frac{(\overline{Y}_{N}-1)^{2}}{2}+\frac{(\overline{Y}_{N}-1)^{3}}{3}\right]\right\}\right)=o\left(\frac{1}{N}\right). (36) Paired up with ( 33 ) (in which the last term behaves as o(1/N) since |\mathbb{E}(X(Y-1)^{3})|\leq\mathbb{E}(|X|^{2})^{1/2}\mathbb{E}(|Y-1|^{6})^{1/2} using the Cauchy-Schwartz inequality which implies |\mathbb{E}(X(Y-1)^{3})|<\infty under our assumptions), this will give \displaystyle\mathbb{E}(N\overline{X}_{N}\log\overline{Y}_{N})=\mathbb{E}(XY)+\frac{1}{N}\left[\mathbb{E}\left(XY\right)\mathbb{E}(Y^{2})-\frac{1}{2}\mathbb{E}(XY^{2})\right]+o\left(\frac{1}{N}\right) and this is exactly the second result from 2 . Using ( 28 ) from 2 with r=\overline{Y}_{N} and k=3 yields \displaystyle|R_{N}|\leq\frac{N}{4}\left[\mathbb{E}\left(|\overline{X}_{N}||\overline{Y}_{N}-1|^{4}\right)+\mathbb{E}\left(|\overline{X}_{N}|\frac{|\overline{Y}_{N}-1|^{4}}{\overline{Y}_{N}}\right)\right]. The proof technique is very similar to (i) from there and we can deduce that ( 36 ) holds under our assumptions by adapting (i). ∎ A.1.3 Pairing 1 and 2 together to prove 1 Proof of 1 . The proof of ( 12 ) follows from 1 and 2 paired up with ( 14 ). To get ( 13 ), we once again use 1 and 2 paired up with ( 14 ). The proof is concluded if we can show that \displaystyle\frac{1}{2}\partial_{\psi}[\gamma^{(\alpha)}(\theta,\phi;x)^{2}] \displaystyle=-\frac{\mathbb{E}(w_{\theta,\phi}(z;x)^{2(1-\alpha)}\partial_{\psi}\log q_{\phi}(z|x))}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})^{2}} \displaystyle\quad+\frac{1}{2(1-\alpha)}\frac{\mathbb{E}(w_{\theta,\phi}(z;x)^{2(1-\alpha)}\partial_{\psi}\log q_{\phi}(z|x))}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})^{2}} \displaystyle\quad+\frac{\mathbb{E}(w_{\theta,\phi}(z;x)^{2(1-\alpha)})\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha}\partial_{\psi}\log q_{\phi}(z|x))}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})^{3}} \displaystyle\quad-\frac{1}{1-\alpha}\frac{\mathbb{E}(w_{\theta,\phi}(z;x)^{2(1-\alpha)})\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha}\partial_{\psi}\log q_{\phi}(z|x))}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})^{3}} that is \frac{1}{2}(1-\alpha)\partial_{\psi}[\gamma^{(\alpha)}(\theta,\phi;x)^{2}]=\frac{1}{2}(1-2(1-\alpha))\frac{\mathbb{E}(w_{\theta,\phi}(z;x)^{2(1-\alpha)}\partial_{\psi}\log q_{\phi}(z|x))}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})^{2}}\\ -\alpha\frac{\mathbb{E}(w_{\theta,\phi}(z;x)^{2(1-\alpha)})\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha}\partial_{\psi}\log q_{\phi}(z|x))}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})^{3}} (37) Let us thus prove ( 37 ). Since \displaystyle\frac{1}{2}(1-\alpha)\partial_{\psi}[\gamma^{(\alpha)}(\theta,\phi;x)^{2}] \displaystyle=\frac{1}{2}\partial_{\psi}\left(\frac{\mathbb{E}(w_{\theta,\phi}(z;x)^{2(1-\alpha)})}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})^{2}}\right) \displaystyle=\frac{1}{2}{\frac{\partial_{\psi}\mathbb{E}(w_{\theta,\phi}(z;x)^{2(1-\alpha)})}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})^{2}}}-{\frac{\mathbb{E}(w_{\theta,\phi}(z;x)^{2(1-\alpha)})\partial_{\psi}\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})^{3}}} we get ( 37 ) by plugging in the above the following identity: for all u>0 , \displaystyle\partial_{\psi}\mathbb{E}(w_{\theta,\phi}(z;x)^{u}) \displaystyle=-u\mathbb{E}(w_{\theta,\phi}(z;x)^{u}\partial_{\psi}\log q_{\phi}(z|x))+\mathbb{E}(w_{\theta,\phi}(z;x)^{u}\partial_{\psi}\log q_{\phi}(z|x)) \displaystyle=(1-u)\mathbb{E}(w_{\theta,\phi}(z;x)^{u}\partial_{\psi}\log q_{\phi}(z|x)), which concludes the proof. ∎ Remark 2 The proof of 1 consists in pairing up 1 and 2 together, where these two results capture the behavior as N\to\infty of the first and second term in the right-hand side of ( 7 ) when \psi\in\{\phi_{1},\ldots,\phi_{b}\} respectively. The proof of 1 builds on the fact that the first term in the right-hand side of ( 7 ) can be written as \mathbb{E}(\overline{X}_{N}/\overline{Y}_{N}) for well-chosen sample averages \overline{X}_{N} and \overline{Y}_{N} , with the asymptotic behavior of estimators of the form \overline{X}_{N}/\overline{Y}_{N} as N\to\infty being studied in 9 , Proposition 6 under general conditions. Obtaining 1 thus follows from 9 , Proposition 6 and the challenge in analyzing the asymptotic behavior of \partial_{\psi}\ell^{(\alpha)}_{N}(\theta,\phi;x) comes from the second term in the right-hand side of ( 7 ). One key ingredient in the proof of 2 is 2 , which is a general lemma that establishes an upper bound on the difference between \log(r) and its k -th order Taylor expansion for all r>0 . Appendix B Deferred proofs for Section 3.2 B.1 Proof of 1 First note that since \psi\in\{\phi_{1},\ldots,\phi_{b}\} , it holds that \displaystyle\mathbb{V}\left(\sum_{j=1}^{N}W_{\theta,\phi}^{(1-\alpha)}(z_{j};x)\partial_{\psi}\log w_{\theta,\phi}(z_{j};x)\right)=\mathbb{V}\left(\sum_{j=1}^{N}W_{\theta,\phi}^{(1-\alpha)}(z_{j};x)\partial_{\psi}\log q_{\phi}(z_{j}|x)\right). Set X=w_{\theta,\phi}(z;x)^{1-\alpha}\partial_{\psi}\log q_{\phi}(z|x) , Y=w_{\theta,\phi}(z;x)^{1-\alpha} as well as \overline{X}_{N}=\frac{1}{N}\sum_{j=1}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}\partial_{\psi}\log q_{\phi}(z_{j}|x)\quad\mbox{and}\quad\overline{Y}_{N}=\frac{1}{N}\sum_{j=1}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}. Applying ( 84 ) from 7 yields the desired result. B.2 Proof of 2 For notational convenience, we denote X=\partial_{\psi}\log q_{\phi}(z|x) , Y={w_{\theta,\phi}(z;x)^{1-\alpha}}/{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})} as well as \displaystyle\overline{X}_{N}=\frac{1}{N}\sum_{i=1}^{N}\partial_{\psi}\log q_{\phi}(z_{i}|x)\quad\mbox{and}\quad\overline{Y}_{N}=\frac{1}{N}\sum_{j=1}^{N}\frac{w_{\theta,\phi}(z_{j};x)^{1-\alpha}}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})}, with \mathbb{E}(X)=\mathbb{E}(Y-1)=0 and thus \mathbb{E}(\overline{X}_{N})=\mathbb{E}(\overline{Y}_{N}-1)=0 . We will first study the quantity \mathbb{V}(N\overline{X}_{N}\log\overline{Y}_{N}) . To that end, note that the central limit theorem yields \displaystyle\sqrt{N}\left[\begin{matrix}\overline{X}_{N}\\ \overline{Y}_{N}-1\end{matrix}\right]\overset{\mathrm{dist.}}{\longrightarrow}\mathcal{N}(0,\boldsymbol{\Sigma})\quad\mbox{where}\quad\boldsymbol{\Sigma}=\left(\begin{matrix}\mathbb{V}(X)&\mathbb{C}\mathrm{ov}(X,Y)\\ \mathbb{C}\mathrm{ov}(X,Y)&\mathbb{V}\left(Y\right)\end{matrix}\right). Furthermore, denoting f(u,v)=u\log v , and observing that \displaystyle\left.\left[\begin{matrix}\partial_{u}f(u,v)\\ \partial_{v}f(u,v)\end{matrix}\right]\right|_{(u,v)=(0,1)}=0 \displaystyle\left.\left(\begin{matrix}\partial_{uu}f(u,v)&\partial_{uv}f(u,v)\\ \partial_{vu}f(u,v)&\partial_{vv}f(u,v)\end{matrix}\right)\right|_{(u,v)=(0,1)}=\left(\begin{matrix}0&1\\ 1&0\end{matrix}\right) we can apply the multivariate second order Delta method (see, e.g. Theorem 3.7 from 2 ) and we get that \displaystyle N\overline{X}_{N}\log\overline{Y}_{N}\overset{\mathrm{dist.}}{\longrightarrow}Z_{1}Z_{2} where \boldsymbol{Z}\sim\mathcal{N}(0,\boldsymbol{\Sigma}) and \boldsymbol{Z}=(Z_{1},Z_{2}) . Next we show that the sequence ((N\overline{X}_{N}\log\overline{Y}_{N})^{2})_{N\geq 1} is uniformly integrable, that is we show that there exists \delta>0 such that \displaystyle\limsup_{N\in\mathbb{N}^{*}}\mathbb{E}\left((N\overline{X}_{N}\log\overline{Y}_{N})^{2(1+\delta)}\right)<\infty. (38) To that end, we write that by Holder’s inequality: for all p,q\geq 1 with 1/p+1/q=1 , \displaystyle\mathbb{E}\left(|N\overline{X}_{N}\log\overline{Y}_{N}|^{2(1+\delta)}\right)\leq\left[N^{1+\delta}\mathbb{E}(|\overline{X}_{N}|^{2(1+\delta)p})^{\frac{1}{p}}\right]\times\left[N^{1+\delta}\mathbb{E}(|\log\overline{Y}_{N}|^{2(1+\delta)q})^{1/q}\right]. Further observe that \displaystyle|\log\overline{Y}_{N}|^{2(1+\delta)q}\leq 2^{2(1+\delta)q-1}\left(|\log\overline{Y}_{N}-(\overline{Y}_{N}-1)|^{2(1+\delta)q}+|\overline{Y}_{N}-1|^{2(1+\delta)q}\right) so that \mathbb{E}\left(|\log\overline{Y}_{N}|^{2(1+\delta)q}\right)^{1/q}\\ \leq(2^{2(1+\delta)q-1})^{1/q}\left(\mathbb{E}(|\log\overline{Y}_{N}-(\overline{Y}_{N}-1)|^{2(1+\delta)q})+\mathbb{E}(|\overline{Y}_{N}-1|^{2(1+\delta)q})\right)^{1/q}. Hence, we have that \mathbb{E}\left(|\log\overline{Y}_{N}|^{2(1+\delta)q}\right)^{1/q}\\ \leq(2^{2(1+\delta)q-1})^{1/q}\left(\mathbb{E}(|\log\overline{Y}_{N}-(\overline{Y}_{N}-1)|^{2(1+\delta)q})^{1/q}+\mathbb{E}(|\overline{Y}_{N}-1|^{2(1+\delta)q})^{1/q}\right). We have thus obtained that \mathbb{E}\left(|N\overline{X}_{N}\log\overline{Y}_{N}|^{2(1+\delta)}\right)\leq\left[N^{1+\delta}\mathbb{E}(|\overline{X}_{N}|^{2(1+\delta)p})^{\frac{1}{p}}\right]\\ \times\left[N^{1+\delta}(2^{2(1+\delta)q-1})^{1/q}\left(\mathbb{E}(|\log\overline{Y}_{N}-(\overline{Y}_{N}-1)|^{2(1+\delta)q})^{1/q}+\mathbb{E}(|\overline{Y}_{N}-1|^{2(1+\delta)q})^{1/q}\right)\right]. Under our assumptions, and setting p=q=2 , h=4(1+\delta)q and h^{\prime\prime}=2(1+\delta)p , we can then apply ( 85 ) from 8 with (Z,\overline{Z}_{N})=(X,\overline{X}_{N}) and (Z,\overline{Z}_{N})=(Y-1,\overline{Y}_{N}-1) respectively, which gives \displaystyle\sup_{N\in\mathbb{N}^{*}}N^{1+\delta}\mathbb{E}(|\overline{X}_{N}|^{2(1+\delta)p})^{\frac{1}{p}}<\infty. \displaystyle\sup_{N\in\mathbb{N}^{*}}N^{1+\delta}\mathbb{E}(|\overline{Y}_{N}-1|^{2(1+\delta)q})^{1/q}<\infty. The final step to obtain ( 38 ) is to show that \displaystyle\sup_{N\in\mathbb{N}^{*}}N^{1+\delta}\mathbb{E}(|\log\overline{Y}_{N}-(\overline{Y}_{N}-1)|^{2(1+\delta)q})^{1/q}<\infty. (39) Using ( 28 ) from 2 with r=\overline{Y}_{N} and k=1 , we get \left|\log\overline{Y}_{N}-(\overline{Y}_{N}-1)\right|\leq\frac{|\overline{Y}_{N}-1|^{2}}{2}\left(1+\frac{1}{\overline{Y}_{N}}\right) so that \displaystyle\mathbb{E}\left(\left|\log\overline{Y}_{N}-(\overline{Y}_{N}-1)\right|^{2(1+\delta)q}\right)\leq 2^{-2(1+\delta)q}\mathbb{E}\left(|\overline{Y}_{N}-1|^{4(1+\delta)q}\left(1+\frac{1}{\overline{Y}_{N}}\right)^{2(1+\delta)q}\right). As a result, we have that \displaystyle\mathbb{E}\left(\left|\log\overline{Y}_{N}-(\overline{Y}_{N}-1)\right|^{2(1+\delta)q}\right)\leq\mathbb{E}\left(|\overline{Y}_{N}-1|^{4(1+\delta)q}\left(1+\frac{1}{\overline{Y}_{N}^{2(1+\delta)q}}\right)\right) from which we deduce \displaystyle\mathbb{E}\left(\left|\log\overline{Y}_{N}-(\overline{Y}_{N}-1)\right|^{2(1+\delta)q}\right)^{\frac{1}{q}} \displaystyle\leq{\mathbb{E}\left(|\overline{Y}_{N}-1|^{4(1+\delta)q}\right)^{\frac{1}{q}}+\mathbb{E}\left(\frac{|\overline{Y}_{N}-1|^{4(1+\delta)q}}{\overline{Y}_{N}^{2(1+\delta)q}}\right)^{\frac{1}{q}}}, Similarly to the proof techniques used in 2 , we get that ( 39 ) holds under our assumptions. Consequently, \displaystyle\lim_{N\to\infty}\mathbb{E}\left((N\overline{X}_{N}\log\overline{Y}_{N})^{2}\right)=\mathbb{E}((Z_{1}Z_{2})^{2}) \displaystyle\lim_{N\to\infty}\mathbb{E}\left(N\overline{X}_{N}\log\overline{Y}_{N}\right)=\mathbb{E}(Z_{1}Z_{2}) and thus \displaystyle\lim_{N\to\infty}\mathbb{V}\left(N\overline{X}_{N}\log\overline{Y}_{N}\right)=\mathbb{V}(Z_{1}Z_{2}). By Isserlis’s theorem, we have that \mathbb{E}((Z_{1}Z_{2})^{2})=\mathbb{E}(Z_{1}^{2})\mathbb{E}(Z_{2}^{2})+2(\mathbb{E}(Z_{1}Z_{2}))^{2} so that \displaystyle\mathbb{V}(Z_{1}Z_{2}) \displaystyle=\mathbb{E}(Z_{1}^{2})\mathbb{E}(Z_{2}^{2})+(\mathbb{E}(Z_{1}Z_{2}))^{2}=\mathbb{V}(X)\mathbb{V}\left(Y\right)+\left(\mathbb{C}\mathrm{ov}\left(X,Y\right)\right)^{2}. We thus get that \displaystyle\mathbb{V}\left(N\overline{X}_{N}\log\overline{Y}_{N}\right)=\mathbb{V}(X)\mathbb{V}\left(Y\right)+{\mathbb{C}\mathrm{ov}\left(X,Y\right)}^{2} that is \mathbb{V}\left(\left(\sum_{i=1}^{N}\partial_{\psi}\log q_{\phi}(z_{i}|x)\right)\log\left(\frac{1}{N}\sum_{j=1}^{N}\frac{w_{\theta,\phi}(z_{j};x)^{1-\alpha}}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})}\right)\right)\\ =\mathbb{V}(\partial_{\psi}\log q_{\phi}(z|x))\mathbb{V}\left(\frac{w_{\theta,\phi}(z;x)^{1-\alpha}}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})}\right)+{\mathbb{C}\mathrm{ov}\left(\partial_{\psi}\log q_{\phi}(z|x),\frac{w_{\theta,\phi}(z;x)^{1-\alpha}}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})}\right)}^{2}+o(1). (40) Moving on to \displaystyle\mathbb{V}\left(\left(\sum_{i=1}^{N}\partial_{\psi}\log q_{\phi}(z_{i}|x)\right)\log\left(\frac{1}{N}\sum_{j=1}^{N}{w_{\theta,\phi}(z_{j};x)^{1-\alpha}}\right)\right), that is, \mathbb{V}(N\overline{X}_{N}[\log\overline{Y}_{N}+\log\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})]) and writing \mathbb{V}\left(N\overline{X}_{N}\left[\log\overline{Y}_{N}+\log\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})\right]\right)=\mathbb{V}\left(N\overline{X}_{N}\log\overline{Y}_{N}\right)\\ +N\mathbb{V}\left(X\right)\left(\log\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})\right)^{2}+2\mathbb{C}\mathrm{ov}(N\overline{X}_{N}\log\overline{Y}_{N},N\overline{X}_{N}\log\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})), we obtain using Cauchy-Schwartz inequality \left|\mathbb{C}\mathrm{ov}(N\overline{X}_{N}\log\overline{Y}_{N},N\overline{X}_{N}\log\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha}))\right|\\ \leq\sqrt{N}\sqrt{\mathbb{V}\left(N\overline{X}_{N}\log\overline{Y}_{N}\right)}\sqrt{\mathbb{V}\left(X\right)\left(\log\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})\right)^{2}}. Using ( 40 ), that is using the fact that \mathbb{V}\left(N\overline{X}_{N}\log\overline{Y}_{N}\right)=O(1) gives \displaystyle\mathbb{V}\left(\left(\sum_{i=1}^{N}\partial_{\psi}\log q_{\phi}(z_{i}|x)\right)\log\left(\frac{1}{N}\sum_{j=1}^{N}{w_{\theta,\phi}(z_{j};x)^{1-\alpha}}\right)\right)=o(N). (41) The proof is concluded by expanding \mathbb{V}(\psi\text{-}g_{N}^{(\alpha,\mathrm{NAIVE})}(\theta,\phi;x)) and observing that the covariance term which appears in the expansion is controlled by the Cauchy-Schwarz inequality thanks to ( 41 ) and 1 . B.3 Proof of 3 We first provide a useful lemma. Lemma 3 Let \ell\in\{1,2\} , \psi\in\{\phi_{1},\ldots,\phi_{b}\} and \eta\geq 0 . Assume (A5) and that \displaystyle\mathbb{E}(({w_{\theta,\phi}(z;x)^{(1+\ell)(1-\alpha)}}|\partial_{\psi}\log q_{\phi}(z|x)|)^{2})<\infty \displaystyle\eta\mathbb{E}(|\partial_{\psi}\log q_{\phi}(z|x)|^{2})<\infty. Then, as N\to\infty , \displaystyle\mathbb{E}\left(\left(\sum_{i=1}^{N}\left(\frac{w_{\theta,\phi}(z_{i};x)^{1-\alpha}-\eta}{\sum_{j=1}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}}\right)^{1+\ell}|\partial_{\psi}\log q_{\phi}(z_{i}|x)|\frac{1}{1-\frac{w_{\theta,\phi}(z_{i};x)^{1-\alpha}}{\sum_{j=1}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}}}\right)^{2}\right)=o\left(\frac{1}{N^{2\ell-1}}\right). Proof. Denoting \displaystyle C_{N}^{(\alpha)}=\mathbb{E}\left(\left(\sum_{i=1}^{N}\left(\frac{w_{\theta,\phi}(z_{i};x)^{1-\alpha}}{\sum_{j=1}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}}\right)^{1+\ell}|\partial_{\psi}\log q_{\phi}(z_{i}|x)|\frac{1}{1-\frac{w_{\theta,\phi}(z_{i};x)^{1-\alpha}}{\sum_{j=1}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}}}\right)^{2}\right), we have that \displaystyle C_{N}^{(\alpha)}=\mathbb{E}\left(\left(\sum_{i=1}^{N}\frac{w_{\theta,\phi}(z_{i};x)^{(1+\ell)(1-\alpha)}}{\left(\sum_{j=1}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}\right)^{\ell}}|\partial_{\psi}\log q_{\phi}(z_{i}|x)|\frac{1}{\sum_{\overset{j=1}{j\neq i}}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}}\right)^{2}\right). Using the Cauchy-Schwartz inequality (1/N\sum_{i}u_{i})^{2}\leq 1/N\sum_{i}u_{i}^{2} that is (\sum_{i}u_{i})^{2}\leq N\sum_{i}u_{i}^{2} , \displaystyle C_{N}^{(\alpha)} \displaystyle\leq N\mathbb{E}\left(\sum_{i=1}^{N}\left(\frac{w_{\theta,\phi}(z_{i};x)^{(1+\ell)(1-\alpha)}}{\left(\sum_{j=1}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}\right)^{\ell}}|\partial_{\psi}\log q_{\phi}(z_{i}|x)|\frac{1}{\sum_{\overset{j=1}{j\neq i}}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}}\right)^{2}\right) so that using first the fact that z_{1},\ldots,z_{N} are i.i.d. and then that \sum_{{j=1}}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}\geq\sum_{{j=1}}^{N-1}w_{\theta,\phi}(z_{j};x)^{1-\alpha} , we get \displaystyle C_{N}^{(\alpha)} \displaystyle\leq N^{2}\mathbb{E}\left(\left(\frac{w_{\theta,\phi}(z_{N};x)^{(1+\ell)(1-\alpha)}}{\left(\sum_{j=1}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}\right)^{\ell}}|\partial_{\psi}\log q_{\phi}(z_{N}|x)|\frac{1}{\sum_{{j=1}}^{N-1}w_{\theta,\phi}(z_{j};x)^{1-\alpha}}\right)^{2}\right) \displaystyle\leq N^{2}\mathbb{E}\left(\left({w_{\theta,\phi}(z_{N};x)^{(1+\ell)(1-\alpha)}}|\partial_{\psi}\log q_{\phi}(z_{N}|x)|\frac{1}{(\sum_{{j=1}}^{N-1}w_{\theta,\phi}(z_{j};x)^{1-\alpha})^{1+\ell}}\right)^{2}\right) \displaystyle=N^{2}\mathbb{E}\left(\left({w_{\theta,\phi}(z_{N};x)^{(1+\ell)(1-\alpha)}}|\partial_{\psi}\log q_{\phi}(z_{N}|x)|\right)^{2}\right)\mathbb{E}\left(\frac{1}{(\sum_{{j=1}}^{N-1}w_{\theta,\phi}(z_{j};x)^{1-\alpha})^{2(1+\ell)}}\right). Thus, we have that \displaystyle C_{N}^{(\alpha)}\leq\frac{N^{2}}{(N-1)^{2(1+\ell)}}\mathbb{E}\left(\left({w_{\theta,\phi}(z;x)^{(1+\ell)(1-\alpha)}}|\partial_{\psi}\log q_{\phi}(z|x)|\right)^{2}\right)\mathbb{E}((\overline{Y}_{N-1})^{-2(1+\ell)}) with \overline{Y}_{N}=1/N\sum_{i=1}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha} . We conclude that C_{N}^{(\alpha)}=o(1/N^{2\ell-1}) using that under our assumptions (i) \mathbb{E}(({w_{\theta,\phi}(z;x)^{(1+\ell)(1-\alpha)}}|\partial_{\psi}\log q_{\phi}(z|x)|)^{2})<\infty (ii) for all \mu>0 : as N\to\infty , \mathbb{E}((\overline{Y}_{N})^{-\mu})=O(1) by 6 . Similarly, we obtain under our assumptions that \displaystyle C_{N}^{(\alpha)^{\prime}}=\eta^{2(1+\ell)}\mathbb{E}\left(\left(\sum_{i=1}^{N}\left(\frac{1}{\sum_{j=1}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}}\right)^{1+\ell}|\partial_{\psi}\log q_{\phi}(z_{i}|x)|\frac{1}{1-\frac{w_{\theta,\phi}(z_{i};x)^{1-\alpha}}{\sum_{j=1}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}}}\right)^{2}\right) satisfies C_{N}^{(\alpha)^{\prime}}=o(1/N^{2\ell-1}) , which concludes the proof since (w_{\theta,\phi}(z;x)^{1-\alpha}-\eta)^{1+\ell}\leq 2^{\ell}(w_{\theta,\phi}(z;x)^{(1+\ell)(1-\alpha)}+\eta^{1+\ell}) . ∎ Proof of 3 . We first write that for all \alpha\in[0,1) , \displaystyle\psi\text{-}g_{N}^{(\alpha,\mathrm{VIMCO\text{-}AM})}(\theta,\phi;x) \displaystyle=\frac{\alpha}{1-\alpha}\sum_{j=1}^{N}W_{\theta,\phi}^{(1-\alpha)}(z_{j};x)\partial_{\psi}\log q_{\phi}(z_{j}|x)-\frac{1}{1-\alpha}\log\left(\frac{N}{N-1}\right)\sum_{i=1}^{N}\partial_{\psi}\log q_{\phi}(z_{i}|x) \displaystyle\quad-\frac{1}{1-\alpha}\sum_{i=1}^{N}\partial_{\psi}\log q_{\phi}(z_{i}|x)\left[\log\left(1-W_{\theta,\phi}^{(1-\alpha)}(z_{i};x)\right)+W_{\theta,\phi}^{(1-\alpha)}(z_{i};x)\right]. Observe next that \displaystyle\mathbb{V}\left(\log\left(\frac{N}{N-1}\right)\sum_{i=1}^{N}\partial_{\psi}\log q_{\phi}(z_{i}|x)\right) \displaystyle=\left(\log\left(\frac{N}{N-1}\right)\right)^{2}N\mathbb{V}\left(\partial_{\psi}\log q_{\phi}(z|x)\right) \displaystyle=\frac{1}{N}\mathbb{V}\left(\partial_{\psi}\log q_{\phi}(z|x)\right)+o\left(\frac{1}{N}\right). The proof of 3 will be concluded if we can show that \displaystyle\mathbb{V}\left(\sum_{i=1}^{N}\partial_{\psi}\log q_{\phi}(z_{i}|x)\left[\log\left(1-W_{\theta,\phi}^{(1-\alpha)}(z_{i};x)\right)+W_{\theta,\phi}^{(1-\alpha)}(z_{i};x)\right]\right)=o\left(\frac{1}{N}\right) (42) and \mathbb{V}\left(\alpha\sum_{j=1}^{N}W_{\theta,\phi}^{(1-\alpha)}(z_{j};x)\partial_{\psi}\log q_{\phi}(z_{j}|x)\right)\\ =\frac{1}{N}\mathbb{V}\left(\alpha\penalty\ \frac{w_{\theta,\phi}(z;x)^{1-\alpha}}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})}\left[\partial_{\psi}\log q_{\phi}(z|x)-\frac{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha}\partial_{\psi}\log q_{\phi}(z|x))}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})}\right]\right)+o\left(\frac{1}{N}\right) (43) as well as \alpha\log\left(\frac{N}{N-1}\right)\mathbb{C}\mathrm{ov}\left(\sum_{j=1}^{N}W_{\theta,\phi}^{(1-\alpha)}(z_{j};x)\partial_{\psi}\log q_{\phi}(z_{j}|x),\sum_{i=1}^{N}\partial_{\psi}\log q_{\phi}(z_{i}|x)\right)\\ =\frac{1}{N}\mathbb{C}\mathrm{ov}\left(\frac{\alpha\penalty\ w_{\theta,\phi}(z;x)^{1-\alpha}}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})}\biggl[\partial_{\psi}\log q_{\phi}(z|x)\right.\\ \left.-\frac{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha}\partial_{\psi}\log q_{\phi}(z|x))}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})}\biggr],\partial_{\psi}\log q_{\phi}(z|x)\right)+o\left(\frac{1}{N}\right). (44) (i) Proof of ( 42 ). Denoting \displaystyle B_{N}^{(\alpha)}=\mathbb{V}\left(\sum_{i=1}^{N}\partial_{\psi}\log q_{\phi}(z_{i}|x)\left[\log\left(1-W_{\theta,\phi}^{(1-\alpha)}(z_{i};x)\right)+W_{\theta,\phi}^{(1-\alpha)}(z_{i};x)\right]\right), we will get ( 42 ) if we can show that B_{N}^{(\alpha)}=o\left(1/N\right) . Since \displaystyle B_{N}^{(\alpha)}\leq\mathbb{E}\left(\left(\sum_{i=1}^{N}\partial_{\psi}\log q_{\phi}(z_{i}|x)\left[\log\left(1-W_{\theta,\phi}^{(1-\alpha)}(z_{i};x)\right)+W_{\theta,\phi}^{(1-\alpha)}(z_{i};x)\right]\right)^{2}\right), setting r=1-W_{\theta,\phi}^{(1-\alpha)}(z_{i};x) , we have that r>0 and ( 28 ) from 2 with k=1 implies \displaystyle|B_{N}^{(\alpha)}|\leq\frac{1}{4}\mathbb{E}\left(\left(\sum_{i=1}^{N}\left(W_{\theta,\phi}^{(1-\alpha)}(z_{i};x)\right)^{2}|\partial_{\psi}\log q_{\phi}(z_{i}|x)|\left[1+\frac{1}{1-W_{\theta,\phi}^{(1-\alpha)}(z_{i};x)}\right]\right)^{2}\right). Consequently, we have that |B_{N}^{(\alpha)}|\leq\mathbb{E}\left(\left(\sum_{i=1}^{N}\left(W_{\theta,\phi}^{(1-\alpha)}(z_{i};x)\right)^{2}|\partial_{\psi}\log q_{\phi}(z_{i}|x)|\right)^{2}\right)\\ +\mathbb{E}\left(\left(\sum_{i=1}^{N}\left(W_{\theta,\phi}^{(1-\alpha)}(z_{i};x)\right)^{2}|\partial_{\psi}\log q_{\phi}(z_{i}|x)|\frac{1}{1-W_{\theta,\phi}^{(1-\alpha)}(z_{i};x)}\right)^{2}\right). (45) Denoting X=w_{\theta,\phi}(z;x)^{2(1-\alpha)}|\partial_{\psi}\log q_{\phi}(z|x)| , \overline{X}_{N}=1/N\sum_{i=1}^{N}w_{\theta,\phi}(z_{i};x)^{2(1-\alpha)}|\partial_{\psi}\log q_{\phi}(z_{i}|x)| , Y=w_{\theta,\phi}(z;x)^{1-\alpha} and \overline{Y}_{N}=1/N\sum_{i=1}^{N}w_{\theta,\phi}(z_{i};x)^{1-\alpha} , the first term in the right-hand side of ( 45 ) becomes \displaystyle\frac{1}{N^{2}}\mathbb{E}\left(\left(\frac{\overline{X}_{N}}{\overline{Y}_{N}^{2}}\right)^{2}\right)=\frac{1}{N^{2}}\left[\mathbb{V}\left(\frac{\overline{X}_{N}}{\overline{Y}_{N}^{2}}\right)+\mathbb{E}\left(\frac{\overline{X}_{N}}{\overline{Y}_{N}^{2}}\right)^{2}\right]. Under our assumptions, we can apply ( 84 ) and ( 81 ) from 7 which yields: as N\to\infty , \displaystyle\mathbb{V}\left(\frac{\overline{X}_{N}}{\overline{Y}_{N}^{2}}\right)=\frac{1}{N}\frac{\mathbb{V}\left(X-2Y\frac{\mathbb{E}(X)}{\mathbb{E}(Y)}\right)}{\mathbb{E}(Y)^{4}}+o\left(\frac{1}{N}\right) \displaystyle\mathbb{E}\left(\frac{\overline{X}_{N}}{\overline{Y}_{N}^{2}}\right)=\frac{\mathbb{E}(X)}{\mathbb{E}(Y)^{2}}+o(1) so that the first term in the right-hand side of ( 45 ) is o(1/N) . As for the second term in the right-hand side of ( 45 ), it is o(1/N) by 3 with (\ell,\eta)=(1,0) . Consequently, we have obtained that |B_{N}^{(\alpha)}|=o(1/N) . (ii) Proof of ( 43 ) and ( 44 ). First note that ( 43 ) and ( 44 ) are immediate when \alpha=0 , so we only need to show them for \alpha\in(0,1) . Letting \alpha\in(0,1) from now on, we can apply ( 84 ) from 7 under our assumptions, which yields ( 43 ). Furthermore, denoting X=w_{\theta,\phi}(z;x)^{1-\alpha}\partial_{\psi}\log q_{\phi}(z|x) , Y=w_{\theta,\phi}(z;x)^{1-\alpha} , Z=\partial_{\psi}\log q_{\phi}(z|x) , \overline{X}_{N}=\sum_{j=1}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}\partial_{\psi}\log q_{\phi}(z_{j}|x) , \overline{Y}_{N}=\sum_{j=1}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha} as well as \overline{Z}_{N}=N^{-1}\sum_{i=1}^{N}\partial_{\psi}\log q_{\phi}(z_{i}|x) , we can rewrite ( 44 ) as \displaystyle\alpha\log\left(\frac{N}{N-1}\right)N\mathbb{E}\left(\frac{\overline{X}_{N}}{\overline{Y}_{N}}\overline{Z}_{N}\right)=\frac{\alpha}{N}\mathbb{C}\mathrm{ov}\left(\frac{X}{\mathbb{E}(Y)}-Y\frac{\mathbb{E}(X)}{\mathbb{E}(Y)^{2}},Z\right)+o\left(\frac{1}{N}\right). (46) Let us thus show ( 46 ). Using that \mathbb{E}(\overline{Z}_{N})=0 , we begin by writing that \displaystyle\mathbb{E}\left(\frac{\overline{X}_{N}}{\overline{Y}_{N}}\overline{Z}_{N}\right)=\mathbb{E}\left(\frac{(\overline{X}_{N}-\mathbb{E}(X))\overline{Z}_{N}}{\overline{Y}_{N}}\right)-\frac{\mathbb{E}(X)}{\mathbb{E}(Y)}\mathbb{E}\left(\frac{(\overline{Y}_{N}-\mathbb{E}(Y))\overline{Z}_{N}}{\overline{Y}_{N}}\right). Next using that 1/\overline{Y}_{N}=1/\mathbb{E}(Y)+(\mathbb{E}(Y)-\overline{Y}_{N})/(\mathbb{E}(Y)\overline{Y}_{N}) , we get \mathbb{E}\left(\frac{\overline{X}_{N}}{\overline{Y}_{N}}\overline{Z}_{N}\right)=\frac{\mathbb{E}((\overline{X}_{N}-\mathbb{E}(X))\overline{Z}_{N})}{\mathbb{E}(Y)}-\frac{1}{\mathbb{E}(Y)}\mathbb{E}\left(\frac{(\overline{X}_{N}-\mathbb{E}(X))\overline{Z}_{N}(\overline{Y}_{N}-\mathbb{E}(Y))}{\overline{Y}_{N}}\right)\\ -\frac{\mathbb{E}(X)}{\mathbb{E}(Y)^{2}}\mathbb{E}\left({(\overline{Y}_{N}-\mathbb{E}(Y))\overline{Z}_{N}}\right)+\frac{\mathbb{E}(X)}{\mathbb{E}(Y)^{2}}\mathbb{E}\left(\frac{(\overline{Y}_{N}-\mathbb{E}(Y))^{2}\overline{Z}_{N}}{\overline{Y}_{N}}\right). In other words, \mathbb{E}\left(\frac{\overline{X}_{N}}{\overline{Y}_{N}}\overline{Z}_{N}\right)=\frac{1}{N}\left(\frac{\mathbb{C}\mathrm{ov}(X,Z)}{\mathbb{E}(Y)}-\frac{\mathbb{E}(X)\mathbb{C}\mathrm{ov}(Y,Z)}{\mathbb{E}(Y)^{2}}\right)\\ +\frac{1}{\mathbb{E}(Y)}\left[\frac{\mathbb{E}(X)}{\mathbb{E}(Y)}\mathbb{E}\left(\frac{(\overline{Y}_{N}-\mathbb{E}(Y))^{2}\overline{Z}_{N}}{\overline{Y}_{N}}\right)-\mathbb{E}\left(\frac{(\overline{X}_{N}-\mathbb{E}(X))\overline{Z}_{N}(\overline{Y}_{N}-\mathbb{E}(Y))}{\overline{Y}_{N}}\right)\right]. Under our assumptions, we have using (ii) from 7 that \displaystyle\mathbb{E}\left(\frac{(\overline{Y}_{N}-\mathbb{E}(Y))^{2}\overline{Z}_{N}}{\overline{Y}_{N}}\right)=o\left(\frac{1}{N}\right). Furthermore, using the Cauchy-Schwartz inequality twice yields \displaystyle\mathbb{E}\left(\frac{(\overline{X}_{N}-\mathbb{E}(X))\overline{Z}_{N}(\overline{Y}_{N}-\mathbb{E}(Y))}{\overline{Y}_{N}}\right)\leq\left(\frac{\mathbb{V}(X)}{N}\right)^{\frac{1}{2}}\mathbb{E}(\overline{Z}_{N}^{4})^{\frac{1}{4}}\mathbb{E}\left(\frac{(\overline{Y}_{N}-\mathbb{E}(Y))^{4}}{\overline{Y}_{N}^{4}}\right)^{\frac{1}{4}}. Under our assumptions, we can apply (i) equation ( 85 ) from 8 and (ii) 6 which gives for all \mu>0 : as N\to\infty , \mathbb{E}((\overline{Y}_{N})^{-\mu})=O(1) so that \displaystyle\sup_{N\in\mathbb{N}^{*}}N^{\frac{1}{2}}\mathbb{E}(\overline{Z}_{N}^{4})^{\frac{1}{4}}<\infty \displaystyle\sup_{N\in\mathbb{N}^{*}}N^{\frac{1}{2}}\mathbb{E}\left(\frac{(\overline{Y}_{N}-\mathbb{E}(Y))^{4}}{\overline{Y}_{N}^{4}}\right)^{\frac{1}{4}}<\infty. We deduce \displaystyle\mathbb{E}\left(\frac{(\overline{X}_{N}-\mathbb{E}(X))\overline{Z}_{N}(\overline{Y}_{N}-\mathbb{E}(Y))}{\overline{Y}_{N}}\right)=o\left(\frac{1}{N}\right). and the proof of ( 46 ) is completed. ∎ Remark 3 (From \psi\text{-}g_{N}^{(\alpha,\mathrm{NAIVE})}(\theta,\phi;x) to \psi\text{-}g_{N}^{(\alpha,\mathrm{VIMCO\text{-}AM})}(\theta,\phi;x) ) The VIMCO-AM gradient estimator can be constructed as the logical estimator with per-sample baselines to build from an intermediate (INTER) estimator with a global baseline and a higher asymptotic variance. To see this, we highlight an intermediary result used in the proof of 2 : under the assumptions of 2 and as N\to\infty , ( 40 ) from Section B.2 states that \mathbb{V}\left(\left(\sum_{i=1}^{N}\partial_{\psi}\log q_{\phi}(z_{i}|x)\right)\log\left(\frac{1}{N}\sum_{j=1}^{N}\frac{w_{\theta,\phi}(z_{j};x)^{1-\alpha}}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})}\right)\right)\\ =\mathbb{V}(\partial_{\psi}\log q_{\phi}(z|x))\mathbb{V}\left(\frac{w_{\theta,\phi}(z;x)^{1-\alpha}}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})}\right)+{\mathbb{C}\mathrm{ov}\left(\partial_{\psi}\log q_{\phi}(z|x),\frac{w_{\theta,\phi}(z;x)^{1-\alpha}}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})}\right)}^{2}+o(1). Now denoting \psi\text{-}g_{N}^{(\alpha,\mathrm{INTER})}(\theta,\phi;x)=\sum_{j=1}^{N}W_{\theta,\phi}^{(1-\alpha)}(z_{j};x)\partial_{\psi}\log w_{\theta,\phi}(z_{j};x)\\ +\frac{1}{1-\alpha}\sum_{i=1}^{N}\partial_{\psi}\log q_{\phi}(z_{i}|x)\left[\log\left(\frac{1}{N}\sum_{j=1}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}\right)-\log\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})\right], (47) it holds that \mathbb{E}(\psi\text{-}g_{N}^{(\alpha,\mathrm{INTER})}(\theta,\phi;x))=\partial_{\psi}\ell^{(\alpha)}_{N}(\theta,\phi;x) , with 1 and ( 40 ) also implying that \mathbb{V}(\psi\text{-}g_{N}^{(\alpha,\mathrm{INTER})}(\theta,\phi;x))=O(1) as N\to\infty under the assumptions of 2 . Hence, the asymptotic variance of the INTER gradient estimator is lower than that of the NAIVE gradient estimator ( 8 ) when \psi\in\{\phi_{1},\ldots,\phi_{b}\} thanks to having included a global baseline in its second term which corresponds to the almost sure limit as N\to\infty of \log(N^{-1}\sum_{j=1}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}) . Noting that the INTER gradient estimator ( 47 ) is unusable in practice due to \mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha}) being untractable, the VIMCO-AM gradient estimator is the more asymptotically efficient practical version of the INTER one. Indeed, writing that \displaystyle\frac{1}{N}\left(\sum_{\overset{j=1}{{j\neq i}}}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}+f_{-i}^{(\alpha)}(z_{1:N},\theta,\phi;x)\right)=\frac{1}{N-1}\sum_{\overset{j=1}{{j\neq i}}}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}, the VIMCO-AM gradient estimator replaces the baseline \log\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha}) by per-sample estimators of it and enjoys an improved asymptotic variance compared to the INTER one. B.4 Proof of 4 We will make use of the following inequality: for all a,b\in\mathbb{R} , \displaystyle|\exp(a)-\exp(b)|=\left|\int_{b}^{a}\exp(t)\mathrm{d}t\right|\leq\left(\exp(a)+\exp(b)\right)|a-b|, (48) which follows since u\mapsto\exp(u) is an increasing function on \mathbb{R} . We next present a lemma. Lemma 4 Let (Y,Z) be an \mathbb{R}_{+}^{*}\times\mathbb{R} random vector. Let (Y_{1},Z_{1}),(Y_{2},Z_{2}),\ldots be a sequence of i.i.d. random vectors with the same distribution as (Y,Z) . Assume that \mathbb{E}(Y^{h})<\infty , \mathbb{E}(|Z|^{h^{\prime}})<\infty , \mathbb{E}((Y|Z|)^{h^{\prime\prime}}) and \mathbb{E}(|\log(Y)|^{h^{\prime\prime\prime}})<\infty with h>2 , h^{\prime},h^{\prime\prime},h^{\prime\prime\prime}>4 . For all N\in\mathbb{N}^{*} , denote \overline{X}_{N}=(N-1)^{-1}\sum_{i=1}^{N}\log Y_{i} , \overline{Y}_{N}=N^{-1}\sum_{i=1}^{N}Y_{i} and \overline{Z}_{N}=N^{-1}\sum_{i=1}^{N}Z_{i} . Further assume that there exist N\geq 1 and \mu>0 such that \mathbb{E}(\overline{Y}_{N}^{-\mu})<\infty . Then: as N\to\infty , \displaystyle\mathbb{E}\left(\frac{\exp(\overline{X}_{N})}{\overline{Y}_{N}}\overline{Z}_{N}\right)=\frac{\exp(\mathbb{E}(X))}{\mathbb{E}(Y)}\mathbb{E}(Z)+o(1) (49) \displaystyle\mathbb{V}\left(\frac{\exp(\overline{X}_{N})}{\overline{Y}_{N}}\overline{Z}_{N}\right)=\frac{\boldsymbol{v}^{T}\boldsymbol{\Sigma}\boldsymbol{v}}{N}+o\left(\frac{1}{N}\right). (50) where \displaystyle\boldsymbol{\Sigma}=\left(\begin{matrix}\mathbb{V}(X)&\mathbb{C}\mathrm{ov}(X,Y)&\mathbb{C}\mathrm{ov}(X,Z)\\ \mathbb{C}\mathrm{ov}(X,Y)&\mathbb{V}\left(Y\right)&\mathbb{C}\mathrm{ov}(Y,Z)\\ \mathbb{C}\mathrm{ov}(X,Z)&\mathbb{C}\mathrm{ov}(Y,Z)&\mathbb{V}(Z)\\ \end{matrix}\right)\quad\mbox{and}\quad\boldsymbol{v}=\frac{\exp(\mathbb{E}(X))}{\mathbb{E}(Y)}\left[\begin{matrix}{\mathbb{E}(Z)}\\ -\frac{\mathbb{E}(Z)}{\mathbb{E}(Y)}\\ 1\end{matrix}\right]. Proof. The central limit theorem paired up with the multivariate Delta method yields \displaystyle\sqrt{N}\left(\frac{\exp(\overline{X}_{N})}{\overline{Y}_{N}}\overline{Z}_{N}-\frac{\exp(\mathbb{E}(X))}{\mathbb{E}(Y)}\mathbb{E}(Z)\right)\overset{\mathrm{dist.}}{\longrightarrow}\mathcal{N}(0,\boldsymbol{v}^{T}\boldsymbol{\Sigma}\boldsymbol{v}). As a result, the desired expressions ( 49 ) and ( 50 ) will follow by showing that the sequence \left(N\left(\frac{\exp(\overline{X}_{N})}{\overline{Y}_{N}}\overline{Z}_{N}-\frac{\exp(\mathbb{E}(X))}{\mathbb{E}(Y)}\mathbb{E}(Z)\right)^{2}\right)_{N\geq 1} is uniformly integrable. Let us thus show that for a certain \delta>0 , we have that \displaystyle\limsup_{N\to\infty}\mathbb{E}\left(N^{1+\delta}\left|\frac{\exp(\overline{X}_{N})}{\overline{Y}_{N}}\overline{Z}_{N}-\frac{\exp(\mathbb{E}(X))}{\mathbb{E}(Y)}\mathbb{E}(Z)\right|^{2(1+\delta)}\right)<\infty. (51) We begin by writing that 2^{1-2(1+\delta)}\mathbb{E}\left(\left|\frac{\exp(\overline{X}_{N})}{\overline{Y}_{N}}\overline{Z}_{N}-\frac{\exp(\mathbb{E}(X))}{\mathbb{E}(Y)}\mathbb{E}(Z)\right|^{2(1+\delta)}\right)\\ \leq\mathbb{E}\left(\left|\frac{\exp(\overline{X}_{N})-\exp(\mathbb{E}(X))}{\overline{Y}_{N}}\overline{Z}_{N}\right|^{2(1+\delta)}\right)+\exp(2(1+\delta)\mathbb{E}(X))\mathbb{E}\left(\left|\frac{\overline{Z}_{N}}{\overline{Y}_{N}}-\frac{\mathbb{E}(Z)}{\mathbb{E}(Y)}\right|^{2(1+\delta)}\right). Hence, ( 51 ) will follow if we can show that \displaystyle\limsup_{N\to\infty}\mathbb{E}\left(N^{1+\delta}\left|\frac{\overline{Z}_{N}}{\overline{Y}_{N}}-\frac{\mathbb{E}(Z)}{\mathbb{E}(Y)}\right|^{2(1+\delta)}\right)<\infty. (52) \displaystyle\limsup_{N\to\infty}\mathbb{E}\left(N^{1+\delta}\left|\frac{\exp(\overline{X}_{N})-\exp(\mathbb{E}(X))}{\overline{Y}_{N}}\overline{Z}_{N}\right|^{2(1+\delta)}\right)<\infty. (53) We prove ( 52 ) and ( 53 ) separately. (i) Proof of ( 52 ). Since \displaystyle\frac{\overline{Z}_{N}}{\overline{Y}_{N}}-\frac{\mathbb{E}(Z)}{\mathbb{E}(Y)}=\frac{\overline{Z}_{N}-\mathbb{E}(Z)}{\overline{Y}_{N}}-\frac{\mathbb{E}(X)}{\mathbb{E}(Y)}\frac{\overline{Y}_{N}-\mathbb{E}(Y)}{\overline{Y}_{N}}, ( 52 ) holds if we can show that \displaystyle\mathbb{E}\left(N^{1+\delta}\left|\frac{\overline{Z}_{N}-\mathbb{E}(Z)}{\overline{Y}_{N}}\right|^{2(1+\delta)}\right)=O(1)\quad\mbox{and}\quad\mathbb{E}\left(N^{1+\delta}\left|\frac{\overline{Y}_{N}-\mathbb{E}(Y)}{\overline{Y}_{N}}\right|^{2(1+\delta)}\right)=O(1). Letting p,q>1 and setting 2(1+\delta)p=h and 2(1+\delta)q=h^{\prime} , the two previous asymptotic bounds hold using Hölder’s inequality paired up with ( 85 ) and the fact that for all \mu>0 : \mathbb{E}((\overline{Y}_{N})^{-\mu})=O(1) as N\to\infty by 6 . (ii) Proof of ( 53 ). Using ( 48 ) with (a,b)=(\overline{X}_{N},\mathbb{E}(X)) yields 2^{1-2(1+\delta)}\mathbb{E}\left(\left|\frac{\exp(\overline{X}_{N})-\exp(\mathbb{E}(X))}{\overline{Y}_{N}}\overline{Z}_{N}\right|^{2(1+\delta)}\right)\leq\mathbb{E}\left(\left(\frac{\exp(\overline{X}_{N})|\overline{X}_{N}-\mathbb{E}(X)|}{\overline{Y}_{N}}|\overline{Z}_{N}|\right)^{2(1+\delta)}\right)\\ +\exp(2(1+\delta)\mathbb{E}(X))\mathbb{E}\left(\left(\frac{|\overline{X}_{N}-\mathbb{E}(X)|}{\overline{Y}_{N}}|\overline{Z}_{N}|\right)^{2(1+\delta)}\right). (54) Focusing first on the first term of the right-hand side above, we get that \mathbb{E}\left(\left(\frac{\exp(\overline{X}_{N})|\overline{X}_{N}-\mathbb{E}(X)|}{\overline{Y}_{N}}|\overline{Z}_{N}|\right)^{2(1+\delta)}\right)\\ \leq\mathbb{E}\left(\left(|\overline{X}_{N}-\mathbb{E}(X)|\frac{1}{N}\sum_{i=1}^{N}\frac{\exp\left(\frac{1}{N-1}\sum_{{j=1},{j\neq i}}^{N}\log Y_{j}\right)}{\overline{Y}_{N}}\exp\left(\frac{1}{N-1}\log Y_{i}\right)|Z_{i}|\right)^{2(1+\delta)}\right). Furthermore, Jensen’s inequality yields \displaystyle{\exp\left(\frac{1}{N-1}\sum_{{j=1},{j\neq i}}^{N}\log Y_{j}\right)}\leq\frac{1}{N-1}\sum_{{j=1},{j\neq i}}^{N}Y_{j}\leq\frac{N}{N-1}{\overline{Y}_{N}} and for all i=1\ldots N we also have that \exp\left(\frac{1}{N-1}\log Y_{i}\right)\leq 1+Y_{i} . As a result, we deduce \displaystyle\mathbb{E}\left(\left(\frac{\exp(\overline{X}_{N})|\overline{X}_{N}-\mathbb{E}(X)|}{|\overline{Y}_{N}|}|\overline{Z}_{N}|\right)^{2(1+\delta)}\right)\leq\mathbb{E}\left(\left(|\overline{X}_{N}-\mathbb{E}(X)|\frac{1}{N-1}\sum_{i=1}^{N}(1+Y_{i})|Z_{i}|\right)^{2(1+\delta)}\right). Consequently, we will obtain that \displaystyle\limsup_{N\to\infty}\mathbb{E}\left(N^{1+\delta}\left(\frac{\exp(\overline{X}_{N})|\overline{X}_{N}-\mathbb{E}(X)|}{|\overline{Y}_{N}|}|\overline{Z}_{N}|\right)^{2(1+\delta)}\right)<\infty if we can show that \displaystyle\mathbb{E}(N^{1+\delta}|\overline{X}_{N}-\mathbb{E}(X)|^{2(1+\delta)})=O(1) \displaystyle\mathbb{E}\left(N^{1+\delta}\left(|\overline{X}_{N}-\mathbb{E}(X)|\times\left|\frac{1}{N}\sum_{i=1}^{N}(1+Y_{i})|Z_{i}|-\mathbb{E}((1+Y)|Z|)\right|\right)^{2(1+\delta)}\right)=O(1). The first asymptotic bound follows from ( 85 ). As for the second asymptotic bound, it follows from the Cauchy-Schwartz inequality paired up with ( 85 ). Similarly, the second term in the right-hand side of ( 54 ) satisfies \limsup_{N\to\infty}\mathbb{E}\left(N^{1+\delta}\left(\frac{|\overline{X}_{N}-\mathbb{E}(X)|}{\overline{Y}_{N}}|\overline{Z}_{N}|\right)^{2(1+\delta)}\right)<\infty, and the proof of ( 53 ) is concluded. ∎ Proof of 4 . We decompose \psi\text{-}g_{N}^{(\alpha,\mathrm{VIMCO\text{-}GM})}(\theta,\phi;x) as follows \psi\text{-}g_{N}^{(\alpha,\mathrm{VIMCO\text{-}GM})}(\theta,\phi;x)\\ =\frac{1}{1-\alpha}\sum_{j=1}^{N}\frac{\alpha\penalty\ w_{\theta,\phi}(z_{j};x)^{1-\alpha}-\exp\left(\frac{1-\alpha}{N-1}\sum_{i=1}^{N}\log w_{\theta,\phi}(z_{i};x)\right)}{\sum_{\ell=1}^{N}w_{\theta,\phi}(z_{\ell};x)^{1-\alpha}}\partial_{\psi}\log q_{\phi}(z_{j}|x)\\ +R_{1,N}^{(\alpha)}(\theta,\phi;x)+R_{1,N}^{{}^{\prime}(\alpha)}(\theta,\phi;x), where \displaystyle R_{1,N}^{(\alpha)}(\theta,\phi;x)=-\frac{1}{1-\alpha}\sum_{i=1}^{N}\partial_{\psi}\log q_{\phi}(z_{i}|x)\left[\log\left(1-g_{i}^{(\alpha)}(z_{1:N},\theta,\phi;x)\right)+g_{i}^{(\alpha)}(z_{1:N},\theta,\phi;x)\right] \displaystyle g_{i}^{(\alpha)}(z_{1:N},\theta,\phi;x)=\frac{w_{\theta,\phi}(z_{i};x)^{1-\alpha}-f_{-i}^{(\alpha)}(z_{1:N},\theta,\phi;x)}{\sum_{j=1}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}},\quad i=1\ldots N \displaystyle f_{-i}^{(\alpha)}(z_{1:N},\theta,\phi;x)=\exp\left(\frac{1}{N-1}\sum_{\overset{j=1}{{j\neq i}}}^{N}\log(w_{\theta,\phi}(z_{j};x)^{1-\alpha})\right),\quad i=1\ldots N and R_{1,N}^{{}^{\prime}(\alpha)}(\theta,\phi;x)\\ =\frac{1}{1-\alpha}\exp\left(\frac{1-\alpha}{N-1}\sum_{i=1}^{N}\log w_{\theta,\phi}(z_{i};x)\right)\sum_{j=1}^{N}\frac{\exp\left(-\frac{1-\alpha}{N-1}\log w_{\theta,\phi}(z_{j};x)\right)-1}{\sum_{\ell=1}^{N}w_{\theta,\phi}(z_{\ell};x)^{1-\alpha}}\partial_{\psi}\log q_{\phi}(z_{j}|x). The proof of 4 will be concluded if we can show that \displaystyle\mathbb{V}\left(R_{1,N}^{(\alpha)}(\theta,\phi;x)+R_{1,N}^{{}^{\prime}(\alpha)}(\theta,\phi;x)\right)=o\left(\frac{1}{N}\right) (55) \displaystyle\mathbb{V}\left(\sum_{j=1}^{N}\frac{\exp\left(\frac{1-\alpha}{N-1}\sum_{i=1}^{N}\log w_{\theta,\phi}(z_{i};x)\right)}{\sum_{\ell=1}^{N}w_{\theta,\phi}(z_{\ell};x)^{1-\alpha}}\partial_{\psi}\log q_{\phi}(z_{j}|x)\right) \displaystyle\qquad\qquad\qquad\qquad=\left(\frac{\exp[(1-\alpha)\mathbb{E}(\log w_{\theta,\phi}(z;x))]}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})}\right)^{2}\frac{\mathbb{V}(\partial_{\psi}\log q_{\phi}(z|x))}{N}+o\left(\frac{1}{N}\right) (56) that ( 43 ) holds and that \alpha\mathbb{C}\mathrm{ov}\left(\sum_{j=1}^{N}W_{\theta,\phi}^{(1-\alpha)}(z_{j};x)\partial_{\psi}\log q_{\phi}(z_{j}|x),\sum_{j=1}^{N}\frac{\exp\left(\frac{1-\alpha}{N-1}\sum_{i=1}^{N}\log w_{\theta,\phi}(z_{i};x)\right)}{\sum_{\ell=1}^{N}w_{\theta,\phi}(z_{\ell};x)^{1-\alpha}}\partial_{\psi}\log q_{\phi}(z_{j}|x)\right)\\ =\frac{1}{N}\mathbb{C}\mathrm{ov}\left(U,V\right)+o\left(\frac{1}{N}\right) (57) where \displaystyle U=\frac{\alpha\penalty\ w_{\theta,\phi}(z;x)^{1-\alpha}}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})}\biggl[\partial_{\psi}\log q_{\phi}(z|x)-\frac{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha}\partial_{\psi}\log q_{\phi}(z|x))}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})}\biggr] \displaystyle V=\frac{\exp[(1-\alpha)\mathbb{E}(\log w_{\theta,\phi}(z;x))]}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})}\partial_{\psi}\log q_{\phi}(z|x). (i) Proof of ( 55 ). We begin by writing that \displaystyle\mathbb{V}\left(R_{1,N}^{(\alpha)}(\theta,\phi;x)+R_{1,N}^{{}^{\prime}(\alpha)}(\theta,\phi;x)\right) \displaystyle\leq\mathbb{E}\left(\left(R_{1,N}^{(\alpha)}(\theta,\phi;x)+R_{1,N}^{{}^{\prime}(\alpha)}(\theta,\phi;x)\right)^{2}\right) \displaystyle\leq 2\left(\mathbb{E}(R_{1,N}^{(\alpha)}(\theta,\phi;x)^{2})+\mathbb{E}(R_{1,N}^{{}^{\prime}(\alpha)}(\theta,\phi;x)^{2})\right). On the one hand, 2 with k=1 yields: for all i=1\ldots N , \left|\log\left(1-g_{i}^{(\alpha)}(z_{1:N},\theta,\phi;x)\right)+g_{i}^{(\alpha)}(z_{1:N},\theta,\phi;x)\right|\\ \leq\frac{1}{2}\left(g_{i}^{(\alpha)}(z_{1:N},\theta,\phi;x)\right)^{2}\left(1+\frac{1}{1-g_{i}^{(\alpha)}(z_{1:N},\theta,\phi;x)}\right) and since f_{-i}^{(\alpha)}(z_{1:N},\theta,\phi;x)\geq 0 , we deduce \left|\log\left(1-g_{i}^{(\alpha)}(z_{1:N},\theta,\phi;x)\right)+g_{i}^{(\alpha)}(z_{1:N},\theta,\phi;x)\right|\\ \leq\frac{1}{2}\left(g_{i}^{(\alpha)}(z_{1:N},\theta,\phi;x)\right)^{2}\left(1+\frac{\sum_{j=1}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}}{\sum_{\overset{j=1}{{j\neq i}}}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}}\right). (58) On the other hand, ( 48 ) with (a,b)=(-\frac{1-\alpha}{N-1}\log w_{\theta,\phi}(z_{j};x),0) implies that for all j=1\ldots N , \left|\exp\left(-\frac{1-\alpha}{N-1}\log w_{\theta,\phi}(z_{j};x)\right)-1\right|\\ \leq\left(\exp\left(-\frac{1-\alpha}{N-1}\log w_{\theta,\phi}(z_{j};x)\right)+1\right)\left|\frac{1-\alpha}{N-1}\log w_{\theta,\phi}(z_{j};x)\right|. (59) We thus deduce from ( 58 ) and ( 59 ) that \displaystyle(1-\alpha)^{2}\mathbb{V}\left(R_{1,N}^{(\alpha)}(\theta,\phi;x)+R_{1,N}^{{}^{\prime}(\alpha)}(\theta,\phi;x)\right)\leq A_{N}^{(\alpha)}(\theta,\phi;x)+B_{N}^{(\alpha)}(\theta\phi;x) (60) where 2A_{N}^{(\alpha)}(\theta,\phi;x)\\ =\mathbb{E}\left(\left(\sum_{i=1}^{N}\left(g_{i}^{(\alpha)}(z_{1:N},\theta,\phi;x)\right)^{2}|\partial_{\psi}\log q_{\phi}(z_{i}|x)|\left(1+\frac{\sum_{j=1}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}}{\sum_{\overset{j=1}{{j\neq i}}}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}}\right)\right)^{2}\right) and B_{N}^{(\alpha)}(\theta\phi;x)=2\mathbb{E}\left(\left[\exp\left(\frac{1-\alpha}{N-1}\sum_{i=1}^{N}\log w_{\theta,\phi}(z_{i};x)\right)\right.\right.\\ \times\left.\left.\sum_{j=1}^{N}\frac{\left(\exp\left(-\frac{1-\alpha}{N-1}\log w_{\theta,\phi}(z_{j};x)\right)+1\right)\left|\frac{1-\alpha}{N-1}\log w_{\theta,\phi}(z_{j};x)\right|}{\sum_{\ell=1}^{N}w_{\theta,\phi}(z_{\ell};x)^{1-\alpha}}|\partial_{\psi}\log q_{\phi}(z_{j}|x)|\right]^{2}\right). We now study A_{N}^{(\alpha)}(\theta,\phi;x) and B_{N}^{(\alpha)}(\theta,\phi;x) separately and show that they are both o(1/N) . Study of A_{N}^{(\alpha)}(\theta,\phi;x) . First note that by Jensen’s inequality: for all i=1\ldots N , \displaystyle f_{-i}^{(\alpha)}(z_{1:N},\theta,\phi;x)\leq\frac{1}{N-1}\sum_{\overset{j=1}{j\neq i}}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}\leq\frac{1}{N-1}\sum_{{j=1}}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}. (61) Since (w_{\theta,\phi}(z_{i};x)^{1-\alpha}-f_{-i}^{(\alpha)}(z_{1:N},\theta,\phi;x))^{2}\leq 2\left(w_{\theta,\phi}(z_{i};x)^{2(1-\alpha)}+f_{-i}^{(\alpha)}(z_{1:N},\theta,\phi;x)^{2}\right) , we thus have that \displaystyle A_{N}^{(\alpha)}(\theta,\phi;x) \displaystyle\leq 4\mathbb{E}\left(\left(\sum_{i=1}^{N}\left(W_{\theta,\phi}^{(1-\alpha)}(z_{i};x)\right)^{2}|\partial_{\psi}\log q_{\phi}(z_{i}|x)|\left(1+\frac{\sum_{j=1}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}}{\sum_{\overset{j=1}{{j\neq i}}}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}}\right)\right)^{2}\right) \displaystyle\quad\frac{4}{(N-1)^{4}}\mathbb{E}\left(\left(\sum_{i=1}^{N}|\partial_{\psi}\log q_{\phi}(z_{i}|x)|\left(1+\frac{\sum_{j=1}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}}{\sum_{\overset{j=1}{{j\neq i}}}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}}\right)\right)^{2}\right). (62) From there, 3 with (\ell,\eta)=(1,0) then implies that the first term in the right-hand side of ( 62 ) is o(1/N) . As for the second term in the right-hand side of ( 62 ), writing that \displaystyle 1+\frac{\sum_{j=1}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}}{\sum_{\overset{j=1}{{j\neq i}}}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}}=2+\frac{w_{\theta,\phi}(z_{i};x)^{1-\alpha}}{\sum_{\overset{j=1}{{j\neq i}}}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}} we deduce \mathbb{E}\left(\left(\sum_{i=1}^{N}|\partial_{\psi}\log q_{\phi}(z_{i}|x)|\left(1+\frac{\sum_{j=1}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}}{\sum_{\overset{j=1}{{j\neq i}}}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}}\right)\right)^{2}\right)\\ \leq 8\mathbb{E}\left(\left(\sum_{i=1}^{N}|\partial_{\psi}\log q_{\phi}(z_{i}|x)|\right)^{2}\right)+2\mathbb{E}\left(\left(\sum_{i=1}^{N}\frac{w_{\theta,\phi}(z_{i};x)^{1-\alpha}|\partial_{\psi}\log q_{\phi}(z_{i}|x)|}{\sum_{\overset{j=1}{{j\neq i}}}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}}\right)^{2}\right). Now using that (\sum_{i=1}^{N}u_{i})^{2}\leq N\sum_{i=1}^{N}u_{i}^{2} by the Cauchy-Schwartz inequality, we get \displaystyle\mathbb{E}\left(\left(\sum_{i=1}^{N}|\partial_{\psi}\log q_{\phi}(z_{i}|x)|\right)^{2}\right)\leq N^{2}\mathbb{V}\left(\partial_{\psi}\log q_{\phi}(z|x)\right) \displaystyle\mathbb{E}\left(\left(\sum_{i=1}^{N}\frac{w_{\theta,\phi}(z_{i};x)^{1-\alpha}|\partial_{\psi}\log q_{\phi}(z_{i}|x)|}{\sum_{\overset{j=1}{{j\neq i}}}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}}\right)^{2}\right)\leq N\mathbb{E}\left(\sum_{i=1}^{N}\left(\frac{w_{\theta,\phi}(z_{i};x)^{1-\alpha}|\partial_{\psi}\log q_{\phi}(z_{i}|x)|}{\sum_{\overset{j=1}{{j\neq i}}}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}}\right)^{2}\right). Furthermore, since z_{1},\ldots z_{N} are i.i.d. and denoting \overline{Y}_{N}=N^{-1}\sum_{i=1}^{N}w_{\theta,\phi}(z_{i};x)^{1-\alpha} , we get \displaystyle\mathbb{E}\left(\sum_{i=1}^{N}\left(\frac{w_{\theta,\phi}(z_{i};x)^{1-\alpha}|\partial_{\psi}\log q_{\phi}(z_{i}|x)|}{\sum_{\overset{j=1}{{j\neq i}}}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}}\right)^{2}\right)\leq N\mathbb{E}\left(\left({w_{\theta,\phi}(z;x)^{1-\alpha}|\partial_{\psi}\log q_{\phi}(z|x)|}\right)^{2}\right)\mathbb{E}\left(\overline{Y}_{N-1}^{-2}\right). Under our assumptions (i) \mathbb{E}\left(\left({w_{\theta,\phi}(z;x)^{1-\alpha}|\partial_{\psi}\log q_{\phi}(z|x)|}\right)^{2}\right)<\infty (ii) for all \mu>0 : as N\to\infty , \mathbb{E}((\overline{Y}_{N})^{-\mu})=O(1) by 6 , we obtain by combining with the above that \displaystyle A_{N}^{(\alpha)}(\theta,\phi;x)=o\left(\frac{1}{N}\right). (63) Study of B_{N}^{(\alpha)}(\theta,\phi;x) . Write that 2^{-1}B_{N}^{(\alpha)}(\theta,\phi;x)\leq\mathbb{E}\left(\left(\sum_{j=1}^{N}\frac{f_{-j}^{(\alpha)}(z_{1:N},\theta,\phi;x)\left|\frac{1-\alpha}{N-1}\log w_{\theta,\phi}(z_{j};x)\right|}{\sum_{\ell=1}^{N}w_{\theta,\phi}(z_{\ell};x)^{1-\alpha}}|\partial_{\psi}\log q_{\phi}(z_{j}|x)|\right)^{2}\right)\\ +\mathbb{E}\left(\left(\exp\left(\frac{1-\alpha}{N-1}\sum_{i=1}^{N}\log w_{\theta,\phi}(z_{i};x)\right)\sum_{j=1}^{N}\frac{\left|\frac{1-\alpha}{N-1}\log w_{\theta,\phi}(z_{j};x)\right|}{\sum_{\ell=1}^{N}w_{\theta,\phi}(z_{\ell};x)^{1-\alpha}}|\partial_{\psi}\log q_{\phi}(z_{j}|x)|\right)^{2}\right). (64) Using ( 61 ) in the first term of the right-hand side above, we obtain that \mathbb{E}\left(\left(\sum_{j=1}^{N}\frac{f_{-j}^{(\alpha)}(z_{1:N},\theta,\phi;x)\left|\frac{1-\alpha}{N-1}\log w_{\theta,\phi}(z_{j};x)\right|}{\sum_{\ell=1}^{N}w_{\theta,\phi}(z_{\ell};x)^{1-\alpha}}|\partial_{\psi}\log q_{\phi}(z_{j}|x)|\right)^{2}\right)\\ \leq\frac{(1-\alpha)^{2}}{(N-1)^{4}}\mathbb{E}\left(\left(\sum_{j=1}^{N}\left|\log w_{\theta,\phi}(z_{j};x)\partial_{\psi}\log q_{\phi}(z_{j}|x)\right|\right)^{2}\right) and next using the fact that (\sum_{i=1}^{N}u_{i})^{2}\leq N\sum_{i=1}^{N}u_{i}^{2} thanks to the Cauchy-Schwartz inequality, we deduce that \mathbb{E}\left(\left(\sum_{j=1}^{N}\frac{f_{-j}^{(\alpha)}(z_{1:N},\theta,\phi;x)\left|\frac{1-\alpha}{N-1}\log w_{\theta,\phi}(z_{j};x)\right|}{\sum_{\ell=1}^{N}w_{\theta,\phi}(z_{\ell};x)^{1-\alpha}}|\partial_{\psi}\log q_{\phi}(z_{j}|x)|\right)^{2}\right)\\ \leq(1-\alpha)^{2}\frac{N^{2}}{(N-1)^{4}}\mathbb{E}\left(|\log w_{\theta,\phi}(z;x)\partial_{\psi}\log q_{\phi}(z|x)|^{2}\right) and thus the first term of the right-hand side of ( 64 ) is o(1/N) . Finally, denoting X=(1-\alpha)\log w_{\theta,\phi}(z;x) , \overline{X}_{N}=(N-1)^{-1}\sum_{i=1}^{N}(1-\alpha)\log w_{\theta,\phi}(z_{i};x) , Y=w_{\theta,\phi}(z;x)^{1-\alpha} , \overline{Y}_{N}=N^{-1}\sum_{i=1}^{N}w_{\theta,\phi}(z_{i};x)^{1-\alpha} , Z=|\log w_{\theta,\phi}(z,x)\partial_{\psi}\log q_{\phi}(z|x)| and \overline{Z}_{N}=N^{-1}\sum_{i=1}^{N}|\log w_{\theta,\phi}(z_{i};x)\partial_{\psi}\log q_{\phi}(z_{i}|x)| , 4 implies that the second term on the right-hand side of ( 64 ) is o(1/N) and we have thus obtained that B_{N}^{(\alpha)}(\theta,\phi;x)=o(1/N) . Pairing up this result with ( 60 ) and ( 63 ) yields ( 55 ). (ii) Proof of ( 56 ). Denoting X=(1-\alpha)\log w_{\theta,\phi}(z;x) , \overline{X}_{N}=(N-1)^{-1}\sum_{i=1}^{N}(1-\alpha)\log w_{\theta,\phi}(z_{i};x) , Y=w_{\theta,\phi}(z;x)^{1-\alpha} , \overline{Y}_{N}=N^{-1}\sum_{i=1}^{N}w_{\theta,\phi}(z_{i};x)^{1-\alpha} , Z=\partial_{\psi}\log q_{\phi}(z|x) and \overline{Z}_{N}=N^{-1}\sum_{i=1}^{N}\partial_{\psi}\log q_{\phi}(z_{i}|x) , ( 56 ) follows from 4 paired up with the fact that \mathbb{E}(Z)=0 and thus \boldsymbol{v}^{T}\boldsymbol{\Sigma}\boldsymbol{v}=\mathbb{V}(Z) . (iii) Proof of ( 43 ) and ( 57 ). First note that ( 43 ) and ( 57 ) are immediate when \alpha=0 , so we only need to show them when \alpha\in(0,1) . Letting \alpha\in(0,1) from now on, we can apply ( 84 ) from 7 under our assumptions, which yields ( 43 ). Now denote Y=w_{\theta,\phi}(z;x)^{1-\alpha} , Z=\partial_{\psi}\log q_{\phi}(z|x) , X=YZ , X^{\prime}=\log Y as well as \overline{Y}_{N}=N^{-1}\sum_{i=1}^{N}w_{\theta,\phi}(z_{i};x)^{1-\alpha} , \overline{Z}_{N}=N^{-1}\sum_{i=1}^{N}\partial_{\psi}\log q_{\phi}(z_{i}|x) , \overline{X}_{N}=N^{-1}\sum_{i=1}^{N}w_{\theta,\phi}(z_{i};x)^{1-\alpha}\partial_{\psi}\log q_{\phi}(z_{i}|x) and \overline{X}^{\prime}_{N}=N^{-1}\sum_{i=1}^{N}\log(w_{\theta,\phi}(z_{i};x)^{1-\alpha}) . Observe next that \mathbb{C}\mathrm{ov}\left(\frac{\overline{X}_{N}}{\overline{Y}_{N}},\frac{\exp\left(\frac{N}{N-1}\overline{X}^{\prime}_{N}\right)}{\overline{Y}_{N}}\overline{Z}_{N}\right)=\mathbb{E}\left({\overline{X}_{N}\overline{Z}_{N}}\frac{\exp\left(\frac{N}{N-1}\overline{X}^{\prime}_{N}\right)}{\overline{Y}_{N}^{2}}\right)\\ -\mathbb{E}\left(\frac{\overline{X}_{N}}{\overline{Y}_{N}}\right)\mathbb{E}\left(\frac{\exp\left(\frac{N}{N-1}\overline{X}^{\prime}_{N}\right)}{\overline{Y}_{N}}\overline{Z}_{N}\right). Notice also that and thus that \displaystyle\mathbb{E}\left({\overline{X}_{N}\overline{Z}_{N}}\frac{\exp\left(\frac{N}{N-1}\overline{X}^{\prime}_{N}\right)}{\overline{Y}_{N}^{2}}\right)=\frac{1}{N}\frac{\exp(\mathbb{E}(X^{\prime}))}{\mathbb{E}(Y)^{2}}\left(\mathbb{E}(XZ)-\frac{\mathbb{E}(X)}{\mathbb{E}(Y)}\mathbb{E}(ZY)\right) \displaystyle\qquad+\mathbb{E}\left({(\overline{X}_{N}-\mathbb{E}(X))\overline{Z}_{N}}\left(\frac{\exp\left(\frac{N}{N-1}\overline{X}^{\prime}_{N}\right)}{\overline{Y}_{N}^{2}}-\frac{\exp(\mathbb{E}(X^{\prime}))}{\mathbb{E}(Y)^{2}}\right)\right) \displaystyle\qquad+\frac{\mathbb{E}(X)}{\mathbb{E}(Y)}\mathbb{E}\left({\overline{Z}_{N}}\frac{\exp\left(\frac{N}{N-1}\overline{X}^{\prime}_{N}\right)}{\overline{Y}_{N}}\right) \displaystyle\qquad-\frac{\mathbb{E}(X)}{\mathbb{E}(Y)}\mathbb{E}\left({\overline{Z}_{N}(\overline{Y}_{N}-\mathbb{E}(Y))}\left(\frac{\exp\left(\frac{N}{N-1}\overline{X}^{\prime}_{N}\right)}{\overline{Y}_{N}^{2}}-\frac{\exp(\mathbb{E}(X^{\prime}))}{\mathbb{E}(Y)^{2}}\right)\right), so that using that X=ZY \displaystyle\mathbb{C}\mathrm{ov}\left(\frac{\overline{X}_{N}}{\overline{Y}_{N}},\frac{\exp\left(\frac{N}{N-1}\overline{X}^{\prime}_{N}\right)}{\overline{Y}_{N}}\overline{Z}_{N}\right)=\frac{1}{N}\frac{\exp(\mathbb{E}(X^{\prime}))}{\mathbb{E}(Y)^{2}}\left(\mathbb{E}(XZ)-\frac{\mathbb{E}(X)^{2}}{\mathbb{E}(Y)}\right)+R_{N}, with R_{N}=\mathbb{E}\left({\left[(\overline{X}_{N}-\mathbb{E}(X))-\frac{\mathbb{E}(X)}{\mathbb{E}(Y)}(\overline{Y}_{N}-\mathbb{E}(Y))\right]\overline{Z}_{N}}\left(\frac{\exp\left(\frac{N}{N-1}\overline{X}^{\prime}_{N}\right)}{\overline{Y}_{N}^{2}}-\frac{\exp(\mathbb{E}(X^{\prime}))}{\mathbb{E}(Y)^{2}}\right)\right)\\ +\left[\frac{\mathbb{E}(X)}{\mathbb{E}(Y)}-\mathbb{E}\left(\frac{\overline{X}_{N}}{\overline{Y}_{N}}\right)\right]\mathbb{E}\left({\overline{Z}_{N}}\frac{\exp\left(\frac{N}{N-1}\overline{X}^{\prime}_{N}\right)}{\overline{Y}_{N}}\right). Using ( 83 ) from 7 , we have that \displaystyle\mathbb{E}\left(\frac{\overline{X}_{N}}{\overline{Y}_{N}}\right)=\frac{\mathbb{E}(X)}{\mathbb{E}(Y)}+\frac{1}{N}\left(\frac{\mathbb{E}(X)\,\mathbb{V}\left(Y\right)}{\left(\mathbb{E}(Y)\right)^{3}}-\frac{\mathbb{C}\mathrm{ov}\left(X,Y\right)}{\left(\mathbb{E}(Y)\right)^{2}}\right)+o\left(\frac{1}{N}\right) while 4 gives \displaystyle\mathbb{E}\left({\overline{Z}_{N}}\frac{\exp\left(\frac{N}{N-1}\overline{X}^{\prime}_{N}\right)}{\overline{Y}_{N}^{2}}\right)=o(1), where we have used that \mathbb{E}(Z)=0 . Consequently, the second term in the right-hand side of R_{N} is o(1/N) . The proof of ( 57 ) will be concluded if we can show that the first term of right-hand side of R_{N} is o(1/N) too, since using our notation \displaystyle\mathbb{C}\mathrm{ov}(U,V)=\frac{\exp(\mathbb{E}(X^{\prime}))}{\mathbb{E}(Y)^{2}}\left(\mathbb{E}(XZ)-\frac{\mathbb{E}(X)^{2}}{\mathbb{E}(Y)}\right). Writing that \displaystyle\mathbb{E}\left({\left[(\overline{X}_{N}-\mathbb{E}(X))-\frac{\mathbb{E}(X)}{\mathbb{E}(Y)}(\overline{Y}_{N}-\mathbb{E}(Y))\right]\overline{Z}_{N}}\left(\frac{\exp\left(\frac{N}{N-1}\overline{X}^{\prime}_{N}\right)}{\overline{Y}_{N}^{2}}-\frac{\exp(\mathbb{E}(X^{\prime}))}{\mathbb{E}(Y)^{2}}\right)\right) \displaystyle=\mathbb{E}\left({\left[(\overline{X}_{N}-\mathbb{E}(X))-\frac{\mathbb{E}(X)}{\mathbb{E}(Y)}(\overline{Y}_{N}-\mathbb{E}(Y))\right]\overline{Z}_{N}}{\frac{\exp\left(\frac{N}{N-1}\overline{X}^{\prime}_{N}\right)-\exp(\mathbb{E}(X^{\prime}))}{\overline{Y}_{N}^{2}}}\right) \displaystyle\qquad-\frac{\exp(\mathbb{E}(X^{\prime}))}{\mathbb{E}(Y)^{2}}\mathbb{E}\left({\left[(\overline{X}_{N}-\mathbb{E}(X))-\frac{\mathbb{E}(X)}{\mathbb{E}(Y)}(\overline{Y}_{N}-\mathbb{E}(Y))\right]\overline{Z}_{N}}\left(\frac{\overline{Y}_{N}^{2}-\mathbb{E}(Y)^{2}}{\overline{Y}_{N}^{2}}\right)\right), we will show that both terms in the right-hand side above are o(1/N) . For the second term of the right-hand side above, we write that \displaystyle\mathbb{E}\left({\left[(\overline{X}_{N}-\mathbb{E}(X))-\frac{\mathbb{E}(X)}{\mathbb{E}(Y)}(\overline{Y}_{N}-\mathbb{E}(Y))\right]\overline{Z}_{N}}\left(\frac{\overline{Y}_{N}^{2}-\mathbb{E}(Y)^{2}}{\overline{Y}_{N}^{2}}\right)\right) \displaystyle=\mathbb{E}\left({\left[(\overline{X}_{N}-\mathbb{E}(X))-\frac{\mathbb{E}(X)}{\mathbb{E}(Y)}(\overline{Y}_{N}-\mathbb{E}(Y))\right]\overline{Z}_{N}}{\frac{\overline{Y}_{N}-\mathbb{E}(Y)}{\overline{Y}_{N}}}\right) \displaystyle\qquad+\mathbb{E}(Y)\mathbb{E}\left({\left[(\overline{X}_{N}-\mathbb{E}(X))-\frac{\mathbb{E}(X)}{\mathbb{E}(Y)}(\overline{Y}_{N}-\mathbb{E}(Y))\right]\overline{Z}_{N}}{\frac{\overline{Y}_{N}-\mathbb{E}(Y)}{\overline{Y}_{N}^{2}}}\right), so this is o(1/N) if we assume enough moments for \overline{X}_{N} , \overline{Y}_{N} and \overline{Z}_{N} . For the first term in the right-hand side, ( 48 ) implies \left|\exp\left(\frac{N}{N-1}\overline{X}^{\prime}_{N}\right)-\exp(\mathbb{E}(X^{\prime}))\right|\\ \leq\left[\exp\left(\frac{N}{N-1}\overline{X}^{\prime}_{N}\right)+\exp(\mathbb{E}(X^{\prime}))\right]\left|\frac{N}{N-1}\overline{X}^{\prime}_{N}-\mathbb{E}(X^{\prime})\right|. Writing that \displaystyle\exp\left(\frac{N}{N-1}\overline{X}^{\prime}_{N}\right) \displaystyle=\exp\left(\overline{X}^{\prime}_{N}\right)\exp\left(\frac{1}{N-1}\overline{X}^{\prime}_{N}\right)\leq\exp\left(\overline{X}^{\prime}_{N}\right)\left(\exp\left(\overline{X}^{\prime}_{N}\right)+1\right) \displaystyle\leq\overline{Y}_{N}(\overline{Y}_{N}+1) we deduce that \displaystyle\left|\exp\left(\frac{N}{N-1}\overline{X}^{\prime}_{N}\right)-\exp(\mathbb{E}(X^{\prime}))\right|\leq\left[\overline{Y}_{N}+\overline{Y}_{N}^{2}+\exp(\mathbb{E}(X^{\prime}))\right]\left|\frac{N}{N-1}\overline{X}^{\prime}_{N}-\mathbb{E}(X^{\prime})\right|. so the first term of the right-hand side is o(1/N) if we assume enough moments for \overline{X}_{N}^{\prime} , \overline{X}_{N} , \overline{Y}_{N} and \overline{Z}_{N} . ∎ B.5 Proof of 5 Using that f_{-i}^{(\alpha)}(z_{1:N},\theta,\phi;x) is constant equal to \eta\geq 0 for all i=1\ldots N in ( 15 ) yields \psi\text{-}g_{N}^{(\alpha,\mathrm{VIMCO})}(\theta,\phi;x)=-\sum_{j=1}^{N}W_{\theta,\phi}^{(1-\alpha)}(z_{j};x)\partial_{\psi}\log q_{\phi}(z_{j}|x)\\ -\frac{1}{1-\alpha}\sum_{i=1}^{N}{\partial_{\psi}\log q_{\phi}(z_{i}|x)\log\left(1-W_{\theta,\phi}^{(1-\alpha)}(z_{i};x)+\frac{\eta}{\sum_{j=1}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}}\right)} which we can rewrite as \psi\text{-}g_{N}^{(\alpha,\mathrm{VIMCO})}(\theta,\phi;x)=\frac{1}{1-\alpha}\sum_{j=1}^{N}\frac{\alpha\penalty\ w_{\theta,\phi}(z_{j};x)^{1-\alpha}-\eta}{\sum_{\ell=1}^{N}w_{\theta,\phi}(z_{\ell};x)^{1-\alpha}}\partial_{\psi}\log q_{\phi}(z_{j}|x)\\ -\frac{1}{1-\alpha}\sum_{i=1}^{N}\partial_{\psi}\log q_{\phi}(z_{i}|x)\left[\log\left(1-\frac{w_{\theta,\phi}(z_{i};x)^{1-\alpha}-\eta}{\sum_{j=1}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}}\right)+\frac{w_{\theta,\phi}(z_{i};x)^{1-\alpha}-\eta}{\sum_{j=1}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}}\right]. (65) By ( 84 ) from 7 , we have that \displaystyle\mathbb{V}\left(\frac{1}{1-\alpha}\sum_{j=1}^{N}\frac{\alpha\penalty\ w_{\theta,\phi}(z_{j};x)^{1-\alpha}-\eta}{\sum_{\ell=1}^{N}w_{\theta,\phi}(z_{\ell};x)^{1-\alpha}}\partial_{\psi}\log q_{\phi}(z_{j}|x)\right)=\frac{\psi\text{-}V^{(\alpha,\mathrm{VIMCO})}(\theta,\phi;x)}{N}+o\left(\frac{1}{N}\right) with \psi\text{-}V^{(\alpha,\mathrm{VIMCO})}(\theta,\phi;x) defined as in 5 and using that \mathbb{E}(\partial_{\psi}\log q_{\phi}(z|x))=0 . The proof will be concluded if we can show that the variance of the second term in the r.h.s. of ( 65 ) is o(1/N) . Denoting \displaystyle B_{N}^{(\alpha)}=\mathbb{V}\left(\sum_{i=1}^{N}\partial_{\psi}\log q_{\phi}(z_{i}|x)\left[\log\left(1-\frac{w_{\theta,\phi}(z_{i};x)^{1-\alpha}-\eta}{\sum_{j=1}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}}\right)+\frac{w_{\theta,\phi}(z_{i};x)^{1-\alpha}-\eta}{\sum_{j=1}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}}\right]\right), we first write that \displaystyle|B_{N}^{(\alpha)}| \displaystyle\leq\mathbb{E}\left(\left(\sum_{i=1}^{N}\partial_{\psi}\log q_{\phi}(z_{i}|x)\left[\log\left(1-\frac{w_{\theta,\phi}(z_{i};x)^{1-\alpha}-\eta}{\sum_{j=1}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}}\right)+\frac{w_{\theta,\phi}(z_{i};x)^{1-\alpha}-\eta}{\sum_{j=1}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}}\right]\right)^{2}\right) \displaystyle\leq\frac{1}{4}\mathbb{E}\left(\left(\sum_{i=1}^{N}\left(\frac{w_{\theta,\phi}(z_{i};x)^{1-\alpha}-\eta}{\sum_{j=1}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}}\right)^{2}|\partial_{\psi}\log q_{\phi}(z_{i}|x)|\left(1+\frac{1}{1-\frac{w_{\theta,\phi}(z_{i};x)^{1-\alpha}-\eta}{\sum_{j=1}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}}}\right)\right)^{2}\right) \displaystyle\leq\frac{1}{4}\mathbb{E}\left(\left(\sum_{i=1}^{N}\left(\frac{w_{\theta,\phi}(z_{i};x)^{1-\alpha}-\eta}{\sum_{j=1}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}}\right)^{2}|\partial_{\psi}\log q_{\phi}(z_{i}|x)|\left(1+\frac{1}{1-W_{\theta,\phi}^{(1-\alpha)}(z_{i};x)}\right)\right)^{2}\right) where we have used successively (i) ( 28 ) with r=1-(w_{\theta,\phi}(z_{i};x)-\eta)/{\sum_{j=1}^{N}w_{\theta,\phi}(z_{j};x)} and (ii) w_{\theta,\phi}(z_{i};x)^{1-\alpha}-\eta\leq w_{\theta,\phi}(z_{i};x)^{1-\alpha} since \eta\geq 0 . Hence, |B_{N}^{(\alpha)}|\leq\mathbb{E}\left(\left(\sum_{i=1}^{N}\left(\frac{w_{\theta,\phi}(z_{i};x)^{1-\alpha}-\eta}{\sum_{j=1}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}}\right)^{2}|\partial_{\psi}\log q_{\phi}(z_{i}|x)|\right)^{2}\right)\\ +\mathbb{E}\left(\left(\sum_{i=1}^{N}\left(\frac{w_{\theta,\phi}(z_{i};x)^{1-\alpha}-\eta}{\sum_{j=1}^{N}w_{\theta,\phi}(z_{j};x)^{1-\alpha}}\right)^{2}|\partial_{\psi}\log q_{\phi}(z_{i}|x)|\left(1+\frac{1}{1-W_{\theta,\phi}^{(1-\alpha)}(z_{i};x)}\right)\right)^{2}\right) Applying ( 81 ) from 7 (paired up with ( 84 ) from 7 ) shows that the first term in the right-hand side above is o(1/N) , while 3 with \ell=1 shows that the second term in the right-hand side above is o\left(1/N\right) . The proof is thus concluded. B.6 Proof of 6 We first write that \displaystyle\psi\text{-}g_{N}^{(0,\mathrm{VIMCO\text{-}\star})}(\theta,\phi;x)=\frac{1}{2}\sum_{j=1}^{N}\left(W_{\theta,\phi}^{(0)}(z_{j};x)\right)^{2}\partial_{\psi}\log q_{\phi}(z_{j}|x)+R_{2,N}^{(0)}(\theta,\phi;x), where R_{2,N}^{(0)}(\theta,\phi;x)=-\frac{1}{1-\alpha}\sum_{i=1}^{N}\partial_{\psi}\log q_{\phi}(z_{i}|x)\left[\log\left(1-W_{\theta,\phi}^{(0)}(z_{i};x)\right)+W_{\theta,\phi}^{(0)}(z_{i};x)\right.\\ \left.+\frac{1}{2}(W_{\theta,\phi}^{(0)}(z_{i};x))^{2}\right]. Under our assumptions, we can apply ( 84 ) from 7 and we have that \displaystyle\mathbb{V}\left(\sum_{j=1}^{N}\left(W_{\theta,\phi}^{(0)}(z_{j};x)\right)^{2}\frac{1}{2}\partial_{\psi}\log q_{\phi}(z_{j}|x)\right)=\frac{\psi\text{-}V^{(0,\mathrm{VIMCO\text{-}\star})}(\theta,\phi;x)}{N^{3}}+o\left(\frac{1}{N^{3}}\right). Denoting \displaystyle B_{N}^{(\alpha)}:=\mathbb{V}\left(\sum_{i=1}^{N}\partial_{\psi}\log q_{\phi}(z_{i}|x)\left[\log\left(1-W_{\theta,\phi}^{(0)}(z_{i};x)\right)\right.\right.+W_{\theta,\phi}^{(0)}(z_{i};x)\left.\left.+\frac{1}{2}\left(W_{\theta,\phi}^{(0)}(z_{i};x)\right)^{2}\right]\right), we will get the desired result if we can show that B_{N}^{(\alpha)}=o\left(1/{N^{3}}\right) with \alpha=0 . Since \displaystyle B_{N}^{(\alpha)}\leq\mathbb{E}\left(\left(\sum_{i=1}^{N}\partial_{\psi}\log q_{\phi}(z_{i}|x)\left[\log\left(1-W_{\theta,\phi}^{(0)}(z_{i};x)\right)+W_{\theta,\phi}^{(0)}(z_{i};x)\right.\right.\right.\left.\left.\left.+\frac{1}{2}\left(W_{\theta,\phi}^{(0)}(z_{i};x)\right)^{2}\right]\right)^{2}\right), setting r=1-W_{\theta,\phi}^{(0)}(z_{i};x) , we have that r>0 and ( 28 ) from 2 with k=2 implies \displaystyle|B_{N}^{(\alpha)}|\leq\frac{1}{9}\mathbb{E}\left(\left(\sum_{i=1}^{N}\left(W_{\theta,\phi}^{(0)}(z_{i};x)\right)^{3}|\partial_{\psi}\log q_{\phi}(z_{i}|x)|\left[1+\frac{1}{1-W_{\theta,\phi}^{(0)}(z_{i};x)}\right]\right)^{2}\right). As a result, |B_{N}^{(\alpha)}|\leq\mathbb{E}\left(\left(\sum_{i=1}^{N}\left(W_{\theta,\phi}^{(0)}(z_{i};x)\right)^{3}|\partial_{\psi}\log q_{\phi}(z_{i}|x)|\right)^{2}\right)\\ +\mathbb{E}\left(\left(\sum_{i=1}^{N}\left(W_{\theta,\phi}^{(0)}(z_{i};x)\right)^{3}|\partial_{\psi}\log q_{\phi}(z_{i}|x)|\frac{1}{1-W_{\theta,\phi}^{(0)}(z_{i};x)}\right)^{2}\right). (66) Denoting X=w(z;x)^{3}|\partial_{\psi}\log q_{\phi}(z|x)| , \overline{X}_{N}=1/N\sum_{i=1}^{N}w_{\theta,\phi}(z_{i};x)^{3}|\partial_{\psi}\log q_{\phi}(z_{i}|x)| , Y=w_{\theta,\phi}(z;x) and \overline{Y}_{N}=1/N\sum_{i=1}^{N}w_{\theta,\phi}(z_{i};x) , the first term in the right-hand side of ( 66 ) becomes \displaystyle\frac{1}{N^{4}}\mathbb{E}\left(\left(\frac{\overline{X}_{N}}{\overline{Y}_{N}^{3}}\right)^{2}\right) Now write that \displaystyle\mathbb{E}\left(\left(\frac{\overline{X}_{N}}{\overline{Y}_{N}^{3}}\right)^{2}\right)={\mathbb{E}(X)^{2}}{\mathbb{E}\left(\frac{1}{\overline{Y}_{N}^{6}}\right)}+2\mathbb{E}(X)\mathbb{E}\left(\frac{\overline{X}_{N}-\mathbb{E}(X)}{\overline{Y}_{N}^{6}}\right)+\mathbb{E}\left(\frac{(\overline{X}_{N}-\mathbb{E}(X))^{2}}{\overline{Y}_{N}^{6}}\right). Under our assumptions and applying 8 , there exists p>1 such that \displaystyle\lim_{N\to\infty}\mathbb{E}(|\overline{X}_{N}-\mathbb{E}(X)|^{p})=0 (67) \displaystyle\lim_{N\to\infty}\mathbb{E}(|\overline{X}_{N}-\mathbb{E}(X)|^{2p})=0 (68) and for all \mu>0 : as N\to\infty , \mathbb{E}((\overline{Y}_{N})^{-\mu})=O(1) by 6 . Hence, \displaystyle\mathbb{E}\left(\left(\frac{\overline{X}_{N}}{\overline{Y}_{N}^{3}}\right)^{2}\right)=O(1) so that the first term in the right-hand side of ( 66 ) is o(1/N^{3}) . As for the second term in the right-hand side of ( 66 ) it is o(1/N^{3}) by applying 3 with (\ell,\eta)=(2,0) . The proof is then concluded. Appendix C Deferred proofs and empirical results for Section 4 C.1 Gaussian example We first recall some known results taken from 9 . Example 1 (Known results from 9 ) Let \theta,\phi\in\mathbb{R}^{d} . Set p_{\theta}(z|x)=\mathcal{N}(z;\theta,\boldsymbol{I}_{d}) and q_{\phi}(z|x)=\mathcal{N}(z;\phi,\boldsymbol{I}_{d}) , where \boldsymbol{I}_{d} is the d -dimensional identity matrix. Denoting the Euclidean norm of a finite dimensional vector x with real entries by \left\|x\right\| and its associated inner product by \langle\cdot,\cdot\rangle . Then: for all k=1\ldots d , \displaystyle\partial_{\phi_{k}}\mathrm{VR}^{(\alpha)}(\theta,\phi;x)=-\alpha(\phi_{k}-\theta_{k}) \displaystyle\partial_{\phi_{k}}[\gamma^{(\alpha)}(\theta,\phi;x)^{2}]=2{(1-\alpha)(\phi_{k}-\theta_{k})\exp\left((1-\alpha)^{2}\|\phi-\theta\|^{2}\right)}. In addition, it holds that \displaystyle\log\left(\frac{p_{\theta}(z|x)}{q_{\phi}(z|x)}\right)=-\frac{\|\theta-\phi\|^{2}}{2}-\|\theta-\phi\|S,\quad S=\frac{\langle z-\phi,\phi-\theta\rangle}{\|\theta-\phi\|},\quad z\in\mathbb{R}^{d}. (69) By ( 69 ), we then have that \displaystyle\log\left(\frac{w_{\theta,\phi}(z;x)}{\mathbb{E}(w_{\theta,\phi}(z;x))}\right)=-\frac{\|\theta-\phi\|^{2}}{2}-\|\theta-\phi\|S,\quad S=\frac{\langle z-\phi,\phi-\theta\rangle}{\|\theta-\phi\|},\quad z\in\mathbb{R}^{d} (70) from which we deduce: for all \alpha\in\mathbb{R} , \displaystyle\log\left(\frac{w_{\theta,\phi}(z;x)^{1-\alpha}}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})}\right)=-(1-\alpha)\langle z-\phi,\phi-\theta\rangle-\frac{1}{2}(1-\alpha)^{2}\|\theta-\phi\|^{2}. (71) For all k=1\ldots d , we now let z^{(k)} denotes the k -th element of z\in\mathbb{R}^{d} so that \displaystyle{\frac{w_{\theta,\phi}(z;x)^{1-\alpha}}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})}}\Biggl[\partial_{\phi_{k}}\log q_{\phi}(z|x)-\frac{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha}\partial_{\phi_{k}}\log q_{\phi}(z|x))}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})}\Biggr] \displaystyle\quad=-\left[\phi_{k}-z^{(k)}+(\alpha-1)(\phi_{k}-\theta_{k})\right]\frac{w_{\theta,\phi}(z;x)^{1-\alpha}}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})}, (72) which follows from ( 71 ) paired up with the fact that for u\sim\mathcal{N}(0,1) and all t\in\mathbb{R} , \mathbb{E}(ue^{ut})=te^{t^{2}/2} as well as \displaystyle\partial_{\phi_{k}}\log q_{\phi}(z|x)=z^{(k)}-\phi_{k}. (73) Furthermore, since \langle z-\phi,\phi-\theta\rangle is a Gaussian variable if z\sim q_{\phi}(\cdot|x) , it admits exponential moments of any exponent and we have that (A5) holds. We further get that \log w_{\theta,\phi}(z;x)=c_{0}(\theta,\phi)+\langle z-\phi,\phi-\theta\rangle for some continuously differentiable function c_{0} defined on \Theta\times\Phi . Conditions (Ah) and ( ~ A h ′ ) follow using that z\sim q_{\phi}(\cdot|x) with h\geq 8 and h^{\prime\prime}\geq 4 . We next define: for all \eta\geq 0 , A_{\eta}=\frac{1}{(1-\alpha)^{2}}\mathbb{V}\left(\frac{\alpha w_{\theta,\phi}(z;x)^{1-\alpha}}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})}\left[\partial_{\phi_{k}}\log q_{\phi}(z|x)\right.\right.\\ \left.\left.-\frac{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha}\partial_{\phi_{k}}\log q_{\phi}(z|x))}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})}\right]-\frac{\eta\partial_{\phi_{k}}\log q_{\phi}(z|x)}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})}\right). In order to compute A_{\eta} , we first note that ( 73 ) implies \mathbb{V}\left(\partial_{\phi_{k}}\log q_{\phi}(z|x)\right)=1 . Next we will show that \mathbb{V}\left(\frac{w_{\theta,\phi}(z;x)^{1-\alpha}}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})}\left[\partial_{\phi_{k}}\log q_{\phi}(z|x)-\frac{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha}\partial_{\phi_{k}}\log q_{\phi}(z|x))}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})}\right]\right)\\ =e^{(1-\alpha)^{2}\|\theta-\phi\|^{2}}\left(1+\left(1-\alpha\right)^{2}(\phi_{k}-\theta_{k})^{2}\right) (74) and \mathbb{E}\left(\frac{w_{\theta,\phi}(z;x)^{1-\alpha}}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})}\left[\partial_{\phi_{k}}\log q_{\phi}(z|x)-\frac{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha}\partial_{\phi_{k}}\log q_{\phi}(z|x))}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})}\right]{\partial_{\phi_{k}}\log q_{\phi}(z|x)}\right)\\ =1. (75) (i) Proof of ( 74 ). Using ( 72 ), we get B:=\mathbb{V}\left(\frac{w_{\theta,\phi}(z;x)^{1-\alpha}}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})}\left[\partial_{\phi_{k}}\log q_{\phi}(z|x)-\frac{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha}\partial_{\phi_{k}}\log q_{\phi}(z|x))}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})}\right]\right)\\ =\mathbb{E}\left(\left(\left[\phi_{k}-z^{(k)}+(\alpha-1)(\phi_{k}-\theta_{k})\right]\frac{w_{\theta,\phi}(z;x)^{1-\alpha}}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})}\right)^{2}\right). As a result, \displaystyle B \displaystyle=e^{-(1-\alpha)^{2}\|\theta-\phi\|^{2}}\mathbb{E}\left(\left[z^{(k)}-\phi_{k}-(\alpha-1)(\phi_{k}-\theta_{k})\right]^{2}e^{-2(1-\alpha)\langle z-\phi,\phi-\theta\rangle}\right) \displaystyle=e^{-(1-\alpha)^{2}\|\theta-\phi\|^{2}}e^{2(1-\alpha)^{2}\|\theta-\phi\|^{2}}\left(1+\left(1-\alpha\right)^{2}(\phi_{k}-\theta_{k})^{2}\right) where we have used ( 71 ) and that for u\sim\mathcal{N}(0,1) and all t\in\mathbb{R} , \displaystyle\mathbb{E}(e^{tu})=e^{t^{2}/2},\quad\mathbb{E}(ue^{ut})=te^{t^{2}/2}\quad\mbox{and}\quad\mathbb{E}(u^{2}e^{ut})=(1+t^{2})e^{t^{2}/2}, and which concludes the proof of ( 74 ). (ii) Proof of ( 75 ). Using ( 72 ) and ( 73 ), we get that C:=\mathbb{E}\left(\frac{w_{\theta,\phi}(z;x)^{1-\alpha}}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})}\left[\partial_{\phi_{k}}\log q_{\phi}(z|x)-\frac{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha}\partial_{\phi_{k}}\log q_{\phi}(z|x))}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})}\right]{\partial_{\phi_{k}}\log q_{\phi}(z|x)}\right)\\ =\mathbb{E}\left((\phi_{k}-z^{(k)}+(\alpha-1)(\phi_{k}-\theta_{k}))(\phi_{k}-z^{(k)})\frac{w_{\theta,\phi}(z;x)^{1-\alpha}}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})}\right). Hence \displaystyle C \displaystyle=e^{-\frac{1}{2}(1-\alpha)^{2}\|\theta-\phi\|^{2}}\mathbb{E}\left(\left((z^{(k)}-\phi_{k})^{2}-(\alpha-1)(\phi_{k}-\theta_{k})(z^{(k)}-\phi_{k})\right)e^{-(1-\alpha)\langle z-\phi,\phi-\theta\rangle}\right) \displaystyle=1 which is exactly ( 75 ). Using ( 74 ), ( 75 ) and \mathbb{V}\left(\partial_{\phi_{k}}\log q_{\phi}(z|x)\right)=1 , we get: for all \eta\geq 0 , A_{\eta}=\frac{\alpha^{2}}{(1-\alpha)^{2}}e^{(1-\alpha)^{2}\|\theta-\phi\|^{2}}\left(1+\left(1-\alpha\right)^{2}(\phi_{k}-\theta_{k})^{2}\right)+\\ \frac{1}{(1-\alpha)^{2}}\frac{\eta}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})}\left(-2\alpha+\frac{\eta}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})}\right) (76) We now consider special cases for \eta . • Setting \eta=\eta^{(\alpha,\mathrm{AM})}=\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha}) , we have that \displaystyle\frac{\eta^{(\alpha,\mathrm{AM})}}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})}=1. and plugging this in ( 76 ) yields \phi_{k}\text{-}V^{(\alpha,\mathrm{VIMCO\text{-}AM})}(\theta,\phi;x) for all \alpha\in[0,1) . • Setting \eta=\eta^{(\alpha,\mathrm{GM})}=\exp[(1-\alpha)\mathbb{E}(\log w_{\theta,\phi}(z;x))] , we have that using ( 70 ) that \displaystyle\frac{\eta^{(\alpha,\mathrm{GM})}}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})} \displaystyle=\frac{\exp[(1-\alpha)\mathbb{E}(\log w_{\theta,\phi}(z;x))]}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})}=\frac{\exp\left[(1-\alpha)\mathbb{E}\left(\log\frac{w_{\theta,\phi}(z;x)}{\mathbb{E}(w_{\theta,\phi}(z;x))}\right)\right]}{\mathbb{E}\left(\left(\frac{w_{\theta,\phi}(z;x)}{\mathbb{E}(w_{\theta,\phi}(z;x))}\right)^{1-\alpha}\right)} \displaystyle=\frac{\exp\left[-\frac{1}{2}(1-\alpha)\|\theta-\phi\|^{2}\right]}{\exp\left[-\frac{1}{2}(1-\alpha)\|\theta-\phi\|^{2}\right]\exp\left[\frac{1}{2}(1-\alpha)^{2}\|\theta-\phi\|^{2}\right]} \displaystyle=\frac{1}{\exp\left[\frac{1}{2}(1-\alpha)^{2}\|\theta-\phi\|^{2}\right]} and plugging this in ( 76 ) yields \phi_{k}\text{-}V^{(\alpha,\mathrm{VIMCO\text{-}GM})}(\theta,\phi;x) for all \alpha\in[0,1) . • Setting \eta=\eta^{\star} , we have \frac{\eta^{\star}}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})}\\ =\alpha\frac{\mathbb{E}\left(\frac{w_{\theta,\phi}(z;x)^{1-\alpha}}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})}\left[\partial_{\phi_{k}}\log q_{\phi}(z|x)-\frac{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha}\partial_{\phi_{k}}\log q_{\phi}(z|x))}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})}\right]{\partial_{\phi_{k}}\log q_{\phi}(z|x)}\right)}{\mathbb{V}\left(\partial_{\phi_{k}}\log q_{\phi}(z|x)\right)} and using ( 75 ) and \mathbb{V}\left(\partial_{\phi_{k}}\log q_{\phi}(z|x)\right)=1 , we deduce \displaystyle\frac{\eta^{\star}}{\mathbb{E}(w_{\theta,\phi}(z;x)^{1-\alpha})}=\alpha. Plugging this in ( 76 ) yields \psi\text{-}V^{(\alpha,\mathrm{VIMCO\text{-}\star})} for all \alpha\in(0,1) . It remains to compute \psi\text{-}V^{(\alpha,\mathrm{VIMCO\text{-}\star})} when \alpha=0 . It follows from ( 73 ) that \phi_{k}\text{-}V^{(0,\mathrm{VIMCO\text{-}\star})}(\theta,\phi;x)\\ =\mathbb{E}\left(\left(A(\theta,\phi;x)-2\frac{w_{\theta,\phi}(z;x)}{\mathbb{E}(w_{\theta,\phi}(z;x))}\mathbb{E}(A(\theta,\phi;x))\right)^{2}\right)-\mathbb{E}\left(A(\theta,\phi;x)\right)^{2} where A(\theta,\phi;x)=\frac{1}{2}(z^{(k)}-\phi_{k})\left(\frac{w_{\theta,\phi}(z;x)}{\mathbb{E}(w_{\theta,\phi}(z;x))}\right)^{2} . Consequently \displaystyle\phi_{k}\text{-}V^{(0,\mathrm{VIMCO\text{-}\star})}(\theta,\phi;x)=\frac{1}{4}\mathbb{E}\left((z^{(k)}-\phi_{k})^{2}\left(\frac{w_{\theta,\phi}(z;x)}{\mathbb{E}(w_{\theta,\phi}(z;x))}\right)^{4}\right) \displaystyle\qquad-\mathbb{E}\left((z^{(k)}-\phi_{k})\left(\frac{w_{\theta,\phi}(z;x)}{\mathbb{E}(w_{\theta,\phi}(z;x))}\right)^{3}\right)\mathbb{E}\left((z^{(k)}-\phi_{k})\left(\frac{w_{\theta,\phi}(z;x)}{\mathbb{E}(w_{\theta,\phi}(z;x))}\right)^{2}\right) \displaystyle\qquad+\left[\mathbb{E}\left(\left(\frac{w_{\theta,\phi}(z;x)}{\mathbb{E}(w_{\theta,\phi}(z;x))}\right)^{2}\right)-\frac{1}{4}\right]\mathbb{E}\left((z^{(k)}-\phi_{k})\left(\frac{w_{\theta,\phi}(z;x)}{\mathbb{E}(w_{\theta,\phi}(z;x))}\right)^{2}\right)^{2} so that using ( 71 ) with \alpha=0 \phi_{k}\text{-}V^{(0,\mathrm{VIMCO\text{-}\star})}(\theta,\phi;x)=\left(\frac{1}{4}+4(\phi_{k}-\theta_{k})^{2}\right)e^{6\|\phi-\theta\|^{2}}-6(\phi_{k}-\theta_{k})^{2}e^{4\|\theta-\phi\|^{2}}\\ +\left[e^{\|\theta-\phi\|^{2}}-\frac{1}{4}\right]4(\phi_{k}-\theta_{k})^{2}e^{2\|\theta-\phi\|^{2}}. C.2 Variational Bayesian Inference for State-Space models Figure 6 plots the SNR for the VIMCO-AM, VIMCO-GM, and VIMCO- \star gradient estimators as a function of N and \alpha when \phi corresponds to the posterior mean estimate \widehat{\phi} returned by the manifold VI algorithm that we adapted to the VR-IWAE bound framework. For each curve, we averaged over the components of the gradient vector and 10 replicates. The experimental results in Figure 6 agree with the theoretical results from Section 3.2 , which predict that the SNR of the VIMCO gradient estimators we considered scale as O(\sqrt{N}) for all \alpha\in(0,1) , with the VIMCO- \star gradient estimator exhibiting the highest SNR. We also observe that the VIMCO-GM gradient estimator outperforms the VIMCO-AM one. Table 1 reports the average number of iterations, computed over multiple runs of the VI training, for the three gradient estimators VIMCO-AM, VIMCO-GM, and VIMCO- \star , across various combinations of \alpha and N . All VI trainings share the same algorithmic settings, including the learning rate and stopping criterion, and differ only in the choice of gradient estimator. As shown, the VIMCO- \star estimator achieves the fastest convergence, while no clear performance advantage is observed between VIMCO-AM and VIMCO-GM. \alpha N VIMCO-AM VIMCO-GM VIMCO- \star 0.9 100 1033 1118 964 500 1735 1824 1473 0.5 100 1471 1815 822 500 2253 2085 1742 0.1 100 300 508 177 500 541 298 264 Table 1: Number of iterations until convergence of the VI training using VIMCO-AM, VIMCO-GM and VIMCO- \star gradient estimators, for various combinations of \alpha and N . Figure 6: SNR for the VIMCO-AM, VIMCO-GM and VIMCO- \star gradient estimators as a function of N for various values of \alpha . C.3 Variational Bayesien Phylogenetic Inference example Implementation details. Following the methodology of 53 , we use subsplit Bayesian networks (SBNs) for Q_{\phi}(\tau) , a diagonal lognormal model for Q_{\psi}(q|\tau) , a uniform prior on tree topologies, an i.i.d. exponential prior with rate parameter 10.0 on branch lengths, the simple 20 substitution model. Furthermore, in line with the annealing strategy for the likelihood described in Section 3.3.2 , we consider an annealed version of the VR-IWAE bound \ell_{N}^{(\alpha,\beta_{t})}(\lambda;Y)=\frac{1}{1-\alpha}\mathbb{E}_{\tau_{i},q_{i}\overset{\mathrm{i.i.d.}}{\sim}Q_{\phi}(\tau)Q_{\psi}(q|\tau)}\log\left(\frac{1}{N}\sum_{j=1}^{N}\left(\frac{[p(Y|\tau_{i},q_{i})]^{\beta_{t}}p(\tau_{i},q_{i})}{Q_{\phi}(\tau_{i})Q_{\psi}(q_{i}|\tau_{i})}\right)^{1-\alpha}\right), (77) where \lambda=\{\phi,\psi\} denotes the variational parameters and \beta_{t}=\min\{1,0.001+t/100{,}000\} is the annealing schedule proposed by 39 . In addition, the subsplit supports for the SBNs are constructed using trees obtained from 10 replicates of 10,000 ultrafast maximum-likelihood bootstrap runs ( 31 ) . The location and scale parameters of the conditional branch-length model are amortized over tree topologies using graph neural networks with edge-convolution operators ( 47 ) . Appendix D Technical results We recall below as lemmas several existing technical results that are used in our proofs. Lemma 5 (Lemma 2 of 9 ) Let \eta_{0}<\mu_{0} be two real exponents. Then, for all a,b\geq 0 , we have \left|a-b\right|^{\mu_{0}}\leq\left|a-b\right|^{\eta_{0}}\;\left(a^{{\mu_{0}}-\eta_{0}}+b^{{\mu_{0}}-\eta_{0}}\right)\;. Lemma 6 (Proposition 5 of 9 ) Set \overline{Z}_{N}=N^{-1}\sum_{i=1}^{N}Z_{i} for all N\in\mathbb{N}^{\star} , where Z_{1},\ldots,Z_{N} are positive i.i.d. random variables. Then the following assertions hold. (i) For all \mu>0 , we have \displaystyle\limsup_{N\to\infty}\mathbb{E}\left((1/\overline{Z}_{N})^{\mu}\right)<\infty\Longleftrightarrow\exists N\geq 1\;,\,\mathbb{E}((1/\overline{Z}_{N})^{\mu})<\infty. (78) Furthermore, if the assertions of the equivalence ( 78 ) hold for some \mu>0 and the distribution of Z_{1} does not reduce to a Dirac measure, there exists N_{0}\geq 1 such that \mathbb{E}\left(\left(1/\overline{Z}_{N}\right)^{\mu}\right)=\infty for 1\leq N0 , we have \displaystyle\sup_{t>0}\left(t^{\eta}\;\mathbb{E}\left(\mathrm{e}^{-t\,Z_{1}}\right)\right)<\infty\Longleftrightarrow\sup_{u>0}\left(u^{-\eta}\;\mathbb{P}\left(Z_{1}\leq u\right)\right)<\infty. (79) (iii) Suppose that the assertions of the equivalence ( 79 ) hold for some \eta>0 . Then the assertions of the equivalence ( 78 ) hold for all \mu>0 . (iv) Suppose that the assertions of the equivalence ( 78 ) hold for some \mu>1 . Then the assertions of the equivalence ( 79 ) hold for some \eta>0 . (v) Suppose that the assertions of the equivalence ( 79 ) hold for some \eta>0 . Then, for all \mu>0 , we have \displaystyle\lim_{N\to\infty}\mathbb{E}\left((1/\overline{Z}_{N})^{\mu}\right)=\begin{cases}0&\text{ if $\mathbb{E}(Z_{1})=\infty$,}\\ \left(\mathbb{E}(Z_{1})\right)^{-\mu}&\text{ otherwise.}\end{cases} (80) Lemma 7 (Proposition 6 (i), (iv) & (vi) of 9 ) Let \left(X,Y\right) be an \mathbb{R}\times\mathbb{R}_{+}^{*} -valued random vector. Let \left(X_{1},Y_{1}\right),\left(X_{2},Y_{2}\right), \ldots be a sequence of i.i.d. random vectors with the same distributions as \left(X,Y\right) . Set \overline{X}_{N}=N^{-1}\sum_{i=1}^{N}X_{i} and \overline{Y}_{N}=N^{-1}\sum_{i=1}^{N}Y_{i} for all N\in\mathbb{N}^{\star} . Assume that there exist N\geq 1 and \mu>0 such that \mathbb{E}((\overline{Y}_{N})^{-\mu})<\infty and that \mathbb{E}(Y^{h}) and \mathbb{E}(\left|X\right|^{\tilde{h}}) are finite for some positive real exponents h and \tilde{h} . Then the following assertions hold. (i) If h\geq 1 and \tilde{h}>1 , we have, as N\to\infty , \displaystyle\mathbb{E}\left(\frac{\overline{X}_{N}}{(\overline{Y}_{N})^{\ell}}\right)=\frac{\mathbb{E}(X)}{(\mathbb{E}(Y))^{\ell}}+o\left(1\right),\quad\ell\in\{1,2\}. (81) (ii) If h>2 and \tilde{h}>1 with 2/h+1/\tilde{h}<1 , we have, as N\to\infty , \displaystyle\mathbb{E}\left(\frac{(\overline{Y}_{N}-\mathbb{E}(Y))^{2}\;\left|\overline{X}_{N}-\mathbb{E}(X)\right|}{\overline{Y}_{N}}\right)=o\left(\frac{1}{N}\right)\;. (82) Furthermore, if h,\tilde{h}\geq 2 with 1/h+1/\tilde{h}<1 , then ( 82 ) holds again as N\to\infty . (iii) Suppose that h>2 and \tilde{h}>1 . If \tilde{h}<2 , suppose moreover that 2/h+1/\tilde{h}<1 . Then, we have, as N\to\infty , \displaystyle\mathbb{E}\left(\frac{\overline{X}_{N}}{\overline{Y}_{N}}\right)=\frac{\mathbb{E}(X)}{\mathbb{E}(Y)}+\frac{1}{N}\left(\frac{\mathbb{E}(X)\,\mathbb{V}\left(Y\right)}{\left(\mathbb{E}(Y)\right)^{3}}-\frac{\mathbb{C}\mathrm{ov}\left(X,Y\right)}{\left(\mathbb{E}(Y)\right)^{2}}\right)+o\left(\frac{1}{N}\right)\;. (83) (iv) If h,\tilde{h}>2 , we have, as N\to\infty , \displaystyle\mathbb{V}\left(\frac{\overline{X}_{N}}{(\overline{Y}_{N})^{\ell}}\right)=\frac{1}{N}\frac{\mathbb{V}\left(X-\ell Y\frac{\mathbb{E}(X)}{\mathbb{E}(Y)}\right)}{\left(\mathbb{E}(Y)\right)^{2\ell}}+o\left(\frac{1}{N}\right),\quad\ell\in\{1,2\}. (84) Lemma 8 (Claim (66) in Lemma 3 of 9 ) Let Z be a real valued random variable, let Z_{1},\ldots,Z_{N} be i.i.d. copies of Z and denote \overline{Z}_{N}=N^{-1}\sum_{i=1}^{N}Z_{i} for all N\in\mathbb{N}^{\star} . Then, for all real p\geq 1 , \displaystyle\mathbb{E}(|Z|^{2p})<\infty\Longrightarrow\sup_{N\in\mathbb{N}^{\star}}\left(N^{p}\;\mathbb{E}\left(\left|\overline{Z}_{N}-\mathbb{E}\left(Z\right)\right|^{2p}\right)\right)<\infty. (85)