Comment on “Sparse Bayesian Factor Analysis when the Number of Factors is Unknown” by S. Frühwirth-Schnatter, D. Hosszejni, and H. Freitas Lopes written by Roberto Casarin and Antonio Peruzzi (Ca’ Foscari University of Venice)

2024

Read Comment on “Sparse Bayesian Factor Analysis when the Number of Factors is Unknown” by S. Frühwirth-Schnatter, D. Hosszejni, and H. Freitas Lopes written by Roberto Casarin and Antonio Peruzzi (Ca’ Foscari University of Venice) (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2411-02531.txt.

Description

Abstract 1 Introduction The techniques suggested in Frühwirth-Schnatter et al. 2024 , FS-H-FL hereafter, concern sparsity and factor selection and have enormous potential beyond standard factor analysis applications. We show how these techniques can be applied to Latent Space (LS) models for network data.

Catalog record

YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE4 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2411-02531

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Comment on “Sparse Bayesian Factor Analysis when the Number of Factors is Unknown” by S. Frühwirth-Schnatter, D. Hosszejni, and H. Freitas Lopes written by Roberto Casarin and Antonio Peruzzi (Ca’ Foscari University of Venice)


Abstract




1
Introduction

The techniques suggested in
Frühwirth-Schnatter et al. 2024
,
FS-H-FL
hereafter, concern sparsity and factor selection and have enormous potential beyond standard factor analysis applications. We show how these techniques can be applied to Latent Space (LS) models for network data. These models suffer from well-known identification issues of the latent factors due to likelihood invariance to factor translation, reflection, and rotation (see
Hoff et al. 2002
). A set of observables can be instrumental in identifying the latent factors via auxiliary equations (see
Liu et al. 2021
). These, in turn, share many analogies with the equations used in factor modeling, and we argue that the factor loading restrictions may be beneficial for achieving identification.

2
Latent Space models

Denote with
W=\{w_{ij},i,j=1,\ldots,n\}
the adjacency matrix of a weighted network
\mathcal{G}
, where the weights are integer-valued,
w_{ij}\in\mathbb{N}
. We assume the following model:

w_{ij}\overset{ind}{\sim}\mathcal{P}oi(\theta_{ij}),\quad\theta_{ij}=g(\alpha-||\mathbf{f}_{i}-\mathbf{f}_{j}||^{2}),

where
\mathcal{P}oi(\theta)
denotes the Poisson distribution with intensity
\theta
,
g(\cdot):\mathbb{R}\rightarrow\mathbb{R}^{+}
is a link function,
\alpha
is an intercept parameter,
\mathbf{f}_{i}
,
i=1,\ldots,n
is a collection of
d
-dimensional latent factors and
||\cdot||
denotes the Euclidean distance. To avoid translation issues, one can assume
\sum_{i=1}^{n}f_{ik}=0
for
k=1,\ldots,d
.

The latent factors can be interpreted via a set of node-specific observables
Y
with the following interpretation factor model:

Y=\Lambda\mathbf{f}+\bm{\varepsilon},\quad\bm{\varepsilon}\sim\mathcal{MN}_{p,n}(O,\Sigma_{p},I_{n}),

where
Y
is an
p\times n
matrix of interpretation variables,
\mathbf{f}=(\mathbf{f}_{1},\mathbf{f}_{2},\ldots,\mathbf{f}_{n})
is a
d\times n
matrix obtained by stacking the factors,
\Lambda=(\bm{\lambda}_{1},\bm{\lambda}_{2},\ldots,\bm{\lambda}_{d})
is a
p\times d
matrix of loadings with
\bm{\lambda}_{k}=(\lambda_{1k},\lambda_{2k},\ldots,\lambda_{lk},\ldots,\lambda_{pk})^{\prime}
and
\bm{\varepsilon}
is a
p\times n
matrix of independent normal error terms with
\Sigma_{p}=\diag(\sigma^{2}_{1},\ldots,\sigma^{2}_{p})
.
We are interested in achieving
row sparsity
for
\Lambda
. Similarly to
FS-H-FL
, we assume the following prior distributions:

\displaystyle\alpha\sim\mathcal{N}(0,\sigma^{2}_{\alpha}),\quad\mathbf{f}_{i}\sim\mathcal{N}_{d}\left(\bm{0},(1-1/d)^{-1}I_{d}\right),\quad\sigma^{2}_{i}\sim\mathcal{IG}\left(c_{0},C_{0}\right),

\displaystyle\tau_{l}\sim\mathcal{B}e\left(1,1\right),\quad\sigma_{k}^{2}\sim\mathcal{IG}\left(c_{\sigma},b_{\sigma}\right),\quad\kappa\sim\mathcal{IG}\left(c_{\kappa},b_{\kappa}\right),

\displaystyle\lambda_{lk}\mid\kappa,\sigma_{k}^{2},\tau_{l}\sim\left(1-\tau_{l}\right)\delta_{0}+\tau_{l}\mathcal{N}\left(0,\kappa\sigma_{k}^{2}\right).

Figure
1
presents the posterior results for an LS model with
d=2
and
p=4
for the unrestricted and restricted
\Lambda
(top and bottom panels, respectively). Panel b) shows the identification issue, and Panel f) the effectiveness of the restrictions on
\Lambda
to achieve identification of the set of latent factors
\mathbf{f}
. The factor identification is obtained via PLT restriction, i.e.
\lambda_{kk}>0
and
\lambda_{lk}=0
for
k>l
. As discussed in
FS-H-FL
, the PLT structure may be too restrictive. Therefore, we speculate on imposing an ordered or unordered GLT structure on
\Lambda
.

Figure 1:
Results for an LS model without and with restrictions (top and bottom, respectively). Panel a) and e)
report the observed network width edge gradient proportional to the absolute distance between the observed and predicted weight (darker edge colors). Panel b) and f) report the posterior draws (blue dots) against the true latent coordinates (red triangles). The true value of
\Lambda
is in Panel c) and g). Panel d) and h) report the posterior means of
\Lambda
without and with PLT restrictions, respectively.

3
Conclusion

As further research, we suggest extending the authors’ approach to nonlinear factor models. This is a stimulating work, and we are therefore very pleased to be able to propose the vote of thanks to the authors for

Read the complete text