Provable Model-Parallel Distributed Principal Component Analysis with Parallel Deflation

Fangshuo Liao, Wenyi Su, Anastasios Kyrillidis · 2025

Read Provable Model-Parallel Distributed Principal Component Analysis with Parallel Deflation by Fangshuo Liao, Wenyi Su, Anastasios Kyrillidis (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-17615.txt.

Description

Fangshuo Liao, Wenyi Su, and Anastasios Kyrillidis presented in 2025 a distributed method for principal component analysis in which each worker seeks a distinct eigenvector. Standard deflation finds these vectors one after another, in strict order. Their method loosens that order so workers can update in parallel.

Each worker refines its vector using interim results from peers ranked above it, at small communication cost. The authors supply the missing theory for why these layered updates converge in a distributed setting. A prototype matched the performance of a leading model-parallel solver in tests, while scaling well. The work aims at large data spread across many machines.

Catalog record

CREATORFangshuo Liao, Wenyi Su, Anastasios Kyrillidis
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE81 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-17615

Browse the full library · About the Tower of Babel