On the Lipschitz Continuity of Set Aggregation Functions and Neural Networks for Sets

Giannis Nikolentzos, Kontantinos Skianis · 2025

Read On the Lipschitz Continuity of Set Aggregation Functions and Neural Networks for Sets by Giannis Nikolentzos, Kontantinos Skianis (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-24403.txt.

Description

Giannis Nikolentzos and Konstantinos Skianis examine whether the set-aggregation functions used by neural networks for unordered data are Lipschitz continuous, and by how much. A network's Lipschitz constant governs its robustness and how well it generalizes. For data that arrive as sets of vectors, models first squash each set into one vector with a sum, mean, max, or attention step.

Working with three natural distances between multisets, the authors test each aggregation for continuity and compute its constants. The analysis extends earlier work that covered only ordinary layered networks. Designers of set-based models, used for point clouds and molecules, gain a stability check. Small input wiggles should not explode into wild outputs.

Catalog record

CREATORGiannis Nikolentzos, Kontantinos Skianis
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE153 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-24403

Browse the full library · About the Tower of Babel