On the Lipschitz Continuity of Set Aggregation Functions and Neural Networks for Sets
Giannis Nikolentzos, Kontantinos Skianis · 2025
Read On the Lipschitz Continuity of Set Aggregation Functions and Neural Networks for Sets by Giannis Nikolentzos, Kontantinos Skianis (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-24403.txt.
Description
Giannis Nikolentzos and Konstantinos Skianis examine whether the set-aggregation functions used by neural networks for unordered data are Lipschitz continuous, and by how much. A network's Lipschitz constant governs its robustness and how well it generalizes. For data that arrive as sets of vectors, models first squash each set into one vector with a sum, mean, max, or attention step.
Working with three natural distances between multisets, the authors test each aggregation for continuity and compute its constants. The analysis extends earlier work that covered only ordinary layered networks. Designers of set-based models, used for point clouds and molecules, gain a stability check. Small input wiggles should not explode into wild outputs.
Catalog record
| CREATOR | Giannis Nikolentzos, Kontantinos Skianis |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 153 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-24403