SKALD: Scalable K-Anonymisation for Large Datasets
Kailash Reddy, Novoneel Chakraborty, Amogh Dharmavaram, Anshoo Tandon · 2025
Read SKALD: Scalable K-Anonymisation for Large Datasets by Kailash Reddy, Novoneel Chakraborty, Amogh Dharmavaram, Anshoo Tandon (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-03529.txt.
Description
Kailash Reddy and three colleagues present SKALD, an algorithm for anonymizing very large datasets, in a paper published in two thousand twenty-five. Privacy law and practice favor k-anonymisation, which hides each person inside a group of lookalikes. Standard tools, though, must fit the whole dataset in memory.
Big datasets get chopped into chunks, and chunk-by-chunk anonymisation loses quality. SKALD instead extracts sufficient statistics from each chunk and combines them. The global picture guides anonymisation even under tight memory limits. The authors claim multi-fold performance improvements over standard methods. Utility of the released data is also better preserved. The algorithm targets releases of sensitive tabular data at real-world scale.
Catalog record
| CREATOR | Kailash Reddy, Novoneel Chakraborty, Amogh Dharmavaram, Anshoo Tandon |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 25 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-03529