SKALD: Scalable K-Anonymisation for Large Datasets

Kailash Reddy, Novoneel Chakraborty, Amogh Dharmavaram, Anshoo Tandon · 2025

Read SKALD: Scalable K-Anonymisation for Large Datasets by Kailash Reddy, Novoneel Chakraborty, Amogh Dharmavaram, Anshoo Tandon (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-03529.txt.

Description

Kailash Reddy and three colleagues present SKALD, an algorithm for anonymizing very large datasets, in a paper published in two thousand twenty-five. Privacy law and practice favor k-anonymisation, which hides each person inside a group of lookalikes. Standard tools, though, must fit the whole dataset in memory.

Big datasets get chopped into chunks, and chunk-by-chunk anonymisation loses quality. SKALD instead extracts sufficient statistics from each chunk and combines them. The global picture guides anonymisation even under tight memory limits. The authors claim multi-fold performance improvements over standard methods. Utility of the released data is also better preserved. The algorithm targets releases of sensitive tabular data at real-world scale.

Catalog record

CREATORKailash Reddy, Novoneel Chakraborty, Amogh Dharmavaram, Anshoo Tandon
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE25 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-03529

Browse the full library · About the Tower of Babel