Dissimilar Batch Decompositions of Random Datasets

Ghurumuruhan Ganesan IISER Bhopal · 2025

Read Dissimilar Batch Decompositions of Random Datasets by Ghurumuruhan Ganesan IISER Bhopal (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-06991.txt.

Description

Machine learning trains on data served in small batches, and the mix inside each batch can sway what is learned. Ghurumuruhan Ganesan studies batch design with probability tools in this 2025 paper. Data points are drawn at random from some space, and some may be corrupted. A similarity score says how alike two points are.

The splits in focus limit how much similarity any one batch may hold. Ganesan finds sharp bounds, holding with high chance, on the smallest possible size of such a split. A tradeoff shows up: loosening the similarity cap shrinks the batch count, and tightening it grows the count. A second set of bounds caps the size of subsets with a given similarity level. The results can guide how training data is portioned when near-duplicates are a worry.

Catalog record

CREATORGhurumuruhan Ganesan IISER Bhopal
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE48 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-06991

Browse the full library · About the Tower of Babel