Dissimilar Batch Decompositions of Random Datasets
Ghurumuruhan Ganesan IISER Bhopal · 2025
Read Dissimilar Batch Decompositions of Random Datasets by Ghurumuruhan Ganesan IISER Bhopal (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-06991.txt.
Description
Machine learning trains on data served in small batches, and the mix inside each batch can sway what is learned. Ghurumuruhan Ganesan studies batch design with probability tools in this 2025 paper. Data points are drawn at random from some space, and some may be corrupted. A similarity score says how alike two points are.
The splits in focus limit how much similarity any one batch may hold. Ganesan finds sharp bounds, holding with high chance, on the smallest possible size of such a split. A tradeoff shows up: loosening the similarity cap shrinks the batch count, and tightening it grows the count. A second set of bounds caps the size of subsets with a given similarity level. The results can guide how training data is portioned when near-duplicates are a worry.
Catalog record
| CREATOR | Ghurumuruhan Ganesan IISER Bhopal |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 48 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-06991