Data Efficient Subset Training with Differential Privacy
Ninad Jayesh Gandhi, Moparthy Venkata Subrahmanya Sri HarshaCentre for Machine Intelligence and Data ScienceIIT Bombay {ninad.gandhi,24M2151}@iitb.ac.in · 2025
Read Data Efficient Subset Training with Differential Privacy by Ninad Jayesh Gandhi, Moparthy Venkata Subrahmanya Sri HarshaCentre for Machine Intelligence and Data ScienceIIT Bombay {ninad.gandhi,24M2151}@iitb.ac.in (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-06732.txt.
Description
Ninad Gandhi and Sri Harsha, authors from an Indian institute in the record, test data-efficient subset training under differential privacy in 2025. Private training trades privacy against performance, converges slowly and needs heavy tuning, so efficient data use is attractive.
They adapt a known subset selection method, called GLISTER, to the private setting and assess it in depth. The hope was that training on a smart subset would offset the costs that privacy imposes. In practice, they find that realistic privacy budgets are too tight for data-efficient training to work well here. That negative result still maps a real limit for the field, they argue.
Catalog record
| CREATOR | Ninad Jayesh Gandhi, Moparthy Venkata Subrahmanya Sri HarshaCentre for Machine Intelligence and Data ScienceIIT Bombay {ninad.gandhi,24M2151}@iitb.ac.in |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 22 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-06732