Out-of-Distribution Detection using Synthetic Data Generation
Momin Abbas, Muneeza Azmat, Raya Horesh, Mikhail Yurochkin · 2025
Read Out-of-Distribution Detection using Synthetic Data Generation by Momin Abbas, Muneeza Azmat, Raya Horesh, Mikhail Yurochkin (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-03323.txt.
Description
Momin Abbas and co-authors present a 2025 trick for spotting inputs that fall outside a classifier's training world. Such out of distribution cases can wreck a deployed model, yet real examples of them are hard to gather. The team's fix has a large language model write fake stand ins for the odd cases.
No outside odd case data is needed at all. Tests spanned nine in and out data pairs, from toxicity and sentiment checks to reward model training and spotting off track model output. False alarm rates fell hard, to zero in some pairs, while in world accuracy held. The method beat bench rivals by a wide edge across model sizes.
Catalog record
| CREATOR | Momin Abbas, Muneeza Azmat, Raya Horesh, Mikhail Yurochkin |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 92 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-03323