Out-of-Distribution Detection using Synthetic Data Generation

Momin Abbas, Muneeza Azmat, Raya Horesh, Mikhail Yurochkin · 2025

Read Out-of-Distribution Detection using Synthetic Data Generation by Momin Abbas, Muneeza Azmat, Raya Horesh, Mikhail Yurochkin (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-03323.txt.

Description

Momin Abbas and co-authors present a 2025 trick for spotting inputs that fall outside a classifier's training world. Such out of distribution cases can wreck a deployed model, yet real examples of them are hard to gather. The team's fix has a large language model write fake stand ins for the odd cases.

No outside odd case data is needed at all. Tests spanned nine in and out data pairs, from toxicity and sentiment checks to reward model training and spotting off track model output. False alarm rates fell hard, to zero in some pairs, while in world accuracy held. The method beat bench rivals by a wide edge across model sizes.

Catalog record

CREATORMomin Abbas, Muneeza Azmat, Raya Horesh, Mikhail Yurochkin
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE92 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-03323

Browse the full library · About the Tower of Babel