Exposing Diversity Bias in Deep Generative Models: Statistical Origins and Correction of Diversity Error

Farzan Farnia, Mohammad Jalali, Azim Ospanov · 2026

Read Exposing Diversity Bias in Deep Generative Models: Statistical Origins and Correction of Diversity Error by Farzan Farnia, Mohammad Jalali, Azim Ospanov (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-14682.txt.

Description

Generative models make striking samples, but do they match the true spread of the data? Farzan Farnia, with Mohammad Jalali and Azim Ospanov as co-authors, compares generated diversity against test data using Vendi and RKE entropy scores. Across benchmarks, test data scores clearly higher than model samples.

The authors trace part of the gap to finite samples: entropy scores rise with sample size, so training sets understate true diversity. Tuning generators to match finite-set diversity can therefore bake the shortfall in. The paper names this diversity error, explains its statistical roots, and points toward corrections. It reframes diversity as a measurable target, not a vague hope.

Catalog record

CREATORFarzan Farnia, Mohammad Jalali, Azim Ospanov
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE71 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-14682

Browse the full library · About the Tower of Babel