PromptSplit: Revealing Prompt-Level Disagreement in Generative Models
Mehdi Lotfian, Mohammad Jalali, Farzan Farnia · 2026
Read PromptSplit: Revealing Prompt-Level Disagreement in Generative Models by Mehdi Lotfian, Mohammad Jalali, Farzan Farnia (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-04009.txt.
Description
Different generative models misbehave on different prompts. Mehdi Lotfian and 2 co-authors built PromptSplit to find which prompts divide them. Their 2026 framework compares two models prompt by prompt, using kernel embeddings that fuse each prompt with the output it produced.
The difference between the models' covariance structures points to the main directions of disagreement. Random projections keep the computation affordable, and theory bounds the approximation error. Knowing exactly which prompt types split models helps developers target fixes, auditors hunt biases, and users pick the right model for a job. The method applies to image and text generators alike.
Catalog record
| CREATOR | Mehdi Lotfian, Mohammad Jalali, Farzan Farnia |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 52 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-04009