A Large-Scale Empirical Analysis of Custom GPTs’ Vulnerabilities in the OpenAI Ecosystem
Sunday Oyinlola Ogundoyin, Muhammad Ikram, Hassan Jameel Asghar, Benjamin Zi Hao Zhao, and Dali Kaafar · 2025
Read A Large-Scale Empirical Analysis of Custom GPTs’ Vulnerabilities in the OpenAI Ecosystem by Sunday Oyinlola Ogundoyin, Muhammad Ikram, Hassan Jameel Asghar, Benjamin Zi Hao Zhao, and Dali Kaafar (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-08148.txt.
Description
Sunday Oyinlola Ogundoyin and co-authors audit the safety of custom chatbots at scale in a 2025 paper. Platforms like OpenAI's store let anyone publish tailored GPT assistants, and millions use them. Security worries have mostly been argued in theory. This team tested nearly fifteen thousand custom GPTs against seven concrete attacks, from tricking the bot into roleplay rule-breaking to leaking its hidden instructions and generating phishing text or malicious code.
Over ninety-five percent lacked adequate protection. Roleplay attacks succeeded against about ninety-six percent, prompt leakage against about ninety-two, and phishing generation against about ninety-one. A ranking system linked popularity tiers to risk, and the base models' own weaknesses were often inherited or amplified. The authors call for stronger platform safeguards and moderation.
Catalog record
| CREATOR | Sunday Oyinlola Ogundoyin, Muhammad Ikram, Hassan Jameel Asghar, Benjamin Zi Hao Zhao, and Dali Kaafar |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 75 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-08148