Auditing Black-Box LLM APIs with a Rank-Based Uniformity Test

Xiaoyuan Zhu, Yaowen Ye, Tianyi Qiu, Hanlin Zhu, Sijun Tan, Ajraf Mannan, Jonathan Michala, Raluca Ada Popa, Willie Neiswanger · 2025

Read Auditing Black-Box LLM APIs with a Rank-Based Uniformity Test by Xiaoyuan Zhu, Yaowen Ye, Tianyi Qiu, Hanlin Zhu, Sijun Tan, Ajraf Mannan, Jonathan Michala, Raluca Ada Popa, Willie Neiswanger (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-06975.txt.

Description

Xiaoyuan Zhu and co-authors offer users a way to check whether the chatbot behind a paid API is really the model advertised. Providers could quietly swap in a cheaper quantized or tampered variant, and users, who see neither weights nor raw scores, would struggle to notice. The team's test compares the service's behavior against a trusted local copy using ranks: with the right statistics, identical models produce a telltale uniform pattern.

The test needs few queries and hides its own pattern, so a provider watching for audits cannot easily reroute the checks. Across threat scenarios, from compression and harmful fine-tuning to jailbreak tuning and outright substitution, the method out-detected earlier approaches under tight query budgets. The authors frame the work as accountability tooling for an opaque market: as models become rented utilities, customers need receipts that the goods match the label.

Catalog record

CREATORXiaoyuan Zhu, Yaowen Ye, Tianyi Qiu, Hanlin Zhu, Sijun Tan, Ajraf Mannan, Jonathan Michala, Raluca Ada Popa, Willie Neiswanger
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE37 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-06975

Browse the full library · About the Tower of Babel