MIRAGE: Multi-model Interface for Reviewing and Auditing Generative Text-to-Image AI

Matheus Kunzler Maldaner, Wesley Hanwen Deng, Jason Hong, Ken Holstein, Motahhare Eslami · 2025

Read MIRAGE: Multi-model Interface for Reviewing and Auditing Generative Text-to-Image AI by Matheus Kunzler Maldaner, Wesley Hanwen Deng, Jason Hong, Ken Holstein, Motahhare Eslami (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-19252.txt.

Introduction

Matheus Kunzler Maldaner and co-authors build a web tool for public auditing of image generators, in work from 2025. Text-to-image systems can produce harmful outputs that erode trust. People affected by those outputs rarely get a structured way to report them.

The tool, MIRAGE, shows outputs from several models side by side. Users compare images and file findings in a set format. A pilot study ran five participants through the interface. Users drew on their own lived experience to spot bias details. Comparing models surfaced harms that single-model review missed. The design turns scattered complaints into auditable evidence for developers.

Catalog record

CREATORMatheus Kunzler Maldaner, Wesley Hanwen Deng, Jason Hong, Ken Holstein, Motahhare Eslami
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE13 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-19252

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

MIRAGE: Multi-model Interface for Reviewing and Auditing Generative Text-to-Image AI Matheus Kunzler Maldaner, Wesley Hanwen Deng, Jason Hong, Ken Holstein, Motahhare Eslami Abstract While generative AI systems have gained popularity in diverse applications, their potential to produce harmful outputs limits their trustworthiness and usability in different applications. Recent years have seen growing interest in engaging diverse AI users in auditing generative AI that might impact their lives. To this end, we propose MIRAGE as a web-based tool where AI users can compare outputs from multiple AI text-to-image (T2I) models by auditing AI-generated images, and report their findings in a structured way. We used MIRAGE to conduct a preliminary user study with five participants and found that MIRAGE users could leverage their own lived experiences and identities to surface previously unnoticed details around harmful biases when reviewing multiple T2I models’ outputs compared to reviewing only one. Figure 1: MIRAGE User Interface and Outlined Workflow Introduction Despite their popularity, generative AI such as text-to-image (T2I) systems can lead to problematic outputs, such as harmful biases reinforcing societal stereotypes or producing misleading information ( Bianchi et al. 2023 ) . For example, a recent news article suggested that Stable Diffusion, a popular open-source T2I model, rarely depicted women as doctors, lawyers, or judges, and often suggested that men with dark skin commit crimes, reinforcing harmful gender and racial biases ( Nicoletti and Bass 2023 ; Buolamwini and Gebru 2018 ) . Auditing algorithms are crucial for detecting discrimination and ensuring fairness in AI systems ( Sandvig et al. 2014 ) . Recognizing the power of diverse end users in surfacing harmful behaviors in AI systems that might otherwise be overlooked by small groups of AI developers, recent research has explored engaging users in auditing AI systems ( Shen et al. 2021 ; DeVos et al. 2022 ) . Industry AI teams are also often motivated to engage diverse users in auditing their AI systems and products, and often employ crowdsourcing platform to recruit and assign auditing tasks to users ( Deng et al. 2023 ) . However, they often lack effective mechanisms to scaffold users in surfacing harmful biases that are relevant to their own identities and lived experiences ( Lam et al. 2022 ) . In this paper, we explore whether viewing outputs from multiple text-to-image models can help users identify image details they might have missed in a single model output. To explore this, we contribute (1) the development of MIRAGE, a web-based interface for multi-model side-by-side comparison, (2) preliminary findings from five user studies, and (3) the exploration of future work directions for MIRAGE and everyday user auditing ( Shen et al. 2021 ) . Related Work A small but growing line of work has explored developing tools for engaging AI developers and users in testing and auditing AI models. For example, Lam et al. developed IndieLabel, an end-user audit system, to empower users with low tech-savviness in auditing sentiment analysis algorithms ( Lam et al. 2022 ) . Kahng et al. designed LLM comparators for AI developers to more effectively compare and audit text-based LLM outputs ( Kahng et al. 2024 ) . More recently, Replicate, a platform providing an array of open-source generative AI models, has developed Zoo as an open-source text-to-image playground ( Replicate 2024 ; Zoo, Replicate 2024 ) . Although Zoo allows users to compare different model outputs, the interface is not particularly designed with auditing as its primary goal ( Zoo, Replicate 2024 ) . For example, users are unable to provide feedback on the model outputs. In addition, Zoo’s model outputs are laid out vertically, requiring users to scroll to see different results, which reduces efficiency in directly comparing model outputs ( Tufte 2001 ) . Our work extends this prior work by designing, developing, and evaluating a web-based interface that allows AI users to review multiple T2I model outputs and report their audit insights in a structured way. System Description MIRAGE is a web-based interface designed to facilitate the auditing of generative text-to-image AI models. Upon entering MIRAGE, users first input a prompt they would like to audit (Figure 1 , Step 1). They will then see image outputs from the bytedance/sdxl-lightning-4step model, chosen for its fast inference speed and high image quality which ensures minimal wait times (Figure 1 , Step 3). After auditing the single model’s image outputs, participants proceed to audit multiple image outputs from all four predefined models: bytedance/sdxl-lightning-4step, ai-forever/kandinsky-2.2, stability-ai/stable-diffusion, and fofr/latent-consistency-model (Figure 1 , Step 4). Between these steps, participants answer prepared questions shown in Figure 3 that will ultimately become part of the audit report. Please visit mirage.weaudit.org to access MIRAGE 1 1 1 We plan to live demo MIRAGE during the conference . Figure 2: MIRAGE Technical Implementation Implementation In order to achieve our goal, we first developed the MIRAGE web application (Figure 2 ), hosting it on Amazon Lightsail with a Docker container packaging a Django project. Image generation for specific models is handled through API calls to Replicate, a centralized service that works as a hub for open-source models. After generation, images are stored in an Amazon S3 Bucket with unique IDs and referenced in an Amazon DynamoDB table for easy retrieval. Backend computations are performed using AWS Lambda functions, accessed through Amazon API Gateway. Although not used in our study, we also integrate a discussion forum developed using the Discourse API, so that users can choose to post and discuss their audit findings. Preliminary User Study To test our hypothesis that multi-model comparisons can help users detect biases, we conducted an initial user study with five participants to evaluate the effectiveness of MIRAGE. Participants were first asked to enter a predefined prompt (“a fancy dinner party”) but later had the opportunity to explore the tool by entering two prompts of their choice, where we encouraged them to consider their background and identities. While the models were generating images in the background, participants were asked additional questions to reflect on their lived experiences and the images they anticipated. Figure 3: MIRAGE User Study Workflow As shown in Figure 3 , participants were first asked why they chose the specific prompt to audit and what they expected the models to generate. This step encouraged users to reflect on their own biases while allowing all models to generate outputs in the background without the users noticing. Initially, participants were only shown the image outputs of the first model and asked whether these matched their initial expectations and if there was anything unexpected about the results. After answering these questions, users were shown all four model outputs, given time to examine them, and then asked whether seeing more models helped them identify any potentially harmful details exhibited in the first model’s outputs that they had previously missed. For this preliminary user study, we recruited our participants through convenient sampling. The study was approved by our Institutional Review Board. Each session lasted around 30-45 minutes, and all participants were compensated with $15 Amazon gift cards for their time. Preliminary Findings The preliminary user study of MIRAGE provided several insights into its usefulness and usability. To start with, all five participants found MIRAGE easy to use, with

Read the complete text