Evaluation without Generation: Non-Generative Assessment of Harmful Model Specialization with Applications to CSAM
Vinith M. Suriyakumar, Ayush Sekhari, Lena Stempfle, Robertson Wang, Michael Simpson, Rebecca Portnoff, Marzyeh Ghassemi, Ashia C. Wilson · 2026
Read Evaluation without Generation: Non-Generative Assessment of Harmful Model Specialization with Applications to CSAM by Vinith M. Suriyakumar, Ayush Sekhari, Lena Stempfle, Robertson Wang, Michael Simpson, Rebecca Portnoff, Marzyeh Ghassemi, Ashia C. Wilson (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-25119.txt.
Introduction
Suriyakumar and seven colleagues address auditing of fine-tuned open-weight models for harmful specialization. Generating test outputs does not scale to platform audits and is legally barred for material such as child sexual abuse material. So they infer capability from model parameters or internal states instead. Their Gaussian probing method tracks how LoRA adaptors shift representations under Gaussian latent ensembles, separating benign fine-tunes from harmful ones with no outputs generated, and it resists weight rescaling.
Catalog record
| CREATOR | Vinith M. Suriyakumar, Ayush Sekhari, Lena Stempfle, Robertson Wang, Michael Simpson, Rebecca Portnoff, Marzyeh Ghassemi, Ashia C. Wilson |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 73105 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.25119
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Evaluation without Generation: Non-Generative Assessment of Harmful Model Specialization with Applications to CSAM Vinith M. Suriyakumar, Ayush Sekhari, Lena Stempfle, Robertson Wang, Michael Simpson, Rebecca Portnoff, Marzyeh Ghassemi, Ashia C. Wilson Abstract Auditing the fine-tunes of open-weight generative models for harmful specialization has become a new governance challenge for model hosting platforms. The standard toolkit, generative evaluation via curated prompts or red-teaming, does not scale to platform-level auditing and breaks down entirely for domains like child sexual abuse material (CSAM) where generation is legally constrained. This motivates the Evaluation without Generation problem: assessing model capabilities without producing outputs. In such settings, capability must be inferred from the model’s state, either its parameters or internal representations, rather than its outputs. We introduce Gaussian probing , a method that characterizes how LoRA adaptors functionally perturb a model by measuring its internal responses to a reference ensemble of Gaussian latent states. Unlike raw-weight baselines, Gaussian probing reliably distinguishes benign from harmful specialization without sampling outputs. We demonstrate effectiveness in high-risk domains, including detecting models specialized for CSAM under realistic constraints. Our results show that Gaussian probing provides a scalable non-generative alternative for evaluating high-risk generative systems and remains robust to weight rescaling, a representative adversarial manipulation. 1 Introduction The proliferation of open weight generative models, such as Stable Diffusion [ 45 ] , FLUX [ 28 ] , and Wan [ 60 ] , has made high-quality image and video generation widely accessible [ 64 , 11 ] . In tandem, low-rank adaptation (LoRA), a commonly used finetuning algorithm, enables cheap and efficient specialization of generative models at a fraction of the cost of traditional finetuning [ 17 ] . Accessibility has also been improved by user-friendly graphical interfaces such as InvokeAI [ 20 ] , which allow amateurs and hobbyists to finetune models for their own creative purposes. As a result, powerful image and video models can be easily specialized, and those specializations can be shared through multiple different services, including public model-sharing platforms. This shift has created new governance challenges for open model-sharing platforms. Platforms such as CivitAI and Hugging Face host and distribute base models, fine-tuned variants, and, crucially, lightweight LoRA adaptors that users can combine, circulate, and redeploy widely before any output is ever inspected. This includes models optimized to produce child sexual abuse material (CSAM), with offenders producing bespoke models through fine-tuning that target particular children, victims and survivors of child sexual abuse [ 53 ] . Governance, therefore, becomes a problem of screening reusable model artifacts before they are broadly distributed. At present, model assessment for first-party model providers is still largely organized around generative evaluation : prompting an adapted model, inspecting its outputs, and using those outputs to infer whether the model has acquired a harmful capability [ 54 ] . This approach does not scale to model hosting platforms. It depends on prompt coverage, requires iterative red-teaming and review, and becomes increasingly costly as the number of uploaded variants grows. The scale of adaptors to be screened is substantial: CivitAI alone reports hundreds of thousands of new LoRAs trained in a single month, alongside millions of generations 1 1 1 https://www.runpod.io/case-studies/civitai-runpod-case-study . At this scale, output-based auditing cannot serve as the sole mechanism for pre-distribution governance. For several categories of harmful content, the limitations are even more acute. Evaluating outputs related to bioweapons, cyberattacks, hate speech, or non-consensual intimate imagery can impose substantial psychological burdens, and the expertise required for reliable evaluation may be scarce [ 44 , 51 , 16 ] . For CSAM, our central motivating application, generative evaluation breaks down entirely: attempting to generate CSAM, regardless of intent or success, is unlawful behavior in several regulatory regimes and jurisdictions, including the United States [ 50 ] . This leaves platforms and auditors with limited ability to determine whether a user-uploaded adaptor has specialized a model toward CSAM generation before that adaptor is shared. LoRAs represent a unique risk, since their small and portable format makes them easy for offenders to exchange [ 53 ] . That limitation matters given AI-generated CSAM is a large and accelerating crisis, with cross-sector impact across hotlines, content moderators, law enforcement [ 53 , 19 ] , creating significant human harm 2 2 2 https://www.cbsnews.com/news/sextortion-generative-ai-scam-elijah-heacock-take-it-down-act/ . In its most recent report analyzing 2024 reports, NCMEC (the National Center for Missing and Exploited Children, which acts as a global clearinghouse for reports related to child sexual abuse and exploitation) received 67,000 reports of AI-generated CSAM, up from 4,700 in 2023 [ 9 ] . Taken together, this harm landscape motivates our core questions: Can harmful specialization be detected from weights alone, without ever generating an output? (a) (b) Figure 1 : (a) Key insight: LoRA fine-tuning shifts the model’s feature distribution, separating benign and explicit outputs in latent space. Proposed Gaussian probing pipeline, which samples Gaussian noise, runs the diffusion model with LoRA, records intermediate activations across timesteps, and aggregates them into feature vectors without generating images. (b) Example results for all three architectures (SD 1.5, SDXL 1.0, FLUX.1-dev) for NSFW and CSAM detection in the wild. We call this the Evaluation without Generation problem. In this work, we study a concrete and narrower instance that arises in open ecosystems: screening LoRA adaptors for evidence of direct specialization toward two sensitive content categories, adult sexual content (NSFW) and CSAM, without generating outputs. We focus on LoRAs because they are the primary unit through which specialization is created, packaged, and distributed. We answer this in the affirmative by shifting evaluation from output space to the model’s state. Rather than measuring what a model generates, we measure how fine-tuning changes its parameters or internal computation. This reframes capability evaluation as an inference problem over model state rather than outputs. We propose Gaussian probing , a method that characterizes how a LoRA functionally perturbs a base diffusion model by measuring its internal responses to random Gaussian inputs. These responses provide a scalable, prompt-free signature of adaptor specialization without requiring image generation. We evaluate the method in two settings. First, in controlled experiments on in-house trained safe-for-work (SFW) and not-safe-for-work (NSFW) LoRAs spanning variation in datasets, styles, architectures, and training conditions. Second in a naturalistic setting using LoRAs collected from public platforms such as CivitAI and CSAM LoRAs accessed through authorized entities and in accordance with applicable laws, where heterogeneity, label noise, and shortcut opportunities better reflect deployment conditions. Across both regimes, Gaussian probing reliably detects harmful NSFW and CSAM specialization while remaining more robust than raw-weight baselines to superficial training artifacts. To our knowledge, this is the first scalable, non-generative method for pre-distribution screening of CSAM-related specialization in user-uploaded generative models. 2 Problem Formulation 2.1 Defining the Governance Target and Scope Open platforms face a practical question when users upload LoRA adaptors: does this warrant intervention before it is widely shared? Put differently, can an uploaded adaptor contribute to harmful downstream use? Answering that question requires some care, because capability is not an intrinsic property of a LoRA in isolation. Whether an adaptor is treated as harmful depends on how it is expected to be used and on what kind of behavior a platform is prepared to tolerate. For example, a