Statistical Methods in Generative AI Journal: Annu. Rev. Stat. Appl. DOI: 10.1146/TBD
Edgar Dobriban 1 · 2025
Read Statistical Methods in Generative AI Journal: Annu. Rev. Stat. Appl. DOI: 10.1146/TBD by Edgar Dobriban 1 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-07054.txt.
Introduction
Edgar Dobriban, writing alone in a 2025 paper, reviews what statistics can do for generative AI. Such AI is set to change many fields, yet it works by sampling from chance-based models. By itself, it gives no pledge that its output is right, safe, or fair.
Statistics, the author argues, offers tools to make these systems more sound. It can help check how good a model is, plan tests and trials, and design steps that fix flaws. The paper walks through past work on each of these themes, in plain terms first and then in AI use. It also notes where the tools fall short and where fresh work is most needed. The upshot is a call to treat stats as a base for trust in generative AI.
Catalog record
| CREATOR | Edgar Dobriban 1 |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 62 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-07054
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Statistical Methods in Generative AI Journal: Annu. Rev. Stat. Appl. DOI: 10.1146/TBD Edgar Dobriban 1 Abstract Generative Artificial Intelligence is emerging as an important technology, promising to be transformative in many areas. At the same time, generative AI techniques are based on sampling from probabilistic models, and by default, they come with no guarantees about correctness, safety, fairness, or other properties. Statistical methods offer a promising potential approach to improve the reliability of generative AI techniques. In addition, statistical methods are also promising for improving the quality and efficiency of AI evaluation, as well as for designing interventions and experiments in AI. In this paper, we review some of the existing work on these topics, explaining both the general statistical techniques used, as well as their applications to generative AI. We also discuss limitations and potential future directions. \jvol TBD 2025+ keywords Artificial Intelligence, generative AI, statistical methods, uncertainty quantification, AI evaluation, interventions and experiment design. 1 Introduction Artificial Intelligence, and more specifically, Generative AI, is emerging as an important technology. Over the past few years a number of prominent generative AI technologies have been developed and have received widespread attention; ranging from text generation via large language models (ChatGPT, Claude, Llama, Gemini, DeepSeek, Qwen, etc), image generation via diffusion models (Dall-E, Stable Diffusion, etc), to scientific generative AI techniques used for protein generation (e.g., Watson et al. 2023 , etc) , DNA sequence editing (e.g., Ruffolo et al. 2025 , etc) , among others. Such methods have been quickly adopted by end users and institutions, both via direct usage, as well as integrated in other tools such as code assistants and web search agents. The scientific community has shown significant interest in using generative AI models, achieving a number of breakthrough results (see e.g., Davies et al. 2021 , Hayes et al. 2025 , etc) , culminating in a 2024 Nobel Prize in Chemistry awarded in part for work with a significant component in protein structure design and generation ( The Royal Swedish Academy of Sciences 2024 ) . Yet, the adoption of generative AI (GenAI) methods more generally is hindered by their lack of reliability (see e.g., Farquhar et al. 2024 , Strauss et al. 2025 , Manduchi et al. 2025 , etc) . At their core, these methods rely on sampling from probability distributions over complex spaces that are learned from huge datasets. At the outset, GenAI does not provide any guarantees about correctness, safety, or any other desired criteria. While the performance and reliability of GenAI models is increasing steadily, so far, issues around reliability have not been successfully eliminated. {marginnote} \entry Generative AIThe construction of probabilistic models over large semantic spaces (text, images, etc.) that allows sampling from these models, given certain inputs. Statistical methods offer potential opportunities to improve the reliability of GenAI systems. In this paper, we review several examples, highlighting statistical methods with proven or potential applications in generative AI. We focus on four topics: improving and changing the behavior of systems, diagnostics and uncertainty quantification, AI evaluation, as well as interventions and experiment design. We highlight here that the approaches we discuss are as of now mainly in the research phase, and they are usually not yet deployed in mainstream generative AI products. Their eventual usefulness remains to be determined. 1.1 About This Review Generative AI models are commonly studied separately, for each specific modality that they pertain to (text, images, video, etc), or based on the underlying technology (diffusion models, large language models or LLMs, etc). There are already a few reviews with significant coverage of statistics related to these topics individually, including Chen et al. 2024 , Zhang et al. 2025 for diffusion models, Suh & Cheng 2024 for deep learning more generally, but also touching on generative models, and Ji et al. 2025 for language models. Our focus is different, rendering our work largely non-overlapping with the above works. We focus on techniques that are applicable to all generative AI models, regardless of their modality. Moreover, with a few exceptions, do not focus on statistical methods that are applicable to generative AI only when the tasks of interest are essentially simple classification/regression tasks (e.g., multiple-choice question-answering with LLMs). For these, there are already numerous useful references. We also focus specifically on statistical methodology for AI and omit discussion about statistical theory of generative AI, as well as statistics-adjacent methods that primarily leverage optimization or other techniques. Further, we omit certain topics, such as watermarking and ranking from human preferences, which have already been discussed in detail in the above works. Due to space limitations, we mainly consider simple methods that have clear theoretical motivation and often provable guarantees. Moreover, we also omit discussion of how generative AI models can be used to improve statistical analysis, see e.g., Bashari et al. 2025 for a representative example. Target audience. Our target audience includes statisticians eager to see how their expertise can drive impact in generative AI, AI researchers interested in how statistical methods can strengthen their tools, and scientists looking to better understand this emerging area. For this reason, our paper aims to be largely self-contained, with prerequisites that include knowledge of introductory undergraduate-level probability and statistics, and a basic familiarity with AI at the advanced undergraduate level. 1.2 What is Generative AI? Table 1: Representative types of generative AI models and their input and output spaces. Generative AI Model \hat{p} Input Space \mathcal{X} Output Space \mathcal{Y} Language Models Text Text Diffusion Models Text Images Multimodal Language Models Images, text Images, text, sound, video Protein Structure Generation Amino acid sequence 3D structure Generative AI usually refers to the use of generative models, which are learned probability distributions one can sample from. Concretely, consider an input space \mathcal{X} (e.g., images, text, documents, their combinations, etc., represented in an appropriate way) and an output space \mathcal{Y} (similarly, this could be images, text, audio, video, etc). See Table 1 for some examples. Formally speaking, this includes as a special case standard statistical machine learning problems such as classification (when \mathcal{Y} consists of the classes) and regression (when \mathcal{Y}=\mathbb{R} , for instance). However, the cases of interest in generative AI are usually high-dimensional spaces \mathcal{Y} representing objects that are semantically meaningful to humans, such as text—viewed as a sequence of symbols (x_{1},\ldots,x_{k})\in V^{k} for a finite set V of symbols—or images, viewed as tensors representing pixels. {marginnote} \entry Generative ModelA generative model \hat{p} provides a way to sample an output Y\sim\hat{p}(\cdot\mid x) from the conditional distribution of \hat{p} given any input x\in\mathcal{X} . Figure 1: General workflow of a generative model: inputs (e.g., text prompts, images) are processed through a black-box model to produce outputs. Generative AI models are often designed for interaction with humans. A simple protocol is as follows: The user inputs a specific x\in\mathcal{X} , for instance, a text prompt such as “How can I fix a broken lamp?”. Then, the generative model \hat{p} provides a way to draw a sample Y\sim\hat{p}(\cdot\mid x) from the conditional distribution \hat{p} given x ; for instance, a textual response by the language model such as “To fix a broken lamp, you need to […]”. This is then returned to the user. See Figure 1