Energy Scaling Laws for Diffusion Models: Quantifying Compute and Carbon Emissions in Image Generation

Aniketh Iyengar, Jiaqi Han, Boris Ruf, Vincent Grari, Marcin Detyniecki, Stefano Ermon · 2025

Read Energy Scaling Laws for Diffusion Models: Quantifying Compute and Carbon Emissions in Image Generation by Aniketh Iyengar, Jiaqi Han, Boris Ruf, Vincent Grari, Marcin Detyniecki, Stefano Ermon (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-17031.txt.

Introduction

Aniketh Iyengar and five co-authors ask a practical question about image-generating diffusion models: how much energy will a given model use on a given graphics card? Energy use is climbing as these models spread, yet there was no principled way to predict it before running a job. The team adapts the scaling-law approach, which links energy to the amount of computation, measured in floating-point operations.

They split generation into text encoding, the repeated denoising steps, and decoding, and argue denoising dominates energy use. Experiments covered four leading models on three graphics card designs, across resolutions, precision settings, and step counts. The resulting law predicted energy within each hardware family very accurately and ranked new model and hardware pairings well. Such forecasts can guide greener deployment choices.

Catalog record

CREATORAniketh Iyengar, Jiaqi Han, Boris Ruf, Vincent Grari, Marcin Detyniecki, Stefano Ermon
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE51 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-17031

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Energy Scaling Laws for Diffusion Models: Quantifying Compute and Carbon Emissions in Image Generation Aniketh Iyengar, Jiaqi Han, Boris Ruf, Vincent Grari, Marcin Detyniecki, Stefano Ermon Abstract The rapidly growing computational demands of diffusion models for image generation have raised significant concerns about energy consumption and environmental impact. While existing approaches to energy optimization focus on architectural improvements or hardware acceleration, there is a lack of principled methods to predict energy consumption across different model configurations and hardware setups. We propose an adaptation of Kaplan scaling laws to predict GPU energy consumption for diffusion models based on computational complexity (FLOPs). Our approach decomposes diffusion model inference into text encoding, iterative denoising, and decoding components, with the hypothesis that denoising operations dominate energy consumption due to their repeated execution across multiple inference steps. We conduct comprehensive experiments across four state-of-the-art diffusion models (Stable Diffusion 2, Stable Diffusion 3.5, Flux, and Qwen) on three GPU architectures (NVIDIA A100, A4000, A6000), spanning various inference configurations including resolution ( 256 2 256^{2} - 1024 2 1024^{2} ), precision ( fp16 / fp32 ), step counts ( 10 10 - 50 50 ), and classifier-free guidance settings. Our energy scaling law achieves high predictive accuracy within individual architectures ( R 2 > 0.9 R^{2}>0.9 ) and exhibits strong cross-architecture generalization, maintaining high rank correlations across models and enabling reliable energy estimation for unseen model–hardware combinations. These results validate the compute-bound nature of diffusion inference and provide a foundation for sustainable AI deployment planning and carbon footprint estimation. 1 Introduction The rapid advancement of generative AI, particularly diffusion models ( 30 ; 9 ; 28 ) for high-quality image synthesis, has transformed creative applications and scientific visualization. Models like Stable Diffusion ( 25 ) , DALL-E ( 24 ) , and recent innovations such as Flux ( 5 ) and Gemini 2.5 Flash Image "Nano Banana" ( 7 ) can generate photorealistic images from text prompts with unprecedented quality. However, this capability comes at substantial computational cost—generating a single high-resolution image can require billions of floating-point operations across dozens of denoising steps. As these models are deployed at scale, their energy consumption has become a critical concern. Recent studies estimate that training large language models can consume as much electricity as hundreds of homes over several months ( 31 ) , and inference costs can be equally significant when scaled to billions of users. For diffusion models, the energy challenge is compounded by their iterative nature—unlike single forward-pass models, diffusion models require multiple denoising steps, each involving full network evaluation ( 9 ; 29 ) . Despite the critical importance of energy efficiency, current approaches to estimating diffusion model energy consumption rely primarily on empirical measurements or crude approximations. The research landscape presents significant gaps: limited research on diffusion models compared to language models ( 31 ; 17 ) , lack of predictive models that enable planning rather than reactive measurement, limited generalization across model-hardware combinations, absence of theoretical frameworks relating computational complexity to energy usage, and hardware heterogeneity that complicates cross-platform prediction. This work addresses these challenges by developing the first principled approach to predicting diffusion model energy consumption based on computational complexity. Our key contributions are: (1) adaptation of Kaplan scaling laws ( 13 ) to formulate energy scaling relationships for diffusion models, (2) comprehensive FLOP decomposition for four major diffusion architectures, (3) cross-architecture validation demonstrating generalization across different model families, (4) hardware-aware modeling incorporating precision and GPU architecture effects, and (5) practical framework for sustainable AI deployment planning. 2 Related Work Energy Efficiency in Deep Learning. The environmental impact of machine learning has gained increasing attention. Strubell et al. ( 31 ) demonstrated that training large transformer models can produce as much CO 2 as several cars over their lifetimes. Henderson et al. ( 8 ) established frameworks for systematic carbon footprint reporting. Tools like CarbonTracker ( 2 ) and CodeCarbon ( 3 ) provide energy monitoring, though they focus on measurement rather than prediction. Recent work by Luccioni et al. ( 17 ; 18 ) analyzed energy consumption for large models but remains reactive rather than predictive. Scaling Laws for Neural Networks. Kaplan et al. ( 13 ) established foundational scaling laws for transformer-based language models, demonstrating that performance scales predictably with parameters, dataset size, and compute budget. The Chinchilla paper ( 11 ) refined these laws for optimal resource allocation. However, existing scaling laws focus on model performance rather than inference energy consumption, and primarily address auto-regressive language models rather than diffusion-based generative models. Diffusion Model Efficiency. Computational efficiency research has focused on reducing latency rather than energy consumption. DDIM ( 9 ) introduced deterministic sampling to reduce denoising steps. Classifier-free guidance ( 10 ) improved quality but doubled computational requirements. Latent diffusion models ( 25 ) reduce cost by operating in compressed spaces, but energy analysis has been limited to crude FLOP counting. Progressive distillation ( 27 ; 20 ) and few-step samplers ( 15 ; 16 ; 33 ) represent promising efficiency directions, but energy benefits vary across hardware platforms. Hardware-Aware Machine Learning. GPU architecture significantly impacts energy efficiency. Mixed-precision training ( 21 ) can reduce energy consumption while maintaining quality. Tensor core acceleration provides efficiency improvements that depend on workload characteristics ( 19 ; 12 ) . Our scaling law approach enables energy prediction across hardware platforms without exhaustive measurement. 3 Background and Theoretical Foundation 3.1 Diffusion Model Architecture Diffusion models generate images through a learned denoising process that iteratively refines random noise into coherent images. Modern text-to-image diffusion models typically consist of three main components: text encoding, iterative denoising, and image decoding. Text Encoding. Input text prompts are processed by transformer-based encoders (e.g., CLIP ( 22 ) , T5 ( 23 ) ) to produce contextual embeddings that guide the generation process. This step occurs once per inference and typically represents a small fraction of total computation. Iterative Denoising. The core computational process involves repeatedly applying a neural network to progressively denoise a latent representation. While many methods employ a U-Net ( 26 ) or standard Transformer backbone ( 32 ) , state-of-the-art diffusion models typically use variants of the MMDiT architecture ( 6 ) . Each denoising iteration requires a full forward pass through the network, with typical inference comprising 10–50 such steps. When classifier-free guidance is applied, the computational cost effectively doubles—whether implemented as an expanded batch dimension or two sequential forward passes—since both conditional and unconditional evaluations are required 1 1 1 Some models implement amortized classifier-free guidance using a learned token. Here, we instead consider the true classifier-free guidance case from a computational footprint perspective. . Image Decoding. The final denoised latent representation is decoded into pixel space using a learned decoder network (e.g., VAE decoder). Like text encoding, this occurs once per inference. The iterative nature of denoising makes it the dominant computational component, typically accounting for more than 90% of inference FLOPs, as shown by our decomposition analysis in Fig. 8 . 3.2 Kaplan Scaling Laws The original Kaplan scaling laws ( 13 ) demonstrate that model performance scales predictably with computational resources according to power-law relationships: L\propto N^{-\alpha_{N}} , L\propto C^{-\alpha_{C}} , and L\propto D^{-\alpha_{D}} , where L denotes loss,

Read the complete text