Transparent Screening for LLM Inference and Training Impacts

Arnault Pachot, Thierry Petit · 2026

Read Transparent Screening for LLM Inference and Training Impacts by Arnault Pachot, Thierry Petit (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-19757.txt.

Introduction

Pachot and Petit present a transparent screening tool that estimates the environmental impact of running and training current large language models when direct observation is limited. The tool turns plain-language descriptions of applications into bounded environmental figures and feeds a comparative online observatory of market models. Rather than claiming direct measurement of opaque proprietary services, it offers an auditable method tied to sources, aimed at better comparability, transparency, and repeatability.

Catalog record

CREATORArnault Pachot, Thierry Petit
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE19327
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.19757

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Transparent Screening for LLM Inference and Training Impacts Arnault Pachot, Thierry Petit Abstract This paper presents a transparent screening framework for estimating inference and training impacts of current large language models under limited observability. The framework converts natural-language application descriptions into bounded environmental estimates and supports a comparative online observatory of current market models. Rather than claiming direct measurement for opaque proprietary services, it provides an auditable, source-linked proxy methodology designed to improve comparability, transparency, and reproducibility. 1 Introduction This paper documents the transparent screening framework used in the ImpactLLM Observatory . The observatory now covers 41 models, and this manuscript explains how the interface extracts scenarios from natural-language descriptions, propagates them through bounded multi-factor screening proxies, and publishes the resulting comparative tables and figures. The goal is to keep those proxies auditable while keeping the application workflow fast and interpretable. The main contributions of this paper are threefold. First, it introduces a transparent screening framework for estimating inference and training impacts of large language models under limited observability. Second, it proposes a bounded multi-factor proxy methodology that separates inference and training estimates while making the main assumptions explicit. Third, it provides an operational implementation and a comparative observatory covering current market models. The remainder of this paper covers the technical design of the inference estimator, the training proxy, the comparative outputs currently exposed in the observatory, and the limits of those assumptions. The methodological premise is straightforward. For the dominant hosted LLM services, direct provider-side environmental telemetry is generally unavailable, even though those systems dominate practical use and public debate. In that context, avoiding approximation altogether does not produce a more rigorous discussion; it leaves room for opaque claims, unsupported comparisons, and contradictory numerical narratives. The role of the present paper is therefore not to claim direct measurement where none exists, but to define a bounded, source-linked, inspectable proxy framework that is methodologically preferable to unverifiable assertions. 2 Inference Screening Method The main practical question addressed by the tool is straightforward: given a software feature using an LLM, can we produce an inference estimate that is useful for screening and comparison when direct provider telemetry is absent? The current answer is deliberately limited. The estimator is inference-only . It excludes model training, embodied impacts, application-side software consumption, and ancillary infrastructure from the displayed result. This is not because those dimensions are unimportant, but because the available inference anchors are structured enough to support a transparent screening method, whereas mixing them with broader lifecycle terms would blur the meaning of the result. The design objective is also practical speed. Instead of asking users to fill a large technical form, the web interface starts from a natural-language description such as “We use GPT-4o-mini for customer support, around 4,000 uses per month.” A parser then maps this text to a compact scenario with model, request type, approximate tokens, usage volume, and country assumptions. The output is therefore fast to obtain, but every inferred parameter remains visible to the user and can be inspected or challenged. The current market-model release follows five rules. • It starts from an observed literature anchor rather than from provider claims. The retained prompt-energy anchor is the Gemini Apps median prompt energy reported by Elsworth et al.: 0.24 Wh/prompt [ 8 ] . • It makes token volume explicit. Prompt compute is approximated from input and output tokens, with a larger weight for output generation than for input processing. • It does not scale on raw parameters alone. It constructs effective active parameters by adjusting the target profile with context-window class, serving mode, modality support, and architecture notes. • It reports a bounded low-central-high interval rather than a single falsely precise point. • It derives carbon from retained energy and the electricity mix of the retained country, which is a contextual assumption rather than a model measurement. Formally, let E_{a}=0.24 Wh be the anchor value and P_{a}=180 the active-parameter proxy retained for the anchor model. For a target model t , let P_{t} denote active parameters, T_{in} input tokens, and T_{out} output tokens. We define weighted prompt-compute volume: V_{t}=T_{in}+\omega T_{out}, (1) with \omega=1.8 in the current release. The LLM inference literature distinguishes a prompt prefilling stage from an autoregressive decoding stage for output generation [ 29 ] . Here, \omega=1.8 is used as an internal screening prior to reflect that asymmetry, not as a directly measured constant from the cited source. The project reference scenario is: V_{ref}=1000+1.8\times 550=1990. (2) Effective active parameters are then defined by: P^{eff}_{t,s}=P_{t}\times F^{ctx}_{t,s}\times F^{srv}_{t,s}\times F^{mod}_{t,s}\times F^{arch}_{t,s}, (3) where s\in\{\mathrm{low},\mathrm{central},\mathrm{high}\} indexes the screening scenario. The final per-request energy estimate is: \hat{E}_{t,s}=E_{a}\times\left(\frac{P^{eff}_{t,s}}{P_{a}}\right)^{\alpha_{s}}\times\left(\frac{V_{t}}{V_{ref}}\right)^{\beta_{s}}. (4) The current implementation uses \alpha_{low}=0.85 , \alpha_{central}=0.95 , \alpha_{high}=1.05 , and \beta_{low}=0.85 , \beta_{central}=0.92 , \beta_{high}=1.0 . These exponents are internal screening priors. The central values are set close to linearity, but slightly below 1, to preserve interpretability while avoiding overstatement of cross-model differences from a single transferred anchor. The low and high values widen the response to reflect uncertainty in how effective active parameters and weighted token volume map to inference energy across opaque production systems. Carbon is then derived from the retained country mix: \hat{C}_{t,s,c}=\frac{\hat{E}_{t,s}}{1000}\times CI_{c}, (5) where CI_{c} is the carbon intensity of country c in gCO 2 e/kWh. This method is not presented as a physical law of inference scaling. It is a traceable screening proxy anchored in observed prompt energy and explicit contextual assumptions. Its purpose is to provide a fast and inspectable estimate for comparative reasoning, not an audited declaration of real provider-side energy use. 3 Training Screening Method The observatory also exposes training orders of magnitude for current market models. Here the uncertainty is even higher than for inference because published values are sparse, heterogeneous, and often reported only as aggregate emissions. A pure parameter-only scaling is therefore too brittle. The current release instead uses a second bounded proxy that combines retained parameter count with additional training priors. The training proxy starts from literature anchors that directly report training CO 2 e, and from training-energy reconstructions derived from those emissions when the source-country electricity mix is documented. For a target model t , the central training estimate is: \hat{E}^{train}_{t,s}=E^{train}_{a}\times\left(\frac{P_{t}}{P_{a}}\right)^{\alpha_{s}}\times\left(\frac{Tok_{t}}{Tok_{a}}\right)^{\beta_{s}}\times F^{reg}_{t,s}\times F^{arch-tr}_{t,s}\times F^{hw}_{t,s}, (6) where P_{t} is the retained parameter count, Tok_{t} is a training-token prior, F^{reg} is a training-regime prior, F^{arch-tr} captures architecture and multimodality assumptions, and F^{hw} is a hardware-class proxy. The value of 20 training tokens per retained parameter is currently used as a project screening prior when no model-specific public estimate is available. It should be read as a pragmatic default assumption, not as a direct measurement. This default is broadly consistent with the order of magnitude illustrated by Chinchilla, whose compute-optimal example combines 70B parameters with 1.4T training tokens, i.e. about 20 tokens per parameter [ 12 ] . The current release also defaults market models to a foundation-pretraining regime unless a narrower public indication exists. This second proxy is not used in the application estimator shown to users, which remains inference-only. It is used in the observatory and the comparative tables to avoid suggesting that training impacts can be projected from parameter count alone. The result should still be read as a screening order of magnitude rather than as an

Read the complete text