Photons = Tokens: The Physics of AI and the Economics of Knowledge
Alec Litowitz, Nick Polson, Vadim Sokolov · 2026
Read Photons = Tokens: The Physics of AI and the Economics of Knowledge by Alec Litowitz, Nick Polson, Vadim Sokolov (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-06630.txt.
Introduction
Litowitz and colleagues apply MacKay's energy-policy arithmetic to AI computation, treating the token as a physical quantity carrying measurable thermodynamic cost. From Landauer's principle, Shannon's channel capacity, and infrastructure data, they build a global token-production balance sheet and derive a question budget. Applying Coase's firm theory and the durable-goods monopoly problem, they locate where value concentrates and regulatory openings. Their claim is that expanding the token budget cannot resolve which questions merit asking, a problem of agency computation alone cannot solve.
Catalog record
| CREATOR | Alec Litowitz, Nick Polson, Vadim Sokolov |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 82375 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.06630
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Photons = Tokens: The Physics of AI and the Economics of Knowledge Alec Litowitz, Nick Polson, Vadim Sokolov Abstract Debates about artificial intelligence capabilities and risks are often conducted without quantitative grounding. This paper applies the methodology of MacKay 2009 —who reframed energy policy as arithmetic—to the economy of AI computation. We define the token , the elementary unit of large language model input and output, as a physical quantity with measurable thermodynamic cost. Using Landauer’s principle, Shannon’s channel capacity, and current infrastructure data, we construct a supply-and-demand balance sheet for global token production. We then derive a finite question budget : the number of meaningful queries humanity can direct at AI systems under physical, information-theoretic, and economic constraints. We apply Coase’s theory of the firm and the durable-goods monopoly problem to the AI value chain—from photon to atom to chip to power to token to question—to identify where economic value concentrates and where regulatory intervention is warranted. We argue that the expansion of the token budget does not resolve a deeper constraint: under structural uncertainty, the decisive variable is not how many questions can be answered but which questions are worth asking—a problem of agency and direction that computation alone cannot solve. We connect limits of measurement in the token economy to a structural parallel between Goodhart’s law and the Heisenberg uncertainty principle, and to Arrow’s impossibility result for efficient information pricing. The framework yields order-of-magnitude estimates that discipline policy discussion: at current efficiency, the projected 2028 US AI energy allocation of 326 TWh could support roughly 6.5 × 10 17 6.5\times 10^{17} tokens per year, or 225,000 tokens per person per day—more than three orders of magnitude above estimated mid-2024 utilization. 1 Introduction In 1957, dying of cancer, John von Neumann prepared what would be his final work: The Computer and the Brain , the Silliman Lectures at Yale that he was too ill to deliver ( von Neumann 1958 ) . In eighty pages, he argued that computation is a physical process. The brain and the digital computer are both engines for transforming energy into information, and the thermodynamic costs of this transformation are irreducible. A neuron dissipates roughly 10^{-3} ergs per operation; a vacuum tube of his era, roughly 10^{2} ergs—a factor of 10^{5} . The brain compensates for its slow, imprecise components through massive parallelism; the computer compensates through raw speed. In both systems, the fundamental operations are the same: storage and retrieval of information, governed by the laws of physics. Von Neumann died before he could finish the manuscript, but the thesis was complete: intelligence, whether natural or artificial, is computation, and computation is physics. Half a century later, David MacKay published Sustainable Energy—Without the Hot Air , a book that reframed energy policy as a problem of arithmetic ( MacKay 2009 ) . His method was simple: convert every energy source and every energy demand into the same unit—kilowatt-hours per day per person—and check whether the numbers balance. The debate over artificial intelligence needs both von Neumann’s insight and MacKay’s method. Von Neumann established that computation is physics; MacKay showed how to do the accounting. This paper applies MacKay’s arithmetic to the computational economy that von Neumann foresaw, with the token —the elementary unit of large language model input and output—playing the role the kilowatt-hour played in MacKay’s analysis. A token is a subword unit, typically three to four characters of English text. Generating one requires a forward pass through a neural network: a physical computation on silicon, consuming electricity, dissipating heat. The analogy to energy is not metaphorical. Power in physics is energy per unit time, measured in watts. Power in AI is information processed per unit time, measured in tokens per second. Both are physical quantities, both are finite, and both can be accounted for. The intellectual lineage runs through cybernetics and the theory of computation. Turing 1936 established the mathematical limits of computation: there exist well-defined problems that no finite procedure can solve, and every computable function can be realized by a universal machine. Wiener 1948 unified the study of control and communication in animals and machines under the principle that feedback requires information, and information has physical cost. von Neumann 1966 demonstrated that self-reproducing automata require a minimum complexity threshold—and that arbitrarily reliable systems can be built from unreliable components through redundancy. Shannon 1948 established the mathematical theory of communication, quantifying information in bits and proving that every physical channel has a finite capacity. Wiener 1950 drew the social implication: if machines process information as organisms do, then the consequences of automation are as much questions of physics as of policy ( Prigogine 1978 ) . Strubell et al. 2019 estimated the carbon footprint of training a large NLP model; Patterson et al. 2021 extended this to Google-scale training; Luccioni et al. 2024 shifted focus to inference. Our contribution differs in scope: rather than measuring individual models, we construct a balance sheet for the entire token economy. This paper develops five results. First, we construct a token budget : a MacKay-style balance sheet of global AI token supply and demand, grounded in current energy infrastructure data and physical efficiency limits (Sections 2 and 3 ). Second, we apply Coase’s theory of the firm and the durable-goods monopoly problem to the AI value chain—from photon to atom to chip to power to token to question—to identify where economic value concentrates and why it migrates upward in the stack (Section 4 ). Third, we derive a question budget : the finite number of meaningful queries that can be directed at AI systems, connecting Cox’s theory of questions to Shannon entropy and Landauer’s thermodynamic cost (Section 5 ). Fourth, we argue that physical and informational abundance does not resolve the problem of agency : under structural uncertainty, the binding constraint is not how many questions can be answered but which questions are worth asking—a problem of direction, path dependence, and judgment that computation alone cannot solve (Section 6 ). Fifth, we identify a measurement limit on the token economy—a structural parallel between Goodhart’s law and the Heisenberg uncertainty principle—and connect it to Arrow’s impossibility of efficient information pricing (Section 7 ). The central question is simple: How many questions is the world allowed to ask? 2 The Physics of Tokens A token is a physical object. Its generation requires a sequence of matrix multiplications on semiconductor hardware, consuming electrical energy and dissipating heat. Landauer 1961 proved that any logically irreversible computation—such as erasing a bit of information—must dissipate at least E_{\min}=k_{B}T\ln 2 (1) of energy into the environment, where k_{B}\approx 1.38\times 10^{-23} J/K is Boltzmann’s constant and T is the absolute temperature. At room temperature ( T\approx 300 K), this gives E_{\min}\approx 2.87\times 10^{-21} J per bit erased. The resolution of Maxwell’s demon paradox confirms this bound: any agent that reduces entropy in one part of a system must pay for the information it acquires by increasing entropy elsewhere ( Bennett 2003 ) . Computation is not free; it is a thermodynamic process. A token drawn from a vocabulary of size V carries at most \log_{2}V bits of information. For a typical LLM vocabulary of V\approx 100{,}000 , this gives \log_{2}(100{,}000)\approx 16.6