Modernizing Amdahl’s Law How Scaling Laws Reshape Computer Architecture Through Optimal Hardware Allocation
Chien-Ping Lu · 2026
Read Modernizing Amdahl’s Law How Scaling Laws Reshape Computer Architecture Through Optimal Hardware Allocation by Chien-Ping Lu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-20654.txt.
Introduction
Lu reframes Amdahl's law for the age of AI scaling and mixed hardware. The old law assumed a fixed split of serial and parallel work. Modern systems must share scarce resources across unlike parts. Workloads also shift as models grow. His version swaps processor count for an allocation choice. A value scalable fraction replaces the old parallel share. The model gives a sharp threshold past which custom hardware stops paying. It favors keeping a strong programmable base.
Catalog record
| CREATOR | Chien-Ping Lu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 25652 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.20654
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Modernizing Amdahl’s Law How Scaling Laws Reshape Computer Architecture Through Optimal Hardware Allocation Chien-Ping Lu Abstract Classical Amdahl’s Law quantifies the limit of speedup under a fixed serial–parallel decomposition and homogeneous replication. Modern systems instead allocate constrained resources across heterogeneous hardware while the workload itself changes: some stages become effectively bounded, whereas others continue to absorb additional compute because more compute still creates value. This paper reformulates Amdahl’s Law around that shift. We replace processor count with an allocation variable, replace the classical parallel fraction with a value-scalable fraction , and model specialization by a relative efficiency ratio between dedicated and programmable compute. The resulting objective yields a finite collapse threshold. For a specialized efficiency ratio R R , there is a critical scalable fraction S c = 1 − 1 / R S_{c}=1-1/R beyond which the optimal allocation to specialization becomes zero. Equivalently, for a given scalable fraction S S , the minimum efficiency ratio required to justify specialization is R c = 1 / ( 1 − S ) R_{c}=1/(1-S) . Thus, as value-scalable workload grows, specialization faces a rising bar. The point is not that programmable hardware is always superior, but that specialization must keep re-earning its place against a moving programmable substrate. The model helps explain increasing GPU programmability, the migration of value-producing work toward learned late-stage computation, and why AI domain-specific accelerators do not simply displace the GPU. 1 Introduction Amdahl’s Law [ 2 ] has long served as a foundational model for reasoning about performance scaling: \text{Speedup}=\frac{1}{(1-P)+\dfrac{P}{N}} (1) where P denotes the fraction of work assumed to be parallelizable and N denotes the number of processors. This formulation assumes: • homogeneous compute units, • replication-based scaling, and • a fixed decomposition between serial and parallel components. These assumptions no longer reflect modern systems. Modern platforms mix programmable compute, dedicated units, tensor engines, mixed precision arithmetic, and layered memory systems within a single device. Hennessy and Patterson described the present period as a “new golden age for computer architecture” [ 6 ] , driven by domain-specific efficiency optimization. Our point is that the central architectural issue is no longer simply whether hardware is domain-specific or general-purpose, but how scaling laws [ 8 ] reshape workload structure and, through it, resource allocation between them. Today’s architectures are heterogeneous. They rely on programmable compute augmented by specialized units, and their workload mix evolves with scale. In that setting, “speedup” and “core count” are no longer sufficient physical descriptions. Even the term “core” now covers a wide range of structures, from SIMD lanes and tensor datapaths to fixed-function assist blocks. We therefore return to a more fundamental quantity: Total normalized execution time under constrained resources. The central move of this paper is to replace “How much speedup do more cores buy?” with “How should constrained resources be allocated as the workload changes?” The mathematical center of the paper is the resulting collapse threshold: for a given specialized efficiency ratio R , there is a critical value-scalable fraction S_{c}=1-1/R beyond which the optimal specialized allocation falls to zero; equivalently, for a given S , specialization must exceed R_{c}=1/(1-S) to justify nonzero resource share. The examples that follow are interpretations of that result. 2 From Classical Amdahl to Hardware Allocation Classical Amdahl analysis writes normalized time as T_{A}(N)=(1-P)+\frac{P}{N} (2) under a fixed decomposition between serial and parallel work. Gustafson’s Law [ 5 ] relaxes that fixed decomposition by allowing the effective workload ratio to change with system scale: \text{Speedup}_{G}=(1-P)+P\cdot N. (3) Both are historically important, but both remain framed in the language of replication, processor count, and speedup. Figure 1 places that language in context. The present paper keeps the concern with performance under constraint, but changes the physical question: not how much speedup replication can buy, but how constrained resources should be allocated across heterogeneous hardware when the workload itself is changing. 20 40 60 0 20 40 60 N (processor count) speedup Speedup Form Amdahl, P=0.5 Amdahl, P=0.9 Amdahl, P=0.99 Gustafson, P=0.5 Gustafson, P=0.9 Gustafson, P=0.99 20 40 60 0 0.2 0.4 0.6 0.8 1 N (processor count) normalized time Time Form Figure 1: Historical legacy of classical scaling laws. Amdahl’s law (solid) and Gustafson’s law (dashed) shown side by side in speedup form and normalized-time form. Both are expressed in terms of processor count N and replication-based speedup, which is the framing the present paper leaves behind. 3 The Modernized Amdahl Model The central change in physical description is simple. Classical Amdahl-style analysis is written in terms of serial versus parallel work, processor count, and speedup under replication. Modern systems instead face a different design question: how should a constrained hardware budget be allocated between specialized logic and programmable compute when the workload itself is changing? We therefore introduce three variables: • x\in[0,1) : the fraction of constrained hardware resource allocated to specialized logic; • R>1 : the relative efficiency advantage of specialized hardware over programmable compute on the bounded portion of the workload; • S\in[0,1] : the value-scalable fraction of the workload, meaning the portion for which additional compute continues to create meaningful value over the design interval under consideration. The corresponding normalized execution time is T(x)=\frac{1-S}{1+(R-1)x}+\frac{S}{1-x}. (4) This setup makes four assumptions explicit. First, S and 1-S are normalized workload shares over the design interval under consideration. Second, specialization improves only the bounded share through the relative efficiency ratio R . Third, the value-scalable share remains on the programmable side because that is where additional compute continues to be productively absorbed. Fourth, the hardware trade-off is reduced to one constrained allocation dimension x , so the model is deliberately a first-order allocation law rather than a full chip-level microarchitectural description. The first term models the effectively bounded portion of the workload, which can benefit from specialization; the second models the value-scalable portion, which remains on the programmable side because it continues to absorb additional compute. Differentiating twice gives T^{\prime\prime}(x)=\frac{2(1-S)(R-1)^{2}}{\bigl(1+(R-1)x\bigr)^{3}}+\frac{2S}{(1-x)^{3}}. (5) This expression is strictly positive on [0,1) , so the objective is strictly convex and admits a unique global minimizer. The threshold condition is then obtained by differentiating once: T^{\prime}(x)=-\frac{(1-S)(R-1)}{\bigl(1+(R-1)x\bigr)^{2}}+\frac{S}{(1-x)^{2}}. (6) At the origin, T^{\prime}(0)=-(1-S)(R-1)+S. (7) So T^{\prime}(0)<0 exactly when S<1-\frac{1}{R}. (8) Since the objective is strictly convex, this condition separates the interior regime from the collapse regime. If S\geq 1-1/R , the unique optimum is the boundary point x^{*}=0 . In the interior regime, solving T^{\prime}(x)=0 yields x^{*}=\frac{\sqrt{\dfrac{(1-S)(R-1)}{S}}-1}{\sqrt{\dfrac{(1-S)(R-1)}{S}}+(R-1)}. (9) For a fixed scalable fraction S , specialization is justified only if R_{c}=\frac{1}{1-S}. (10) Equivalently, for a fixed efficiency ratio R , specialization collapses once S_{c}=1-\frac{1}{R}. (11) Within the interior regime, the optimal specialization share decreases monotonically as the value-scalable fraction rises, which follows directly from Equation ( 9 ). The threshold is finite rather than asymptotic. For example, when S=0.9 , specialization requires at least a 10\times relative efficiency advantage; when S=0.95 , it requires at least 20\times . As the value-scalable fraction rises, the bar for specialization rises rapidly. 0 5\cdot 10^{-2} 0.1 0.15 0.2 0.25 0.3 0.35 0.4 0.45 0.5 0.55 0.6 0.65 0.5 1 1.5 2 2.5 3 x^{*}=0 x (specialization fraction) T(x) (normalized execution time) S=0.2 S=0.5 S=0.8 S=0.9 S=0.95 optimal locus x^{*}(S) Figure 2: Normalized execution time T(x) versus