Beyond Moore’s Law: Harnessing the Redshift of Generative AI with Effective Hardware-Software Co-Design

Amir Yazdanbakhsh Google DeepMind · 2025

Read Beyond Moore’s Law: Harnessing the Redshift of Generative AI with Effective Hardware-Software Co-Design by Amir Yazdanbakhsh Google DeepMind (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-06531.txt.

Description

Amir Yazdanbakhsh argues that the fading of Moore's law forces computing to abandon its old split between hardware and software and embrace designing them together. For decades, the steady doubling of transistors let programmers gain speed without thinking about chips. As those gains shrink to increments, the strict boundary between the two worlds becomes a liability, especially for generative AI's huge appetite.

He traces hardware-software co-design through five historical epochs and notes the growing role of computer architects in teams with machine learning researchers. He also examines the hardware lottery, the way research directions win or lose based on available machines, and ways to soften its grip. The piece is a call to make co-design the default mindset.

Catalog record

CREATORAmir Yazdanbakhsh Google DeepMind
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE28 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-06531

Browse the full library · About the Tower of Babel