AI+HW 2035: Shaping the Next Decade

Deming Chen, Jason Cong, Azalia Mirhoseini, Christos Kozyrakis, Subhasish Mitra, Jinjun Xiong, Cliff Young, Anima Anandkumar, Michael Littman, Aron Kirschen, Sophia Shao, Serge Leef, Naresh Shanbhag, Dejan Milojicic, Michael Schulte, Gert Cauwenberghs, Jerry M. Chow, Tri Dao, Kailash Gopalakrishnan, Richard Ho, Hoshik Kim, Kunle Olukotun, David Z. Pan, Mark Ren, Dan Roth, Aarti Singh, Yizhou Sun, Yusu Wang, Yann LeCun, Ruchir Puri · 2026

Read AI+HW 2035: Shaping the Next Decade by Deming Chen, Jason Cong, Azalia Mirhoseini, Christos Kozyrakis, Subhasish Mitra, Jinjun Xiong, Cliff Young, Anima Anandkumar, Michael Littman, Aron Kirschen, Sophia Shao, Serge Leef, Naresh Shanbhag, Dejan Milojicic, Michael Schulte, Gert Cauwenberghs, Jerry M. Chow, Tri Dao, Kailash Gopalakrishnan, Richard Ho, Hoshik Kim, Kunle Olukotun, David Z. Pan, Mark Ren, Dan Roth, Aarti Singh, Yizhou Sun, Yusu Wang, Yann LeCun, Ruchir Puri (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-05225.txt.

Introduction

Deming Chen and team lay out a ten-year AI-hardware co-design roadmap, as the two paths intertwine inseparably. Fragmentation blocks adaptive systems across cloud, edge, and real settings, with progress hinging on intelligence per joule. The roadmap redefines scaling through leanness, joining, and cross-layer tuning across algorithms and designs. Success means a thousandfold leanness gain for training and inference, plus energy-aware self-optimizing cloud, edge, and real AI systems. It also means wider infrastructure access and human-centric design, via coordinated national and public-private initiatives.

Catalog record

CREATORDeming Chen, Jason Cong, Azalia Mirhoseini, Christos Kozyrakis, Subhasish Mitra, Jinjun Xiong, Cliff Young, Anima Anandkumar, Michael Littman, Aron Kirschen, Sophia Shao, Serge Leef, Naresh Shanbhag, Dejan Milojicic, Michael Schulte, Gert Cauwenberghs, Jerry M. Chow, Tri Dao, Kailash Gopalakrishnan, Richard Ho, Hoshik Kim, Kunle Olukotun, David Z. Pan, Mark Ren, Dan Roth, Aarti Singh, Yizhou Sun, Yusu Wang, Yann LeCun, Ruchir Puri
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE104690
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.05225

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

AI+HW 2035: Shaping the Next Decade Deming Chen, Jason Cong, Azalia Mirhoseini, Christos Kozyrakis, Subhasish Mitra, Jinjun Xiong, Cliff Young, Anima Anandkumar, Michael Littman, Aron Kirschen, Sophia Shao, Serge Leef, Naresh Shanbhag, Dejan Milojicic, Michael Schulte, Gert Cauwenberghs, Jerry M. Chow, Tri Dao, Kailash Gopalakrishnan, Richard Ho, Hoshik Kim, Kunle Olukotun, David Z. Pan, Mark Ren, Dan Roth, Aarti Singh, Yizhou Sun, Yusu Wang, Yann LeCun, Ruchir Puri Abstract Artificial intelligence (AI) and hardware (HW) are advancing at unprecedented rates, yet their trajectories have become inseparably intertwined. The exponential growth of large AI models and data-intensive applications demands ever more powerful and efficient hardware acceleration, while breakthroughs in specialized computing platforms, ranging from GPUs, FPGAs, and TPUs to emerging NPUs, analog AI chips, photonic systems, and neuromorphic processors, are redefining the limits of intelligent systems. This virtuous cycle is transforming the landscape of computing, but it also exposes a critical gap: despite rapid co-evolution, the global research community lacks a cohesive, long-term vision to strategically coordinate the development of AI and HW. Today’s algorithms are designed around yesterday’s systems, and tomorrow’s chips are optimized for today’s workloads. This fragmentation constrains progress toward holistic, sustainable, and adaptive AI systems capable of learning, reasoning, and operating efficiently across cloud, edge, and physical environments. At the same time, AI’s energy footprint has reached environmentally and economically unsustainable levels. Training a single frontier model can consume energy comparable to hundreds of households, and AI datacenters increasingly rival nations in power demand. The future of AI depends not only on scaling intelligence, but on scaling efficiency, achieving exponential gains in intelligence per joule, defined as meaningful capability, insight, or task performance per unit of energy, rather than unbounded compute consumption. Addressing this grand challenge requires rethinking the entire computing stack. This vision paper lays out a 10-year roadmap for AI+HW co-design and co-development, spanning algorithms, architectures, systems, and sustainability. We articulate key insights that redefine scaling around energy efficiency, system-level integration, and cross-layer optimization. We identify key challenges and opportunities, including the training–inference divide, infrastructure constraints, heterogeneous integration, and equitable access to advanced hardware. We examine important future trends, from memory-centric and 3D-integrated architectures to self-improving systems, decentralized AI agents, and emerging computing paradigms. We candidly assess potential obstacles and pitfalls, including siloed research, resource inequality, and over-reliance on hardware-only gains and propose integrated solutions grounded in algorithmic innovation, hardware advances, and software abstraction. Looking ahead, we define what success means in 10 years: achieving a 1000× improvement in efficiency for AI training and inference ; enabling energy-aware, self-optimizing systems that seamlessly span cloud, edge, and physical AI; democratizing access to advanced AI infrastructure; and embedding human-centric principles into the design of intelligent systems. Finally, we outline concrete action items for academia, industry, government, and the broader community, calling for coordinated national initiatives, shared infrastructure, workforce development, cross-agency collaboration, and sustained public–private partnerships to ensure that AI+HW co-design becomes a unifying, long-term mission. Corresponding Authors: Deming Chen, [email protected] ; Ruchir Puri, [email protected] . Executive Summary (1) Reinventing Computing and AI Foundations for 1000× Efficiency Achieving a 1000× improvement in AI training and inference efficiency requires deep co-innovation between AI models and hardware architectures. The rapid growth of large models has made data movement the dominant bottleneck, outpacing advances in compute, memory, and interconnect technologies. Addressing this challenge calls for a shift toward computation immersed in memory, enabled by dense 3D integration of compute and memory to provide ultra-high bandwidth at low energy cost. Meanwhile, developing low-complexity yet high-quality AI models, including hybrid, Shannon-inspired, neuro-inspired, approximate, and probabilistic models, is critical to reducing computational and memory demands without sacrificing accuracy. Hardware-aware models must further adapt to system constraints through techniques such as redundancy reduction, low-rank and low-precision training, and efficient test-time scaling. Combined with cross-layer optimization and transparent, hardware-agnostic benchmarking frameworks, this tight co-evolution of models, compilers, runtimes, libraries, architectures, and devices can deliver future AI systems that maximize intelligence per joule and usher in a new era of sustainable AI computing. (2) Revolutionizing Design Productivity and Adaptability The pace of AI innovation now far outstrips the speed of hardware and system design. Bridging this gap calls for AI-in-the-loop design workflows that embed learning and reasoning into every stage of development. Open datasets and standardized benchmarks are critical for transparency, reproducibility, and progress in electronic design automation (EDA). Fine-grained task–agent alignment, leveraging specialized large and small language models, will automate and accelerate design subtasks while aiming for intelligence efficiency. Combined with context engineering techniques, these advances will enable AI-native design methodologies that unify technology, architecture, and algorithms into a cohesive, adaptive co-design ecosystem. (3) Building Reliable and Trustworthy AI Systems As AI becomes ubiquitous, reliability and trustworthiness must be understood through fundamental trade-offs among accuracy, robustness, and efficiency, including complexity, energy, and latency. Robustness must span both models and hardware, motivating design methods that explicitly manage these trade-offs and provide guarantees on system behavior. AI hardware paradigms should be evaluated by their position on multi-dimensional trade-off surfaces, with strong methods approaching Pareto-optimality across key metrics. Achieving this requires formal verification, physics-informed constraints, and runtime monitoring. While general-purpose generative AI has transformed many domains, bridging the gap to hardware design demands specialized language models and context-engineered AI systems that understand the semantics of circuits, architectures, and design automation. Benchmarking must also evolve beyond MLPerf to include robustness, explainability, and sustainability. (4) Physical AI for Scientific Discovery, Robotics and Autonomous Agents The next leap in AI innovation lies in coupling data-driven learning with the laws of physics. Physics-informed AI, including approaches based on neural operators and differentiable simulators, offers a principled way to model multi-scale phenomena central to science and engineering, from materials discovery to chip design. At the same time, physical and embodied AI systems, such as robotics and autonomous agents operating in the real world, place stringent demands on energy efficiency, real-time responsiveness, and robustness, making tight integration between learning, control, and hardware essential. Despite their promise, progress in these areas is hindered by the lack of unified benchmarks, datasets, and scalable solvers. Emerging latent world models, such as Joint Embedding Predictive Architectures (JEPA), aim to learn structured latent representations of the physical world. These approaches may provide a foundation for integrating symbolic reasoning, physics-informed priors, and more efficient decision-making mechanisms in future AI systems. (5) Addressing Core Bottlenecks and Unifying AI+HW Evolution A major frontier for future AI lies in developing compact, energy-efficient models that rival frontier models in capability while operating effectively on edge and embedded platforms, including those supporting physical AI. Achieving this will require continued innovation beyond today’s dominant implementations, combining attention mechanisms with complementary architectures, algorithmic sparsity, state-space models, and system-level optimizations to improve efficiency, scalability, and generalization. On the hardware side, the next generation of AI computing platforms will be built on heterogeneous, memory-centric architectures that integrate AI accelerators, programmable fabrics, and quantum processors through scalable, low-latency interconnects. Cross-cutting priorities include AI+HW co-design, energy optimization across the full stack, AI-driven chip and system automation, and large-scale fleet efficiency. In addition, as agentic AI systems become increasingly capable, Human-AI Interaction (HAI) must remain a central focus, ensuring that humans and intelligent agents collaborate seamlessly, communicate intent transparently, and execute complex tasks

Read the complete text