A New Kind of Network? Review and Reference Implementation of Neural Cellular Automata .
Martin Spitznagel, Janis Keuper · 2026
Read A New Kind of Network? Review and Reference Implementation of Neural Cellular Automata . by Martin Spitznagel, Janis Keuper (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-24990.txt.
Introduction
Spitznagel and Keuper review Neural Cellular Automata and provide code. Wolfram argued in 2003 that simple recursive cellular programs could replace equation-based models for modeling complex systems. Recent work pairs Wolfram's ideas with tunable neural networks that learn complex update rules from data. They can model complex, self-organizing systems. The paper unifies past work in a modular framework, with a reference implementation in NCAtorch.
Catalog record
| CREATOR | Martin Spitznagel, Janis Keuper |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 74732 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.24990
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A New Kind of Network? Review and Reference Implementation of Neural Cellular Automata . Martin Spitznagel, Janis Keuper Abstract Stephen Wolfram proclaimed in his 2003 seminal work “A New Kind Of Science” that simple recursive programs in the form of Cellular Automata (CA) are a promising approach to replace currently used mathematical formalizations, e.g. differential equations, to improve the modeling of complex systems. Over two decades later, while Cellular Automata have still been waiting for a substantial breakthrough in scientific applications, recent research showed new and promising approaches which combine Wolfram’s ideas with learnable Artificial Neural Networks: So-called Neural Cellular Automata (NCA) are able to learn the complex update rules of CA from data samples, allowing them to model complex, self-organizing generative systems. The aim of this paper is to review the existing work on NCA and provide a unified modular framework and notation, as well as a reference implementation in the open-source library NCAtorch . Project page and source code: https://www.neural-cellular-automata.org/ 1 Introduction 1.1 Cellular Automata Figure 1: Visualization of a simple, 1D CA with binary states. a) shows the recursive update of grid states over time by applying the update rules \mathcal{R} on the 3\times 1 cell neighborhoods shown in b). Cellular Automata (CA) have been a subject of study since the 1940s, notably by John von Neumann ( 47 ) and others. At its core, Cellular Automata are discrete computational models, which consist of a finite, regular grid \mathcal{G} of discrete cells. Each cell holds a discrete state s_{i,t} at a given discrete time-step t . As time progresses, cell states are updated recursively and synchronously across all cells, based on a set of rules \mathcal{R} that utilize the local neighborhood \mathcal{N}(s_{i,t}) to calculate the new cell state: s_{i,t+1}:=\mathcal{R}[\mathcal{N}(s_{i,t})] ( 41 ) . Figure 1 shows the computation process and rules for a basic CA with binary states ( s_{(x,y),t}\in\{0,1\}) . Cellular Automata gained significant public recognition in the 1970s through Conway’s "Game of Life" ( 6 ) . This game employed a binary Cellular Automaton on a two-dimensional grid and update-rules based on a 3\times 3 neighborhood. Applications and Theoretical Significance. Subsequent research demonstrated the broad applicability of CAs, including their use in biological ( 8 ; 3 ; 20 ) , chemical ( 13 ) , and physical modeling ( 49 ; 50 ) . Furthermore, certain CA configurations were shown to possess powerful theoretical computing properties, such as Turing Completeness ( 7 ) of certain CA configurations, thus establishing CAs as a universal computing model . This theoretical strength led Stephen Wolfram to propose his well-known work, “A New Kind Of Science” ( 48 ) . In it, he suggested that inherently limited mathematical formulations could be replaced by more powerful “simple programs” and formulated a new formal framework for numerous scientific applications grounded in Cellular Automata . 1.2 Basic Neural Cellular Automata From Fixed Rules to Neural Networks. Traditional Cellular Automata (CA) , as initially proposed by ( 48 ) , ( 6 ) , and ( 47 ) , are constructed using a fixed set of manually designed rules . For instance, the update rule shown in fig. 1 is known as “Rule #110” (named after the binary coding of the rule outputs), which is one of 2^{2^{3}}=256 possible rules for a 1D, binary-state CA with a neighborhood size of 3 , first introduced in ( 48 ) . Figure 2: Sketch of a basic CNN implementation of a 2D NCA with a 3D state space. The initial grid is fed into a CNN architecture which updates the state additively and is called recursively for each time step. During training, the network is trained via usual gradient updates computed per timestep. While all potential rules for a specific CA with predetermined discrete states \mathcal{S} and neighborhood-size \mathcal{|N|} can be generated combinatorially, these rule-spaces unfortunately grow exponentially . Even the relatively simple 2D binary CA used in the Game of Life already has 2^{2^{3\times 3}}=2^{512} possible rules for its 3\times 3 neighborhood. This challenge has made the idea of learning more complex rules from data — instead of designing them by hand — increasingly appealing. 30 introduced the concept of Neural Cellular Automata (NCA), which essentially substitutes the manually designed rules with artificial Neural Networks that are trained on problem-specific data. Equation 1 provides an abstract formalization of an NCA update function, where f_{\phi} denotes an arbitrary neural network with learnable parameters \phi . s_{i,t+1}:=s_{i,t}+f_{\phi}[\mathcal{N}(s_{i,t})],\quad s_{i}\in\mathcal{S} (1) Since f_{\phi} is space-invariant with respect to the grid \mathcal{G} (meaning the same f_{\phi} is applied at all positions i during a time step), ( 30 ) suggested an efficient implementation using “nested” Convolutional Neural Networks (CNNs) ( 25 ) . In its simplest form, the kernels (or filters) of a single convolutional layer model a learnable perception \mathcal{P}_{\mathcal{N},\phi} of neighborhoods \mathcal{N} matching the kernel size, followed by a learnable update layer \mathcal{U}_{\phi} implemented as 1\times 1 convolutions, which together implement learnable non-linear CA update rules \mathcal{R_{\phi}} on all cells s at time t simultaneously: s_{t+1}:=s_{t}+\mathcal{R_{\phi}}[s_{t}]:=s_{t}+\mathcal{U}_{\phi}[\mathcal{P}_{\mathcal{N},\phi}*s_{t}] (2) Figure 2 illustrates this basic CNN-based NCA architecture. The theoretical equivalence between "nested" CNNs and CA has been formally proven by ( 14 ) . It is important to note, however, that most NCA architectures relax the original CA property of discrete cell states, moving instead toward continuous vector state representations s_{i,t}\in\mathbb{R}^{n} . While the original work of 30 used a simple, LeNet ( 26 ) -like, 1-layer convolutional NCA to show impressive self-organizing and classification tasks on images, later works extended the use of CNNs to more complex network architectures: 40 showed NCA based image segmentation with larger CNNs, while 44 introduced an attention based implementation. NCAs based on GANs ( 32 ) , VAEs ( 34 ) or diffusion ( 23 ) also have been utilized for generative tasks. 15 applied a NCA based approach on graph data. 1.3 Contributions The contributions of this paper are threefold: I) We summarize the existing works on NCA in the (to the best of our knowledge) first systematic review and experimental evaluation of this novel research topic. II) We introduce a unified notation and modular decomposition that consolidates the disparate formulations of prior NCA works into a single coherent framework. III) We release NCAtorch 1 1 1 https://www.neural-cellular-automata.org/ , a PyTorch ( 35 ) open-source framework that consolidates established NCA practices and, novel to this domain, makes a range of standard deep-learning stability and training options available as configuration-level components in a single ready-to-use stack. 2 Reference Implementation: the NCAtorch Framework To facilitate systematic and reproducible research in NCA, we introduce a modular and extensible framework for experimentation. Its central objective is to compare different NCA architectures and components across a spectrum of tasks. The framework is built around an abstract base model, with key components managed through YAML files and pydantic for type-safe configuration. This design allows researchers to seamlessly implement and integrate new perception modules, training routines, and datasets. To ensure traceability, all training metrics and visualizations are optionally logged via Weights & Biases ( 2 ) . Related Frameworks. The original NCA and self-organizing systems releases are distributed as independent example notebooks without a shared configuration or